I export the released products v2 entity in the production environment. Our production environment has about 970,000 pieces of data, but it always fails. The error log is on the picture, which makes me very puzzled. I just do it in the sandbox environment. The released products V2 entity can be successfully exported, and there are only about 30,000 pieces of data in the sandbox environment
When do you get this error message? It’s talking about uploading a file, while you said you’re exporting data…
What I did is to export the data, this error is the log information
Could you be a bit more specific, please? How are you exporting the data? At what point did it fail? Is it specific to particular setup or don’t exports work at all?
I use export in data management to export released products v2 entity，There are related information and errors in the picture above
What if you export less records? Do you get the same error?
I tried to use filters to set conditions when exporting, as shown in the figure below,
But I exported 0 records. Is my filter criteria wrong?
get rid of the double quotes around the filter maybe?
Yes, I can successfully export 10,000 records after resetting the conditions. Is the 970,000 records exceeding a certain limit?
I tried to export 10000 records, there is no error
Maybe you get a file larger than what can be stored in a blob.
Let’s approximate the size. Take the size of your file with 10000 records and multiply it by 97. What result do you get?
I don’t quite understand what you mean. To be precise, I exported 9997 pieces of data. Is it 6.09×9997×97?
It depends on what file you’re looking at. If it’s the file with your 9997 records, then you shouldn’t multiply it with the number of records, because they’re already included. If it’s the case, then the estimated size of a file with 970000 products is 590 MB.
Your calculation would be correct if your file contained a single product, which doesn’t sound likely to me.
The file in the picture above is a file containing 9997 data，
Does this have anything to do with my failure to export 970,000 pieces of data?
600 MB isn’t that much; it shouldn’t be a problem. Also, it’s interesting that it’s an authorization-related error. If I was you, I would log a support request on LCS and let Microsoft investigate it.
agreed.
With the help of Microsoft to investigate, the cause of this error should be timeout. I successfully solved this problem after making some modifications.
The solution is as follows：
(a) Please go to the Framework parameters tile on the Data management workspace
(b) Then change the “Shared access signature expiration time” value to 120. By default time i set and relies on storage to flag the expiration. By setting a value we set the storage timeout