fileDatastore request to AWS S3 limited to 1000 files
조회 수: 4 (최근 30일)
이전 댓글 표시
I have a bucket on an AWS S3 server which I can reach without any problems.
The issue is: The answer from the server is limited to 1000 files. How can I increase this number? My target is to get just the list of filenames.
I also tried different calls of fileDatastore.
imds = fileDatastore(['s3://',<bucket>,','/'],'FileExtensions','.csv','ReadFcn',@load,'IncludeSubfolders',true)
댓글 수: 4
Sameer Gummuluru
2020년 12월 1일
I was able to figure out a temporary solution to this, today. On older versions of MATLAB, I was able to use filedatastore to access more than 1000 files from S3. (I tried on MATLAB R2019a)
You can give it a try if working on older MATLAB versions is fine by you.
Jhon Wine
2021년 4월 18일
I have the same issue. When using Matlab R2020b I cannot get more than 1,000 files.
However while using Matlab R2019b, fileDataStore seems to return all the files I need.
Using AWS CLI seems to work fine, but is not as elegent of a solution.
답변 (1개)
Div Tiwari
2021년 4월 19일
Hi all, this issue was resolved in MATLAB R2021a and R2020b Update 5: https://www.mathworks.com/support/bugreports/details/2407120.
If you're using R2020b, you can install updates by clicking on the notification icon towards the top-right of the MATLAB window.
댓글 수: 1
Jhon Wine
2021년 4월 22일
I just installed R2021a, problem persists.
In fact I have two versions of Matlab on the same computer. 2019a shows 2000 files, 2021a shows 1000 files...
참고 항목
카테고리
Help Center 및 File Exchange에서 Introduction to Installation and Licensing에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!