100 Requests in 10 Seconds Download Limit

[noatech]

Hi,

Regarding the 100 Requests in 10 Seconds Download Limit, does it cover concurrent downloads as well?

The reason I ask is that each time I attempt to download 100 files concurrently (within the 10-second boundaries), I receive a "Too Many Requests" error.

It seems that "any" parallel download (even only 2 files concurrently) is causing same error.

The only way to avoid this error was to download one file at a time, but that is significantly slower.

Also, it looks to me that the limit is somewhere around 50 files/10 seconds instead of 100 as there are no errors if I would set delay by 200ms between downloads.

Could you please assist here?

Thanks.

[LetsGo]

Old data more than a year old or maybe 18 months is not much use.
Also, when back testing you don't need huge amounts of data.
I've been doing this for over 15 years and the markets have less liquidity and are less volatile.

[noatech]

How does this answer the question?

[rosettefilament]

Even though you're aiming for 100 files, concurrent downloads count as multiple requests within that 10-second window. The 200ms delay works because it spreads out your requests, staying below the threshold. To improve download speed, try increasing the delay slightly to find the fastest speed that reliably avoids the "Too Many Requests" error. You might also explore whether the service offering the downloads has a documented API or bulk download option that could handle many files more efficiently.