Feature request: CLI download throttling / random sleep #12

New issue

Open

opened 2026-06-02 08:12:52 +00:00 by analytik · 0 comments

analytik commented

2026-06-02 08:12:52 +00:00

(Migrated from github.com)

Hi,

Thank you for this crate! I managed to create a 1GB png that's 53000x47000 and mostly transparent because either Google wisely started blocking my requests after the first ~200MB downloaded, or the tiles don't exist in the zoom level 17. (I personally think requests should be throttled by default, but optional sleep is still fine.)

The most complex+performant+reliable combination would perhaps be something like: the first X hundred or thousand tiles can be downloaded with zero or minimal sleep (eg 20ms), then I think a randomized 200-600ms delay between tiles, then a ~5 minute delay if downloading more than say 10000 tiles, and/or when it encounters http 401/402/429/503/504.

It's not really a priority for me, I'd try to submit a PR, but I'd need to think more about it. Ideally I'd want to alter the tool to be able to download whole Earth very slowly at a lower resolution, and rethink how to split result images into tiles, but I get that's not your tool's intention.

Either way, thanks again and good luck with your endeavors!

Hi, Thank you for this crate! I managed to create a 1GB png that's 53000x47000 and mostly transparent because either Google wisely started blocking my requests after the first ~200MB downloaded, or the tiles don't exist in the zoom level 17. (I personally think requests should be throttled by default, but optional sleep is still fine.) The most complex+performant+reliable combination would perhaps be something like: the first X hundred or thousand tiles can be downloaded with zero or minimal sleep (eg 20ms), then I think a randomized 200-600ms delay between tiles, then a ~5 minute delay if downloading more than say 10000 tiles, and/or when it encounters http 401/402/429/503/504. It's not really a priority for me, I'd try to submit a PR, but I'd need to think more about it. Ideally I'd want to alter the tool to be able to download whole Earth very slowly at a lower resolution, and rethink how to split result images into tiles, but I get that's not your tool's intention. Either way, thanks again and good luck with your endeavors!