crawl: set a timeout for every fetch
Closedopened 9 months ago by René Wagner · 2 comments
we should set a timeout for every page fetch.
Timeouts are sometimes 30 seconds, sometimes a few minutes...
I think 30 seconds would be ok to start with
René Wagner added the
enhancementlabel 9 months ago
René Wagner changed title from
set a timeout for every fetch to crawl: set a timeout for every fetch 9 months ago
Reference in new issue
There is no content yet.
Delete Branch '%!s(MISSING)'
Deleting a branch is permanent. It CANNOT be undone. Continue?