ressources fetched twice in single crawl #10

Closed
opened 10 months ago by René Wagner · 2 comments
Owner

It seems like ressources may be fetched multiple times during one crawl run:

Feb 08 06:16:30 geminispace-info poetry[1020238]: 2021-02-08 06:16:30,349 crawl    INFO     Fetching resource: gemini://gemini.conman.org/boston/2003/11/27.1
Feb 08 12:12:55 geminispace-info poetry[1020238]: 2021-02-08 12:12:55,033 crawl    INFO     Fetching resource: gemini://gemini.conman.org/boston/2003/11/27.1

Maybe ROOT_CHANGE_FREQUENCY_DEFAULT = 3 in constants.py is too short?

It seems like ressources may be fetched multiple times during one crawl run: ``` Feb 08 06:16:30 geminispace-info poetry[1020238]: 2021-02-08 06:16:30,349 crawl INFO Fetching resource: gemini://gemini.conman.org/boston/2003/11/27.1 Feb 08 12:12:55 geminispace-info poetry[1020238]: 2021-02-08 12:12:55,033 crawl INFO Fetching resource: gemini://gemini.conman.org/boston/2003/11/27.1 ``` Maybe `ROOT_CHANGE_FREQUENCY_DEFAULT = 3` in constants.py is too short?
René Wagner added the
bug
label 10 months ago
Poster
Owner

workaround in 02d00f10ed

workaround in 02d00f10ed
Poster
Owner
patch sent to upstream: https://lists.sr.ht/~natpen/gus/patches/20144
René Wagner closed this issue 10 months ago
Sign in to join this conversation.
No Milestone
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Loading…
There is no content yet.