deletion: honor change frequency #32

Closed
opened 3 months ago by René Wagner · 1 comments
Owner

Do not delete data which last sucessfull crawl is older than 30 days but the crawl delay is so large that it should not have been recrawled lately.

Approach:

  • only delete if last_crawl_success_at > 30 days and last_crawl_at < 30 days
  • only delete if last_crawl_success_at is older than today minus change frequency
Do not delete data which last sucessfull crawl is older than 30 days but the crawl delay is so large that it should not have been recrawled lately. Approach: - only delete if `last_crawl_success_at > 30` days and `last_crawl_at < 30 days` - only delete if `last_crawl_success_at` is older than today minus change frequency
René Wagner added the
bug
label 3 months ago
René Wagner added the
invalid
label 3 months ago
Poster
Owner

already implemented this way

already implemented this way
René Wagner closed this issue 3 months ago
Sign in to join this conversation.
No Milestone
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Loading…
There is no content yet.