index: timestamp exception #17

Closed
opened 9 months ago by René Wagner · 2 comments
Owner
2021-02-26 23:27:40,221 build_index INFO     Indexing page: gemini://gemini.techrights.org/2015/07/02/political-fire-and-epo/index.gmi
Feb 26 23:27:41 v2202102141844143923 poetry[15162]: Traceback (most recent call last):
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:   File "<string>", line 1, in <module>
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:   File "/home/gus/gus/build_index.py", line 132, in main
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:     build_index(args.should_run_destructive, args.invalidation_window)
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:   File "/home/gus/gus/build_index.py", line 119, in build_index
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:     index_page(index, page, indexed_urls)
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:   File "/home/gus/gus/build_index.py", line 72, in index_page
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:     "indexed_at": datetime.strptime(page.crawl_timestamp, "%Y-%m-%d %H:%M:%S.%f"),
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:   File "/usr/lib/python3.7/_strptime.py", line 577, in _strptime_datetime
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:     tt, fraction, gmtoff_fraction = _strptime(data_string, format)
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:   File "/usr/lib/python3.7/_strptime.py", line 359, in _strptime
Feb 26 23:27:41 v2202102141844143923 poetry[15162]:     (data_string, format))
Feb 26 23:27:41 v2202102141844143923 poetry[15162]: ValueError: time data '2021-02-26 07:57:30' does not match format '%Y-%m-%d %H:%M:%S.%f'
``` 2021-02-26 23:27:40,221 build_index INFO Indexing page: gemini://gemini.techrights.org/2015/07/02/political-fire-and-epo/index.gmi Feb 26 23:27:41 v2202102141844143923 poetry[15162]: Traceback (most recent call last): Feb 26 23:27:41 v2202102141844143923 poetry[15162]: File "<string>", line 1, in <module> Feb 26 23:27:41 v2202102141844143923 poetry[15162]: File "/home/gus/gus/build_index.py", line 132, in main Feb 26 23:27:41 v2202102141844143923 poetry[15162]: build_index(args.should_run_destructive, args.invalidation_window) Feb 26 23:27:41 v2202102141844143923 poetry[15162]: File "/home/gus/gus/build_index.py", line 119, in build_index Feb 26 23:27:41 v2202102141844143923 poetry[15162]: index_page(index, page, indexed_urls) Feb 26 23:27:41 v2202102141844143923 poetry[15162]: File "/home/gus/gus/build_index.py", line 72, in index_page Feb 26 23:27:41 v2202102141844143923 poetry[15162]: "indexed_at": datetime.strptime(page.crawl_timestamp, "%Y-%m-%d %H:%M:%S.%f"), Feb 26 23:27:41 v2202102141844143923 poetry[15162]: File "/usr/lib/python3.7/_strptime.py", line 577, in _strptime_datetime Feb 26 23:27:41 v2202102141844143923 poetry[15162]: tt, fraction, gmtoff_fraction = _strptime(data_string, format) Feb 26 23:27:41 v2202102141844143923 poetry[15162]: File "/usr/lib/python3.7/_strptime.py", line 359, in _strptime Feb 26 23:27:41 v2202102141844143923 poetry[15162]: (data_string, format)) Feb 26 23:27:41 v2202102141844143923 poetry[15162]: ValueError: time data '2021-02-26 07:57:30' does not match format '%Y-%m-%d %H:%M:%S.%f' ```
René Wagner added the
bug
label 9 months ago
Poster
Owner

restarting the index will skip this error and will go further

restarting the index will skip this error and will go further
Poster
Owner

source: the timestamp parsing expects that milliseconds are given, but in the database they are skipped if millisecond 0 of a second is hit.

source: the timestamp parsing expects that milliseconds are given, but in the database they are skipped if millisecond 0 of a second is hit.
René Wagner closed this issue 8 months ago
Sign in to join this conversation.
No Milestone
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Loading…
There is no content yet.