Skip to content
Snippets Groups Projects
Commit 5c8ca024 authored by unarist's avatar unarist Committed by Eugen Rochko
Browse files

Improve error handling on LinkCrawlWorker (#5250) 

* Improve error handling on LinkCrawlWorker

* Ignore TimeoutError and InvalidURIError too
* Record errors to debug log
* Enable dead job queue on LinkCrawlWorker

Since most of acceptable errors were already ignored, only our side issue should go to dead job queue.

* Ignore all http gem errors
parent d8b2f89d
No related branches found
No related tags found
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment