Commit Graph

18 Commits

Author SHA1 Message Date
Nicolas e5ca4364ba Nick: improvements to llm extract error handling 2024-08-30 11:57:55 -03:00
Nicolas d872bf0c4c Merge branch 'main' into v1-webscraper 2024-08-28 12:42:23 -03:00
Nicolas 1e08e6d317 Merge branch 'main' into nsc/job-priority 2024-08-27 15:01:58 -03:00
Gergő Móricz 1054a1397b Merge branch 'main' into v1-webscraper 2024-08-23 19:14:49 +02:00
Gergő Móricz 866e71910c further fixes 2024-08-23 18:27:00 +02:00
Gergő Móricz dd737f1235 feat(sentry): add queue instrumentation to 2024-08-22 19:17:51 +02:00
Gergő Móricz 6d48dbcd38 feat(sentry): add trace continuity for queue 2024-08-22 16:47:38 +02:00
Nicolas 477c3257dc Nick: 2024-08-21 22:53:33 -03:00
Nicolas c7bfe4ffe8 Nick: 2024-08-21 22:20:40 -03:00
Nicolas 0ea0a5db46 Nick: wip 2024-08-21 20:54:39 -03:00
Gergő Móricz 57730f6a35 priority changes 2024-08-15 18:58:07 +02:00
Gergő Móricz 2ca1017fc3 fix(crawl): make request 0 of crawl jobs higher priority 2024-08-14 19:34:18 +02:00
Gergo Moricz 4bbc9db1df fix: prioritize scrape jobs over crawl jobs 2024-08-13 21:31:34 +02:00
Gergo Moricz d7549d4dc5 feat: remove webScraperQueue 2024-08-13 21:03:24 +02:00
Nicolas f43d5e7895 Nick: scrape queue 2024-07-30 14:44:13 -04:00
Nicolas 7e002a8b06 Nick: bull mq 2024-07-30 13:27:23 -04:00
Gergő Móricz 6798695ee4 feat: move scraper to queue 2024-07-25 00:14:25 +02:00
Nicolas a6c2a87811 Initial commit 2024-04-15 17:01:47 -04:00