 Gergő Móricz
|
4bd2ff26d3
|
fix(llm-extract): pass stacktrace properly
|
2024-08-22 14:37:09 +02:00 |
|
|
Gergő Móricz
|
e4adbaa88e
|
fix(llm-extract): handle llm-extract if scrape failed
|
2024-08-22 14:12:52 +02:00 |
|
|
Gergő Móricz
|
670d253a8c
|
fix(auth): fix error reporting
|
2024-08-22 14:08:09 +02:00 |
|
|
Gergő Móricz
|
7d9f5bf8b1
|
fix(crawl): don't use sitemap if it's empty
Fixes FIRECRAWL-SCRAPER-JS-11
|
2024-08-22 13:41:33 +02:00 |
|
|
Gergő Móricz
|
1f580deefc
|
fix(crawl): validate includes.excludes regexes
|
2024-08-22 13:29:11 +02:00 |
|
|
Gergő Móricz
|
fbbc3878f1
|
fix(crawler): make sure includes/excludes is an array
|
2024-08-22 13:18:26 +02:00 |
|
|
Gergő Móricz
|
508568f943
|
fix(search): handle scrape timeouts on search
Fixes FIRECRAWL-SCRAPER-JS-15
|
2024-08-22 13:10:58 +02:00 |
|
|
Gergő Móricz
|
14fa75cae6
|
fix(crawl): send error if url is not a string
Fixes FIRECRAWL-SCRAPER-JS-1E and FIRECRAWL-SCRAPER-JS-Z
|
2024-08-22 13:09:08 +02:00 |
|
|
Gergo Moricz
|
0cdf41587e
|
feat(sentry): add error handles to try-catch blocks
|
2024-08-22 03:55:40 +02:00 |
|
 Nicolas
|
e78d2af1f0
|
Nick:
|
2024-08-21 21:51:54 -03:00 |
|
|
Gergő Móricz
|
629da74a5c
|
fix(sentry): decrease tracesSampleRate
|
2024-08-21 20:51:35 +02:00 |
|
|
Gergő Móricz
|
55009e51f5
|
fix: filter out invalid URLs from crawl links
|
2024-08-21 20:49:25 +02:00 |
|
|
Gergő Móricz
|
dae1408e66
|
fix(Dockerfile): retain sentry auth token properly
|
2024-08-21 20:40:42 +02:00 |
|
|
Gergő Móricz
|
ac9783ed2f
|
fix(sentry): adjust profiles sample rate to be even lower
|
2024-08-21 20:21:16 +02:00 |
|
|
Gergő Móricz
|
9579f03c4b
|
fix: import resolution
|
2024-08-21 20:16:06 +02:00 |
|
|
Gergő Móricz
|
6104d74213
|
fix(sentry): drop profiling sample rate
|
2024-08-21 20:12:47 +02:00 |
|
|
Gergő Móricz
|
3d5dc9d90a
|
feat(sentry): add log + server name
|
2024-08-21 19:39:10 +02:00 |
|
|
Gergő Móricz
|
85ff0c311e
|
Add worker ID to job attribute
|
2024-08-21 19:21:29 +02:00 |
|
|
Gergő Móricz
|
920702cdde
|
Update builder to handle uploading sourcemaps
|
2024-08-21 19:08:03 +02:00 |
|
|
Gergő Móricz
|
86942728e3
|
Add metadata for queue-worker and Express
|
2024-08-21 17:58:27 +02:00 |
|
|
Nicolas
|
35decb1af2
|
Nick:
|
2024-08-21 12:35:03 -03:00 |
|
 rafaelsideguide
|
52abec41c2
|
fixing delete
|
2024-08-21 10:35:50 -03:00 |
|
|
Nicolas
|
db8c84ff0f
|
Update requests.http
|
2024-08-21 10:19:37 -03:00 |
|
|
rafaelsideguide
|
b66553867e
|
reverting delete, fixed express bug on checkCredits
|
2024-08-21 09:28:20 -03:00 |
|
|
rafaelsideguide
|
138437d616
|
commenting out delete, crashing on fire-engine
|
2024-08-21 08:11:24 -03:00 |
|
|
rafaelsideguide
|
5e48bec1fd
|
commenting out delete, crashing on fire-engine
|
2024-08-21 08:10:46 -03:00 |
|
|
Nicolas
|
90b32f16c8
|
Nick: fixes
|
2024-08-20 21:38:11 -03:00 |
|
|
Nicolas
|
819ad50af3
|
Update fireEngine.ts
|
2024-08-20 21:16:33 -03:00 |
|
|
Nicolas
|
1b3ad60a2c
|
Reapply "Merge pull request #561 from mendableai/bug/dealing-with-dns-error"
This reverts commit ffe11a5bf7.
|
2024-08-20 19:22:09 -03:00 |
|
|
Nicolas
|
441628998f
|
Reapply "Merge pull request #561 from mendableai/bug/dealing-with-dns-error"
This reverts commit ffe11a5bf7.
|
2024-08-20 19:16:48 -03:00 |
|
|
Nicolas
|
ffe11a5bf7
|
Revert "Merge pull request #561 from mendableai/bug/dealing-with-dns-error"
This reverts commit 2030ec6031, reversing
changes made to f494d2b707.
|
2024-08-20 18:16:11 -03:00 |
|
|
rafaelsideguide
|
f98be7d94e
|
Update fireEngine.ts
|
2024-08-20 16:53:01 -03:00 |
|
|
Gergő Móricz
|
f494d2b707
|
prioritize search lower
|
2024-08-20 21:18:31 +02:00 |
|
|
Nicolas
|
59eb552df5
|
Merge pull request #560 from mendableai/feat/cancel-fire-engine
[Feat] Added check job and cancel to fire-engine requests
|
2024-08-20 15:43:31 -03:00 |
|
|
rafaelsideguide
|
1f27182a13
|
added try catch
|
2024-08-20 15:42:39 -03:00 |
|
|
Gergő Móricz
|
efb91f9ca5
|
fix(search): delete jobs after done
|
2024-08-20 20:29:08 +02:00 |
|
|
rafaelsideguide
|
e326249a57
|
added check job and cancel to fire-engine requests
|
2024-08-20 14:26:42 -03:00 |
|
|
Nicolas
|
5abd26a267
|
Nick: set the crawl limit to the remaining credits
|
2024-08-20 14:16:54 -03:00 |
|
|
rafaelsideguide
|
e1c9cbf709
|
bug fixed. crawl should not stop if sitemap url is invalid
|
2024-08-20 09:11:58 -03:00 |
|
|
rafaelsideguide
|
ecd472356b
|
added variables to beta customers
|
2024-08-19 16:41:54 -03:00 |
|
|
Nicolas
|
8e4ca86463
|
Update crawl.ts
|
2024-08-19 11:02:24 -03:00 |
|
|
Nicolas
|
36b35dbc67
|
Update crawl.ts
|
2024-08-19 11:01:26 -03:00 |
|
|
rafaelsideguide
|
4ffc60596a
|
Update queue-worker.ts
|
2024-08-19 09:29:23 -03:00 |
|
|
rafaelsideguide
|
b8170aaa47
|
Update blocklist.ts
|
2024-08-19 08:51:48 -03:00 |
|
|
Nicolas
|
3fe82b4f12
|
Update queue-worker.ts
|
2024-08-17 03:09:31 -04:00 |
|
|
Nicolas
|
f797380112
|
Nick:
|
2024-08-16 22:17:38 -04:00 |
|
|
Nicolas
|
47123be783
|
Nick: weird activity block
|
2024-08-16 22:01:56 -04:00 |
|
|
Gergő Móricz
|
c281fe62c0
|
fix(crawl): propagate db fix to preview endpoint
|
2024-08-16 23:43:54 +02:00 |
|
|
Gergő Móricz
|
e6738abf96
|
fix(crawl-status): retrieve from DB in bulk
|
2024-08-16 23:39:39 +02:00 |
|
|
Nicolas
|
78ca94251c
|
Merge pull request #480 from mendableai/nsc/hyper-v81
Reduce metrics ingestion w/ HyperDX v0.8.1
|
2024-08-16 14:34:14 -04:00 |
|