Commit Graph

27 Commits

Author SHA1 Message Date
Gergo Moricz b4dbf75537 fix(v1): check if url is string in blocklistMiddleware
Fixes FIRECRAWL-SCRAPER-JS-9Z
2024-09-10 10:25:14 +02:00
rafaelsideguide ad950a6c9d fixed controller res and tests 2024-09-04 11:29:32 -03:00
Nicolas 8431be5826 Nick: 2024-08-31 14:23:55 -03:00
Nicolas 170a8ebfe5 Nick: 2024-08-27 11:58:42 -03:00
rafaelsideguide 1ef41b92a0 feat: cancel
v0 implementation + e2e test
2024-08-27 09:42:55 -03:00
Nicolas 7d93eab0f8 Nick: 2024-08-26 18:48:00 -03:00
Nicolas 4d0acc9722 Merge branch 'main' into v1-webscraper 2024-08-26 16:22:05 -03:00
Nicolas 173f4ee1bf Nick: chrome cdp main | simple autoscaler 2024-08-23 20:09:59 -03:00
Gergő Móricz eea530e0ad feat(v1): update for sentry 2024-08-23 17:29:42 +02:00
Nicolas b36faeaf54 Nick: 2024-08-20 14:39:52 -03:00
Nicolas 27903247b6 Nick: map tests and fixes 2024-08-20 12:04:08 -03:00
rafaelsideguide fd7fdc1d52 added blocklist middleware 2024-08-19 13:28:54 -03:00
Gergő Móricz eb84673b06 feat: crawl status websocket WIP 2024-08-17 01:04:14 +02:00
Gergő Móricz e2a6ef26d3 mount v1Router under v1 path 2024-08-16 23:48:50 +02:00
Gergő Móricz f20328bdbb crawl status and document stuff 2024-08-16 22:48:05 +02:00
Gergő Móricz 8b7569f8f3 add zod, create middleware, update openapi declaration, add crawl logic 2024-08-15 23:30:33 +02:00
Gergő Móricz 4165de1773 v1 restructure 2024-08-15 21:51:59 +02:00
rafaelsideguide 6cdf4c68ec wip: map, crawl, scrape mockups 2024-08-06 15:24:45 -03:00
Nicolas 0c2e3a72cc Merge pull request #460 from mendableai/nsc/admin-router
Admin router + Improve redis notifications
2024-07-26 12:16:14 -04:00
Nicolas 7129d7993e Update v0.ts 2024-07-25 17:19:45 -04:00
Nicolas 28a8a98491 Update admin.ts 2024-07-25 14:58:14 -04:00
Nicolas 2014d9dd2e Nick: admin router 2024-07-25 14:54:20 -04:00
Jakob Stadlhuber be9e7f9edf Update Kubernetes configs for playwright-service, api, and worker
Added new ConfigMap for playwright-service and adjusted existing references.
Applied imagePullPolicy: Always to ensure all images are updated promptly.
Updated README to include --no-cache for Docker build instructions.
2024-07-24 18:54:16 +02:00
Eric Ciarla d280bcadf3 Add keyAuth 2024-05-07 13:52:42 -04:00
Nicolas 6d5da358cc Nick: cancel job 2024-05-06 17:16:43 -07:00
Nicolas 0146157876 Nick: mvp 2024-04-23 15:28:32 -07:00
Nicolas 23b2190e5d Nick: 2024-04-20 16:38:05 -07:00