Commit Graph

27 Commits

Author SHA1 Message Date
Nicolas 55dad82df1 Nick: fixed map search 2024-08-20 12:17:53 -03:00
Nicolas 27903247b6 Nick: map tests and fixes 2024-08-20 12:04:08 -03:00
Nicolas ff84f1fe5e Update map.ts 2024-08-16 20:42:36 -04:00
Nicolas 4314313477 Update map.ts 2024-08-16 19:56:18 -04:00
Nicolas af9a0a6f0b Update map.ts 2024-08-16 19:56:03 -04:00
Nicolas ba5279eafc Nick: all tests passing 2024-08-16 19:55:44 -04:00
Nicolas 5205c5f005 Update map.ts 2024-08-16 19:37:00 -04:00
Nicolas 0c05d096a9 Merge branch 'v1-webscraper' of https://github.com/mendableai/firecrawl into v1-webscraper 2024-08-16 19:33:58 -04:00
Nicolas ab48353226 Nick: /map almost good 2024-08-16 19:33:57 -04:00
Gergő Móricz eb84673b06 feat: crawl status websocket WIP 2024-08-17 01:04:14 +02:00
Gergő Móricz 4c1b74dab3 fix(map): remove robots.txt 2024-08-16 23:46:10 +02:00
Gergő Móricz 803577eeba feat(crawl): webhook 2024-08-16 23:42:48 +02:00
rafaelsideguide 086ba6280b fixed markdown format 2024-08-16 18:39:13 -03:00
Gergő Móricz aabfaf0ac5 clean up crawl-status, fix db ddos 2024-08-16 23:29:39 +02:00
rafaelsideguide e5b807ccc4 Merge branch 'v1-webscraper' of https://github.com/mendableai/firecrawl into v1-webscraper 2024-08-16 17:57:31 -03:00
rafaelsideguide 7a61325500 map + search + scrape markdown bug 2024-08-16 17:57:11 -03:00
Gergő Móricz 5896153d19 fix: crawl status and redis fixes 2024-08-16 22:52:48 +02:00
Gergő Móricz 3fcb21930e remove log 2024-08-16 22:48:23 +02:00
Gergő Móricz f20328bdbb crawl status and document stuff 2024-08-16 22:48:05 +02:00
Nicolas 23a033fe61 Nick: fixes and more e2e tests 2024-08-16 16:03:35 -04:00
Nicolas 200ce8e2ce Merge branch 'v1-webscraper' of https://github.com/mendableai/firecrawl into v1-webscraper 2024-08-16 14:16:35 -04:00
Nicolas 21d3798e49 Nick: initial e2e v1 tests for /scrape 2024-08-16 14:16:30 -04:00
rafaelsideguide 3f998b688d scrape ready 2024-08-16 15:14:37 -03:00
rafaelsideguide 9b1cb266a0 added origin to request types 2024-08-16 13:49:50 -03:00
Gergő Móricz 8b7569f8f3 add zod, create middleware, update openapi declaration, add crawl logic 2024-08-15 23:30:33 +02:00
Gergő Móricz 4165de1773 v1 restructure 2024-08-15 21:51:59 +02:00
rafaelsideguide 6cdf4c68ec wip: map, crawl, scrape mockups 2024-08-06 15:24:45 -03:00