Commit Graph

38 Commits

Author SHA1 Message Date
Nicolas 2d37dca9dc Nick: introduced system prompt to /extract 2024-12-18 22:10:41 -03:00
Nicolas a759a7ab7a Nick: small improvements 2024-12-18 21:45:06 -03:00
Nicolas ac187452c3 Nick: better filtering for urls that should be scraped 2024-12-17 17:34:55 -03:00
Nicolas b9f621bed5 Nick: extract fixes 2024-12-17 16:58:35 -03:00
Nicolas 79e335636a Nick: fixed extract issues 2024-12-17 16:40:45 -03:00
Nicolas 6d77879d68 Update extract.ts 2024-12-17 15:22:25 -03:00
Gergő Móricz e74e4bcefc feat(runWebScraper): retry a scrape max 3 times in a crawl if the status code is failure 2024-12-14 00:54:05 +01:00
Nicolas 8a1c404918 Nick: revert trailing comma 2024-12-11 19:51:08 -03:00
Nicolas 00335e2ba9 Nick: fixed prettier 2024-12-11 19:46:11 -03:00
Nicolas 4bb46ed152 Nick: extract prompt fixes and limit the number of urls 2024-12-01 20:29:03 -03:00
rafaelmmiller 943bbae88d fixed nested data inside extract 2024-11-27 18:29:37 -03:00
Nicolas 5522d6af7d Update extract.ts 2024-11-26 15:01:42 -03:00
Nicolas 8a26f08b14 Update extract.ts 2024-11-24 20:37:58 -08:00
Nicolas 2513efc971 Update extract.ts 2024-11-24 20:31:38 -08:00
Nicolas 30def84c0a Nick: scrape timeout + warnings 2024-11-24 19:44:51 -08:00
Nicolas b693c6c23b Update extract.ts 2024-11-24 19:36:18 -08:00
Nicolas 945183ffbd Update extract.ts 2024-11-20 16:40:55 -08:00
Nicolas d196b9d93d Update extract.ts 2024-11-20 13:16:36 -08:00
Nicolas 9512d81e05 Update extract.ts 2024-11-20 13:15:52 -08:00
Nicolas 3de4997f4d Loggin num tokens 2024-11-20 13:09:46 -08:00
Nicolas 769f08c10d Billing and log for extract 2024-11-20 13:08:09 -08:00
Nicolas 0e4e9a3b37 Nick: 2024-11-20 13:01:36 -08:00
Nicolas 67a2989874 Nick: fixes 2024-11-20 12:48:10 -08:00
Nicolas 91f4fd815f Update extract.ts 2024-11-14 15:41:42 -05:00
Nicolas 22848af5ae Nick: 2024-11-14 15:34:02 -05:00
Nicolas ebe9de2ac5 Nick: 2024-11-14 15:26:15 -05:00
Nicolas 796cd0746d Update extract.ts 2024-11-14 15:03:06 -05:00
Nicolas 1b5f6a0959 Update extract.ts 2024-11-14 14:59:34 -05:00
Nicolas d6749c211d Nick: refactor and /* glob pattern support 2024-11-14 14:57:38 -05:00
rafaelmmiller 904c904971 wip 2024-11-13 18:06:20 -03:00
rafaelmmiller 25f32000db mvp done? 2024-11-13 13:05:29 -03:00
rafaelmmiller a175c1513a wip 2024-11-13 08:09:51 -03:00
rafaelmmiller 807703d94c wip 2024-11-12 18:44:14 -03:00
Nicolas a23364e5da Update extract.ts 2024-11-12 12:23:44 -05:00
Nicolas a4f15260a7 Nick: 2024-11-12 12:23:24 -05:00
Nicolas d430cfcbfb Update extract.ts 2024-11-12 12:17:48 -05:00
Nicolas 540d4e5b56 Nick: 2024-11-12 12:10:18 -05:00
Nicolas 78badf8f72 Nick: wip 2024-10-28 16:02:07 -03:00