Rafael Miller 8d7e8c4f50 added cached scrapes to extract (#1107) ...

* added cached scrapes to extract

* dont save if exists

* no duplicates

* experimental tag

* Update requests.http

---------

Co-authored-by: Nicolas <nicolascamara29@gmail.com>

2025-01-31 13:58:52 -03:00

..

__tests__

(feat/extract) Refactor and Reranker improvements (#1100)

2025-01-27 20:07:01 -03:00

extract

added cached scrapes to extract (#1107)

2025-01-31 13:58:52 -03:00

LLM-extraction

Nick: fixes to extract rephrase prompt

2025-01-11 20:22:36 -03:00

batch-process.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

cache.ts

Update cache.ts

2025-01-23 02:37:04 -03:00

canonical-url.test.ts

Nick: formatting fixes

2025-01-10 18:35:10 -03:00

canonical-url.ts

Nick: url normalization

2025-01-03 23:54:03 -03:00

concurrency-limit.ts

fix(concurrency): proper job timeouting

2025-01-31 11:22:10 +01:00

crawl-redis.test.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

crawl-redis.ts

Nick: formatting done

2025-01-22 18:47:44 -03:00

custom-error.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

default-values.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

entities.ts

Nick: fixed prettier

2024-12-11 19:46:11 -03:00

html-to-markdown.ts

Update html-to-markdown.ts

2025-01-20 00:20:20 -03:00

html-transformer.ts

feat: rewrite html transformer in rust

2025-01-25 09:41:33 +01:00

job-priority.ts

(feat/conc) Move fully to a concurrency limit system (#1045)

2025-01-30 13:47:29 -03:00

logger.ts

Nick: formatting fixes

2025-01-10 18:35:10 -03:00

map-cosine.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

parse-mode.ts

Initial commit

2024-04-15 17:01:47 -04:00

parseApi.ts

Nick: fixed prettier

2024-12-11 19:46:11 -03:00

ranker.test.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

ranker.ts

Nick: formatting done

2025-01-22 18:47:44 -03:00

scrape-events.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

strings.ts

Nick: blocklist string

2024-12-20 18:09:49 -03:00

supabase-jobs.ts

Nick: fixed prettier

2024-12-11 19:46:11 -03:00

timeout.ts

Nick: fixed prettier

2024-12-11 19:46:11 -03:00

validate-country.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

validateUrl.test.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

validateUrl.ts

Nick: fixed prettier

2024-12-11 19:46:11 -03:00

withAuth.ts

fix: merge mock success data

2024-12-26 17:56:30 +08:00