Nicolas 07f4b714af Update removeUnwantedElements.ts

2024-12-31 15:23:02 -03:00

..

__tests__

Update index.test.ts

2024-12-27 13:59:09 -03:00

controllers

Merge pull request #1014 from mendableai/nsc/extract-url-trace

2024-12-30 19:00:58 -03:00

lib

Merge pull request #1014 from mendableai/nsc/extract-url-trace

2024-12-30 19:00:58 -03:00

main

Nick: blocklist string

2024-12-20 18:09:49 -03:00

routes

Nick: blocklist string

2024-12-20 18:09:49 -03:00

scraper

Update removeUnwantedElements.ts

2024-12-31 15:23:02 -03:00

search

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

services

fix(queue-worker): do not follow redirect URLs if they are not allowed by the crawl options

2024-12-30 14:41:31 +01:00

control.ts

Initial commit

2024-04-15 17:01:47 -04:00

index.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

run-req.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

strings.ts

Nick: fixed prettier

2024-12-11 19:46:11 -03:00

supabase_types.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

types.ts

feat(runWebScraper): retry a scrape max 3 times in a crawl if the status code is failure

2024-12-14 00:54:05 +01:00