Nicolas f10f3f886b Merge pull request #410 from mendableai/feat/fire-engine-chrome-cdp ...

Support chrome-cdp and restructure sitemap fire-engine support.

2024-07-18 13:52:08 -04:00

..

__tests__

Update removeUnwantedElements.test.ts

2024-06-26 21:20:11 -03:00

custom

Nick: fixes

2024-07-18 13:19:44 -04:00

blocklist.ts

testing crawl with new.abb.com case

2024-06-24 16:25:07 -03:00

docxProcessor.ts

Added metadata.pageStatusCode and metadata.pageError properties to the responses

2024-06-13 17:08:40 -03:00

excludeTags.ts

Nick: max num tokens for llm extract (for now) + slice the max

2024-05-20 17:07:38 -07:00

imageDescription.ts

Fixing rate-limiter-flexible package version

2024-07-05 12:12:00 -03:00

maxDepthUtils.ts

Add unit tests to replace e2e

2024-06-15 16:43:37 -04:00

metadata.ts

Added metadata.pageStatusCode and metadata.pageError properties to the responses

2024-06-13 17:08:40 -03:00

parseTable.ts

Nick: fixes

2024-04-17 12:44:23 -07:00

pdfProcessor.ts

Nick:

2024-06-24 16:33:07 -03:00

removeUnwantedElements.ts

Update removeUnwantedElements.ts

2024-07-16 18:22:56 -03:00

replacePaths.ts

fix(WebScraper): infinite regex leading to fly.io instance hangs

2024-07-18 19:13:43 +02:00

utils.ts

Caleb: made changes per Rafaels requests

2024-07-17 11:29:05 -07:00