rafaelsideguide f4348024c6 Added check during scraping to deal with pdfs ...

Checks if the URL is a PDF during the scraping process (single_url.ts).

TODO: Run integration tests - Does this strat affect the running time?

ps. Some comments need to be removed if we decide to proceed with this strategy.

2024-05-13 09:13:42 -03:00

..

__tests__

Added check during scraping to deal with pdfs

2024-05-13 09:13:42 -03:00

controllers

Merge pull request #118 from mendableai/feat/test-suite

2024-05-08 12:47:17 -07:00

lib

Merge branch 'main' into feat/max-depth

2024-05-07 10:20:49 -07:00

main

Merge branch 'main' into nsc/cancel-job

2024-05-07 10:13:43 -07:00

routes

Add keyAuth

2024-05-07 13:52:42 -04:00

scraper/WebScraper

Added check during scraping to deal with pdfs

2024-05-13 09:13:42 -03:00

search

Update index.ts

2024-04-25 10:00:35 -07:00

services

Update credit_billing.ts

2024-05-09 15:29:58 -07:00

control.ts

Initial commit

2024-04-15 17:01:47 -04:00

example.ts

Initial commit

2024-04-15 17:01:47 -04:00

index.ts

Changed from active to waiting jobs

2024-04-23 16:07:22 -03:00

strings.ts

Initial commit

2024-04-15 17:01:47 -04:00

supabase_types.ts

Initial commit

2024-04-15 17:01:47 -04:00

types.ts

nested includeHtml inside pageOptions

2024-05-07 13:40:24 -03:00