Ademílson F. Tonato 843cec971d [FIR-796] feat(api/types): Add action and wait time validation for scrape requests ...

- Implement max actions limit (15 actions)
- Add total wait time calculation for actions
- Increase max waitFor time to 60 seconds
- Refactor scrape options schema to include validation

2025-02-07 21:16:38 +00:00

..

sharedLibs

fix(scrape): allow getting valid JSON via rawHtml (FIR-852) (#1138)

2025-02-06 18:35:28 +01:00

src

[FIR-796] feat(api/types): Add action and wait time validation for scrape requests

2025-02-07 21:16:38 +00:00

utils

feat(queue-worker): fix redirect slipping

2024-12-15 20:16:52 +01:00

.dockerignore

Initial commit

2024-04-15 17:01:47 -04:00

.env.example

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

.env.local

Add SearchApi to search

2024-09-05 18:36:59 +03:00

.gitattributes

Initial commit

2024-04-15 17:01:47 -04:00

.gitignore

Update .gitignore

2024-12-23 18:42:05 -03:00

.prettierrc

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

docker-entrypoint.sh

Fix corepack and self hosting setup (#1131)

2025-02-05 10:19:11 +01:00

Dockerfile

Fix corepack and self hosting setup (#1131)

2025-02-05 10:19:11 +01:00

fly.staging.toml

fix(fly): change proxy limits

2024-08-14 18:52:40 +02:00

fly.toml

fix(fly): change proxy limits

2024-08-14 18:52:40 +02:00

jest.config.js

Nick:

2024-04-20 16:38:05 -07:00

jest.setup.js

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

openapi-v0.json

add zod, create middleware, update openapi declaration, add crawl logic

2024-08-15 23:30:33 +02:00

openapi.json

add zod, create middleware, update openapi declaration, add crawl logic

2024-08-15 23:30:33 +02:00

package.json

feat(blocklist): Improve URL blocking with tldts parsing

2025-01-31 13:14:48 +00:00

pnpm-lock.yaml

feat(blocklist): Improve URL blocking with tldts parsing

2025-01-31 13:14:48 +00:00

requests.http

added cached scrapes to extract (#1107)

2025-01-31 13:58:52 -03:00

tsconfig.json

revert to pdf parse

2024-12-17 12:12:22 -05:00

v1-openapi.json

docs: update cancel crawl response

2025-01-24 16:16:17 +00:00