Gergő Móricz a8dc75f762 feat(crawl): add parameter to treat differing query parameters as different URLs (#892) ...

* add parameter to crawleroptions

* add code to make it work

2024-11-11 21:36:22 +01:00

..

alerts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

billing

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

idempotency

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

logging

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

notification

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

posthog.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

queue-jobs.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

queue-service.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

queue-worker.ts

feat(crawl): add parameter to treat differing query parameters as different URLs (#892)

2024-11-11 21:36:22 +01:00

rate-limiter.test.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

rate-limiter.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

redis.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

redlock.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

sentry.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

supabase.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

system-monitor.ts

debug: worker stall check

2024-11-08 20:19:44 +01:00

webhook.ts

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00