Iyeoluwads/firecrawl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge branch 'main' of https://github.com/mendableai/firecrawl

Browse Source
This commit is contained in:
Nicolas
2024-11-27 12:47:12 -03:00
parent 02cd5bcfa4 b69c6f9f95
commit 53e0cb6b19
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
apps/api/src/scraper/WebScraper/utils/blocklist.ts
+1
View File
@@ -38,6 +38,7 @@ const allowedKeywords = [
'press', 'press',
'conditions', 'conditions',
'tos', 'tos',
'://library.tiktok.com',
'://ads.tiktok.com', '://ads.tiktok.com',
'://tiktok.com/business', '://tiktok.com/business',
'://developers.facebook.com' '://developers.facebook.com'