Iyeoluwads/firecrawl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Basic react app

Browse Source
This commit is contained in:
Eric Ciarla
2024-07-23 21:48:11 -04:00
parent a0d89169ed
commit 565bc09439
19 changed files with 18856 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
apps/ui/ingestion-component/public/robots.txt
+3
View File
@@ -0,0 +1,3 @@
# https://www.robotstxt.org/robotstxt.html
User-agent: *
Disallow: