Removed:
- All extra .md documentation files (kept only README.md)
- Test and debug scripts
- Data files and archives
- Cleaned text files
- Config and setup files not needed for production
Kept only:
- Core scraping and processing scripts
- Database and export utilities
- Automation scripts (daily_run.sh, setup_daily_automation.sh)
- Essential documentation (README.md)
- Dependencies (requirements.txt)
- Added `extract_listings.py` for extracting stock listings from TSX, TSXV, CSE, and CBOE using Playwright.
- Created `main.py` to orchestrate the entire stock intelligence system, including extraction, database import, financial scraping, news scraping, and report generation.
- Developed `populate_database.py` to populate the database with existing JSON data.
- Introduced `scrape_nasdaq_tsx_only.py` for focused scraping of NASDAQ and TSX stocks.
- Added `setup.py` for initial setup and testing of the system.
- Created `watchlist.txt` template for user-defined stock tracking.
- Generated `final_test_output.txt` to log the results of the test run.
Aherobo Ovie Victor