mirror of
https://github.com/thecyberlearn/chat-backend.git
synced 2026-08-18 06:32:52 +00:00
a0fce0b484
Features: - Django REST API backend - Multi-strategy web scraping system (Beautiful Soup, Playwright, Firecrawl) - Anti-detection features (proxy rotation, user-agent rotation) - Data export functionality (JSON, CSV, TXT) - Business and CrawledPage models - Enhanced crawling service with fallback mechanisms 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
7 lines
125 B
Plaintext
7 lines
125 B
Plaintext
Django==5.2.6
|
|
firecrawl-py==4.3.6
|
|
python-decouple==3.8
|
|
requests==2.32.3
|
|
beautifulsoup4==4.12.3
|
|
lxml==5.3.0
|
|
playwright==1.47.0 |