amit/chat-backend
1
0
Fork 0
mirror of https://github.com/thecyberlearn/chat-backend.git synced 2026-08-18 09:52:54 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
a0fce0b484
chat-backend/scraping
History
Django Template a0fce0b484 Initial commit: Django chat backend with enhanced web scraping 
Features:
- Django REST API backend
- Multi-strategy web scraping system (Beautiful Soup, Playwright, Firecrawl)
- Anti-detection features (proxy rotation, user-agent rotation)
- Data export functionality (JSON, CSV, TXT)
- Business and CrawledPage models
- Enhanced crawling service with fallback mechanisms

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-09-21 11:01:50 +05:30
..
__pycache__ Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
migrations Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
templates/scraping Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
__init__.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
admin.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
apps.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
models.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
proxy_manager.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
scrapers.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
SCRAPING_GUIDE.md Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
services.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
tests.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
urls.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30
views.py Initial commit: Django chat backend with enhanced web scraping 2025-09-21 11:01:50 +05:30