- Introduce app/ package with config, services (storage, notifications), API server, and crawler modules - Add BaseCrawler and BarronsCrawler; extract notifications and storage - Keep enhanced_crawler.py as back-compat entry delegating to app.runner - Add template crawler for future sites - Update README with new structure and usage - Extend .env.template with DATA_DIR/LOG_DIR options
7 lines
141 B
Python
7 lines
141 B
Python
"""Modular crawler package.
|
|
|
|
This package separates API, crawlers, services, and configuration
|
|
to support multiple sites in the future.
|
|
"""
|
|
|