mirror of
https://git.datalinker.icu/deepseek-ai/DeepSeek-V3.git
synced 2025-12-09 12:54:33 +08:00
e44e45bfc5
Comprehensive intelligence retrieval system for collecting and aggregating information about Nairobi, Kenya from multiple sources. Features: - Multi-source data collection (news, social media, government, tourism, business) - RESTful API with FastAPI - Automated scheduling for continuous data collection - Intelligence brief generation - Real-time trending topics tracking - Alert system for important updates - Web scraping with rate limiting and caching - Social media integration (Twitter, Instagram) - NLP-powered categorization and processing - Docker support for easy deployment - CLI for manual operations Components: - Data models with SQLAlchemy - Base collector class with extensible architecture - Source-specific collectors (news, social, government, tourism, business) - Data processor for brief generation - Scheduler for automated collection - Comprehensive API endpoints - CLI interface for manual control Documentation: - Complete README with setup instructions - Quick start guide - Example usage scripts - Docker Compose configuration - Environment configuration templates
19 lines
497 B
Python
19 lines
497 B
Python
"""
|
|
Data collectors for various sources
|
|
"""
|
|
from .base_collector import BaseCollector
|
|
from .news_collector import NewsCollector
|
|
from .social_media_collector import SocialMediaCollector
|
|
from .government_collector import GovernmentCollector
|
|
from .tourism_collector import TourismCollector
|
|
from .business_collector import BusinessCollector
|
|
|
|
__all__ = [
|
|
"BaseCollector",
|
|
"NewsCollector",
|
|
"SocialMediaCollector",
|
|
"GovernmentCollector",
|
|
"TourismCollector",
|
|
"BusinessCollector"
|
|
]
|