Add web admin features + fix scraper & translator
Frontend changes: - Add /admin dashboard for article management - Add AdminButton component (Alt+Shift+A on articles) - Add /api/admin/article API endpoints Backend improvements: - scraper_v2.py: Multi-layer fallback extraction (newspaper → trafilatura → readability) - translator_v2.py: Better chunking, repetition detection, validation - admin_tools.py: CLI admin commands - test_scraper.py: Individual source testing Docs: - WEB-ADMIN-GUIDE.md: Web admin usage - ADMIN-GUIDE.md: CLI admin usage - SCRAPER-IMPROVEMENT-PLAN.md: Scraper fixes details - TRANSLATION-FIX.md: Translation improvements - ADMIN-FEATURES-SUMMARY.md: Implementation summary Fixes: - Article scraping from 0 → 96+ articles working - Translation quality issues (repetition, truncation) - Added 13 new RSS sources
This commit is contained in:
@@ -8,9 +8,9 @@ from loguru import logger
|
||||
import config
|
||||
|
||||
# Import pipeline stages
|
||||
from scraper import run_scraper
|
||||
from scraper_v2 import run_scraper # Using improved v2 scraper
|
||||
from compiler import run_compiler
|
||||
from translator import run_translator
|
||||
from translator_v2 import run_translator # Using improved v2 translator
|
||||
from publisher import run_publisher
|
||||
import database
|
||||
|
||||
|
||||
Reference in New Issue
Block a user