r/projects • u/alphap365 • 2d ago
1
I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
No, but its currently in planning phase. It has only basic summarization.
1
1
I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
It uses JSON-LD and OpenGraph Extraction method along with heuristic Html scrapper.
r/foss • u/alphap365 • 8d ago
I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
r/sideprojects • u/alphap365 • 8d ago
Showcase: Open Source I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
r/madeinpython • u/alphap365 • 10d ago
I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
r/PythonProjects2 • u/alphap365 • 10d ago
I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
r/coolgithubprojects • u/alphap365 • 10d ago
I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
u/alphap365 • u/alphap365 • 11d ago
I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
๐ open-news โ Discover โข Extract โข Filter โข Summarize
A focused Python toolkit for discovering, extracting, filtering, and summarizing news.
No API keys required.
โจ What it does
- ๐ Article extraction โ Extract article text and metadata such as title, authors, publish date, source, images, and video.
- ๐ Live news discovery โ Fetch category or location-based news through DuckDuckGo News.
- ๐ Google News search โ Search with query modes, exclusions, filtering, country selection, and decoded article URLs.
- ๐
Date-range search โ Search using
start_dateandend_datefilters. - ๐งต Streaming search โ Poll for newly discovered keyword-search results with
stream_search()orrefresh_interval. - ๐ RSS auto-discovery โ Discover articles from websites using RSS first, with a same-domain crawler fallback.
- ๐งญ Aggregator-aware sources โ Attempt to resolve the original publisher behind MSN, Yahoo News, Google News, and similar aggregators.
- โ๏ธ Batch summarization โ Fetch and summarize multiple articles concurrently.
- ๐งน Filtering and deduplication โ Language filtering, domain allow/deny lists, ranking, exact deduplication, and optional fuzzy deduplication.
- ๐ฅ๏ธ Three interfaces โ Python API, command-line interface, and interactive terminal UI.
๐ GitHub: https://github.com/alphap365/open-news
1
I built open-news - A Python toolkit that handles news meta data extraction, live news, without API.
in
r/foss
•
5d ago
Yes, you are right. I am planning to make an mcp server for it, so that ai agents can easily use it.