News Scraper & Summarizer

  • Tech Stack: OpenAI, BM25, NewsApi, BeautifulSoup, Scrapy-Spider
  • Github URL: Project Link

A command line application that searches the web for recent news articles matching a user-specified topic with a choice of language and provides a summary of the news .

It leverages third-party APIs for both news search, finetuned models for relevancy scoring, LM for named entity recognition and LLMs for summarization