Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Multi-purpose Web Bots (Flight & BBC)

A command-line application featuring two distinct web-scraping bots: a Flight Scraper and a BBC News scraper. Developed using an MVC (Model-View-Controller) architecture, the project seamlessly integrates web automation and Natural Language Processing (NLP).

Key Features

  • MVC Architecture: Code is logically separated into Model, View, and Control components for maintainability.
  • Flight Bot: Scrapes flight information based on user-provided keywords.
  • BBC Bot with NLP: Scrapes news articles from the BBC and applies Natural Language Processing to summarize the text and perform sentiment analysis on the news data.

Technologies Used

  • Languages: Python
  • Architecture: Model-View-Controller (MVC)
  • Web Automation / Scraping: (Likely Selenium/BeautifulSoup behind the scenes)
  • NLP: Custom summarization and sentiment analysis pipelines (nlpbbc.py).

Project Structure

  • View/User_main.py: The entry point and command-line interface.
  • Control/FlightBot.py: Controller logic for handling flight queries.
  • Control/BBCbot.py: Controller logic for handling BBC news queries.
  • Control/nlpbbc.py: NLP utilities for text summarization and sentiment analysis.
  • Model/: Data structures and content handling.

Installation & Setup

  1. Clone the repository:

    git clone https://github.com/TalSomech/Web-bot.git
    cd Web-bot
  2. Setup your environment: Ensure you have Python 3.x installed along with the necessary scraping and NLP libraries (e.g., nltk, pandas, selenium, etc., depending on the specific implementation).

Usage Instructions

  1. Run the Application: Navigate to the root directory and execute the main script:

    python View/User_main.py
  2. Follow Prompts: The CLI will ask you to choose between the Flight Bot and BBC Bot. Enter 1 or 2. Provide keywords when prompted to search for flights or retrieve and analyze news articles.

About

web scraping bot for bbc articles and flight table using selenium

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages