This project focuses on performing a complete data analysis workflow on a given dataset. The process includes data cleaning, exploratory data analysis (EDA) to uncover trends, and SQL for efficient data exploration and pattern identification. The goal is to derive meaningful insights from the raw data using Python libraries and SQL queries.
- Python: For data manipulation and analysis.
- Pandas: For data cleaning and manipulation.
- Matplotlib & Seaborn: For data visualization.
- SQL: For efficient data querying and pattern identification.
- Development Environment:
- Jupyter Notebook: For interactive data analysis and visualization.
- SQL Workbench: For executing and testing SQL queries.
- Data Cleaning: The initial dataset was processed to handle inconsistencies, such as missing values and incorrect data types, ensuring data quality for analysis.
- Exploratory Data Analysis (EDA): Using Pandas, Matplotlib, and Seaborn, I conducted a deep dive into the data. This involved creating various visualizations to understand variable distributions, relationships, and outliers.
- SQL Exploration: SQL queries were written and executed in SQL Workbench to perform efficient data exploration, aggregate data, and identify patterns that were not immediately obvious.
- Statistical Analysis: Basic statistical methods were applied to understand the relationships and correlations between key variables.
To replicate this analysis on your local machine, follow these steps:
- Clone the repository:
git clone [https://github.com/your-username/your-repository-name.git](https://github.com/your-username/your-repository-name.git)
- Navigate to the project directory:
cd your-repository-name - Install the required libraries:
pip install -r requirements.txt
- Run the analysis:
- Open the
analysis.ipynbfile in Jupyter Notebook to see the Python-based EDA. - The SQL queries used for exploration can be found in the
/sql_queriesfolder and can be run using an environment like SQL Workbench.
- Open the