Mining AIS Big Data to Identify Hidden Fishing Activities in the Mediterranean Sea
Illegal, unreported, and unregulated (IUU) fishing threatens marine ecosystems and global food security. This project uses Machine Learning + AIS (Automatic Identification System) vessel data to detect hidden fishing patterns and identify possible illegal fishing hotspots in the Mediterranean Sea.
We process AIS data, detect suspicious behavior (like identity gaps), cluster dangerous zones, and visualize hotspots on an interactive map using Streamlit, Folium, and Heatmaps.
A KNN-based prediction system is also included to check whether a new vessel belongs to any hotspot.
- Sorting by MMSI and timestamp
- Calculating gaps between consecutive signals
- Detecting “identity hiding gaps” (AIS turned off)
- Identifying vessels with abnormal behavior
- Filtering real fishing-related points
- Density-based clustering to detect illegal-fishing zones
- Automatic centroid extraction
- Cluster quality metrics (Silhouette Score, Davies–Bouldin Score)
Predicts the cluster of a new vessel based on:
- Latitude
- Longitude
- Speed
- MMSI
If the vessel is too far from known clusters → returns Cluster = -1 (Safe / Not suspicious)
- ⚡ Heatmap visualization
- 📍 Cluster centroid markers
- 📄 Raw data display
- 🤖 Live vessel cluster prediction
- 🖤 Black theme with custom UI
- 📷 Optional Mediterranean Sea background image
- Python
- Scikit-Learn
- DBSCAN
- K-Nearest Neighbors (KNN)
- Clustering metrics
- AIS Big Data (simulated dataset of ~30,000 rows)
- Python
- Pandas
- NumPy
- Streamlit
- Folium
- HeatMap Plugin
- Custom HTML/CSS styling
AIS Big Data → Clean & Sort Data →
Detect AIS Gaps → Extract Suspicious Points →
Cluster Using DBSCAN → Generate Hotspot Centroids →
Train KNN Model → Deploy Streamlit Dashboard →
Predict Vessel Hotspot Risk
git clone https://github.com/your-username/illegal-fishing-hotspots.git
cd illegal-fishing-hotspotspip install -r requirements.txtstreamlit run app.pyUsually at:
http://localhost:8501
- Integrate real-time AIS streaming
- Use satellite imagery for validation
- Implement LSTM-based vessel behavior forecasting
- Add anomaly detection (Isolation Forest)
- Build a full maritime risk dashboard
Kevin Manjila
Machine Learning Developer