Skip to content

About

An end-to-end Automated Optical Inspection (AOI) pipeline coupling YOLOv8 dynamic component cropping with a PatchCore feature memory engine for real-time, unsupervised surface defect localization. Built with PyTorch, OpenCV, and Gradio.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

🏭 Industrial Surface Defect Inspection Dashboard

An end-to-end, two-stage Automated Optical Inspection (AOI) pipeline designed for real-time defect detection and localization on assembly lines. The system couples YOLOv8 for dynamic object localization with a PatchCore Feature Memory Engine for unsupervised pixel-level anomaly segmentation.

Python PyTorch Gradio OpenCV


Evaluation Images

good good1 defect defect1

📌 Project Overview

In industrial manufacturing, defective samples are rare, making supervised learning impractical. This project implements an unsupervised, few-shot anomaly detection system:

  1. Stage 1 (ROI Localization): Uses YOLOv8 (with an OpenCV contour-fallback engine) to extract and standardize the region of interest (ROI) of incoming components, filtering out variable assembly line backgrounds.
  2. Stage 2 (PatchCore Anomaly Detection): Extracts deep mid-level feature representations from a pre-trained ResNet backbone and compares them against a memory bank of normal (non-defective) reference components using nearest-neighbor search.

🌟 Key Features

  • Unsupervised Learning: Trained exclusively on good/normal samples—no labeled defect data required.
  • Pixel-Level Heatmaps: Generates localized anomaly heatmaps highlighting exact crack, scratch, or contamination boundaries.
  • Real-Time Interactive Dashboard: Built with Gradio for immediate image uploads, confidence threshold adjustments, and decision reporting.
  • Robust ROI Handling: Automatically falls back to full-frame/contour extraction if YOLO detection confidence drops.

🛠️ System Architecture

[ Input Image ] ──► [ Stage 1: ROI Detector (YOLOv8) ] ──► [ Cropped Component ROI ] │ ▼ [ Inspection Decision ] ◄── [ Stage 2: PatchCore Memory Engine ] ◄───┘ (PASS/FAIL + Heatmap) (ResNet-18 Embeddings vs Normal Bank)

Note on Anomaly Detection Scope: PatchCore is domain-specific. The memory bank is initialized using normal dataset samples (e.g., standard MVTec bottle images). Testing an out-of-domain object (e.g., pliers) against a bottle memory bank will correctly mark the object as anomalous due to high feature distance.


🚀 Quickstart & Setup Guide

Follow these steps to run the inspection dashboard on your local machine.

1. Prerequisites

  • Python 3.10+
  • Git
  • (Optional) CUDA-compatible GPU for faster ResNet feature extraction.

2. Clone the Repository

git clone [https://github.com/your-username/industrial-defect-inspection.git](https://github.com/your-username/industrial-defect-inspection.git)
cd industrial-defect-inspection

3. Create a Virtual Environment & Install Dependencies

# Create virtual environment
python3 -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install required packages
pip install --upgrade pip
pip install torch torchvision opencv-python numpy gradio ultralytics

🏃 Launching & Testing the Application
Step 1: Start the Dashboard
Launch the main application from the root directory:

python3 app.py

Step 2: Open Web UI
Open your web browser and navigate to:

http://localhost:7860


🧪 Evaluation & Demonstration Instructions
When evaluating or demonstrating this system:

Upload Normal Sample:

Upload a clean component image (e.g., a good bottle).

Set YOLO Confidence Threshold to 0.25 and Anomaly Score Threshold to 3.5.

Click Run Inspection.

Expected Result: System outputs ✅ NORMAL (PASS) with low anomaly scores.

Upload Defective Sample:

Upload an image containing a surface crack, scratch, or contamination.

Click Run Inspection.

Expected Result: System outputs ❌ DEFECT DETECTED and displays localized anomaly heatmaps highlighting the exact defect region.

Adjust Thresholds:

Modify the Anomaly Score Threshold slider to tune sensitivity for strict vs. relaxed industrial tolerances.

Lower YOLO Confidence Threshold (e.g., to 0.10) if handling custom or synthetic component geometry.
EOF

## 📊 Quantitative Evaluation Benchmark

The system was evaluated using a two-phase architecture (YOLO ROI Extraction + ResNet-18 Memory Bank Feature Engine) across clean and defective test sets.

| Metric | Result |
| :--- | :--- |
| **Total Test Samples** | 10 |
| **Classification Accuracy** | **100.0%** |
| **True Positives (TP)** | 5 |
| **True Negatives (TN)** | 5 |
| **False Positives (FP)** | 0 |
| **False Negatives (FN)** | 0 |
| **Average Normal Score** | `0.0086` |
| **Average Defect Score** | `8.6476` |

> **Key Takeaway:** The PatchCore feature engine demonstrates a massive score margin separation (~1000x score increase) between normal surface features and defect regions, enabling reliable thresholding without false alarms.

About

An end-to-end Automated Optical Inspection (AOI) pipeline coupling YOLOv8 dynamic component cropping with a PatchCore feature memory engine for real-time, unsupervised surface defect localization. Built with PyTorch, OpenCV, and Gradio.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages