Skip to main content [Tab]
AM
Asib Mahmud
←Back to Project Index
Editorial Feature/Computer Vision
01
Archival Record
●[CLIENT / CAPSTONE LAB: Industrial Quality Assurance Partner]

●[PROJECT NAME: Real-Time Defect Detection for Manufacturing Lines]

Replacing slow manual surface inspections with an edge-optimized YOLOv8 pipeline that spots micro-defects in 14 milliseconds.

RoleComputer Vision Engineer & ML Pipeline Lead
Year & Duration2025 • ●[3 MONTHS]
Team Structure●[2 ENGINEERS: 1 ML ENGINEER, 1 HARDWARE INTEGRATOR]
Focus DisciplineComputer Vision
Core Stack
PythonPyTorchYOLOv8OpenCVTensorRTFastAPIDocker
// Plain-English Summary for Stakeholders

When manufacturing items glide past a high-speed camera, human eyes get tired after 20 minutes. We trained a model to spot hairline fractures, scratches, and misalignment in real time, alerting the conveyor arm to discard broken items before packaging.

Phase 01 • The Problem

The factory floor operated on manual spot-checks where inspectors examined parts under high-glare LED bars.

Inspectors caught roughly 82% of surface flaws at shift start, but fatigue reduced consistency by mid-shift. The hardware partner needed an automated edge vision system that could run directly inside the inspection housing without relying on an external cloud connection.

Crucially, lighting conditions fluctuated by 18% throughout the day due to skylight variation, confounding standard OpenCV edge-detection filters and causing unacceptable false rejects.

“If an inspection algorithm takes more than 20 milliseconds per frame, the conveyor belt has already moved the part past the pneumatic rejection arm.”
— Project Retrospective Note
Phase 02 • Interactive Verification & Numbers
Interactive CV Verification Slider
Drag handle left/right to compare pipeline stages
FISSURE_04 :: 96.4%
ROI [x:160, y:64]
●INSPECTION STATUS: DEFECT REJECTED (14.2ms)
Model Segmentation & Defect Bounding
RAW SENSOR STREAM (60 FPS • UNPROCESSED)
Raw Camera Feed (High Glare)
↔
Raw factory frame showing faint hair crack obscured by overhead lamp reflection.TensorRT inference isolating the fissure with 96.4% confidence score.
Quantitative Performance Profile
Audit Mode:
Inference Latency
●[14.2]ms

Batch size 1 on NVIDIA Jetson Orin Nano

mAP@50
●[94.8]%

Across 4 defect classes on custom industrial dataset

Dataset Scale
●[12,400]frames

Curated, augmented, and contrast-balanced

False Positive Reduction
●[68]%

Compared against the baseline heuristic thresholding

Phase 03 • Engineering Decisions & Tradeoffs

Architectural choices and what was explicitly rejected.

Selected YOLOv8-Nano quantized with TensorRT over larger ResNet backbones

Heavy transformer vision models offered marginal accuracy gains (+1.2% mAP) at the cost of 4x higher latency and double the thermal footprint on edge hardware. Quantizing YOLOv8n to INT8 brought inference latency under 15ms while keeping accuracy above 94%.

Alternative Rejected

Rejected cloud API roundtrips (too slow, unreliable local network) and large multi-stage mask-RCNN architectures.

Synthetic shadow and specular glare augmentation during training

Rather than installing expensive polarizing filter glass on the factory ceiling, we generated randomized specular glare patches and Gaussian contrast shifts across 3,000 baseline images to make the model invariant to daylight shifts.

Alternative Rejected

Rejected relying solely on factory-captured validation images.

Phase 04 • Technical Topology
System Architecture & Data Pipeline

High-framerate GigE camera capture feeds an in-memory ring buffer, processed via OpenCV CUDA bindings into a TensorRT execution engine running on edge hardware.

NODE_01// pipeline

Optical Capture & Region Normalization

Industrial camera streams 60fps at 1080p. Frame is cropped to the conveyor ROI and normalized.

NODE_02// pipeline

TensorRT INT8 Inference Engine

Quantized weights evaluate bounding boxes and surface classification masks in under 15ms.

NODE_03// pipeline

GPIO Signal & Telemetry Egress

If confidence exceeds 0.88, a hardware trigger actuates the reject valve; metadata is batched to SQLite.

Phase 05 • Outcome & Retrospective

The automated pipeline ran continuously for [TEST DURATION: 3-WEEK PILOT], reducing manual inspection overhead and catching micro-cracks before shipping.

Key Engineering Takeaways:
  • 01.Edge hardware thermals matter just as much as validation loss.
  • 02.Data augmentation targeting real environmental noise (lighting, dust) outperforms raw model size every time.
  • 03.Clean fallback logic is required when a camera lens collects surface dust.
What I Learned

“Computer vision in the real world is 80% data curation and deployment constraints, and 20% model selection.”