Skip to content

NotYourRootUser/vehicle-classification-ai-prototype

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Turners Car Insurance AI Prototype

This project is a cloud-based prototype that uses Azure AI to recognize vehicle types from uploaded images. The goal is to explore how AI can help support Turners Car Insurance by automatically identifying vehicles as part of the insurance process.

This repository will include project documentation, stakeholder analysis, and the AI prototype.

Architecture

This system follows a layered cloud architecture:

Client → Node.js Backend → Azure Custom Vision → Prediction Result

Architecture diagram:

Architecture Diagram


How It Works

  1. User uploads a vehicle image
  2. Backend receives image via /analyze endpoint
  3. Backend sends image to Azure Custom Vision Prediction API
  4. Azure AI model analyzes the image
  5. Azure returns classification probabilities
  6. Backend returns the highest confidence vehicle type

Example response:

{
  "vehicleType": "SUV",
  "confidence": 0.92
}

Custom Vision Model

The Custom Vision model was trained using three vehicle categories:

  • SUV
  • Sedan
  • Truck

Training included around 15 images per category.

Model performance:

Training Results

Prediction example:

Prediction Result


Backend API

Endpoint:

POST /analyze

Description:

Accepts an image file and returns vehicle classification using Azure Custom Vision.

Backend running:

Backend Running


Technologies Used

Backend:

  • Node.js
  • Express.js
  • Axios
  • Multer

Cloud:

  • Microsoft Azure Custom Vision
  • Azure Cognitive Services

Tools:

  • GitHub
  • Postman
  • Jira

Project Structure

backend/
screenshots/
architecture-diagram.png
README.md
stakeholders.md
project-context.md

Purpose

This prototype demonstrates how cloud‑based AI can automatically classify vehicle types to support insurance processing, reducing manual work and improving efficiency.


Challenges Faced

  • Initial Azure Computer Vision model only returned general labels such as "vehicle" instead of specific types like SUV or Sedan.
  • Required training a Custom Vision model to achieve accurate SUV, Sedan, and Truck classification.
  • Configuring the backend to correctly connect to the Custom Vision Prediction API required proper endpoint, project ID, and prediction key setup.
  • Azure Custom Vision portal had compatibility issues when accessed using Firefox. Switching to Chrome resolved the issue.
  • Some sedan images were incorrectly named as SUV, showing me the need for more diverse and balanced data to improve model accuracy.

Future Improvements

  • Improve model accuracy by training with more diverse vehicle images.
  • Add support for additional vehicle categories and brand recognition.
  • Implement authentication and authorization to secure the API.
  • Deploy the backend to a cloud platform such as Azure App Service.
  • Build a frontend interface for users to upload images directly.

About

Cloud-based vehicle classification prototype using Node.js and Azure Custom Vision to identify car types from uploaded images.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors