This project is a cloud-based prototype that uses Azure AI to recognize vehicle types from uploaded images. The goal is to explore how AI can help support Turners Car Insurance by automatically identifying vehicles as part of the insurance process.
This repository will include project documentation, stakeholder analysis, and the AI prototype.
This system follows a layered cloud architecture:
Client → Node.js Backend → Azure Custom Vision → Prediction Result
Architecture diagram:
- User uploads a vehicle image
- Backend receives image via
/analyzeendpoint - Backend sends image to Azure Custom Vision Prediction API
- Azure AI model analyzes the image
- Azure returns classification probabilities
- Backend returns the highest confidence vehicle type
Example response:
{
"vehicleType": "SUV",
"confidence": 0.92
}The Custom Vision model was trained using three vehicle categories:
- SUV
- Sedan
- Truck
Training included around 15 images per category.
Model performance:
Prediction example:
Endpoint:
POST /analyze
Description:
Accepts an image file and returns vehicle classification using Azure Custom Vision.
Backend running:
Backend:
- Node.js
- Express.js
- Axios
- Multer
Cloud:
- Microsoft Azure Custom Vision
- Azure Cognitive Services
Tools:
- GitHub
- Postman
- Jira
backend/
screenshots/
architecture-diagram.png
README.md
stakeholders.md
project-context.md
This prototype demonstrates how cloud‑based AI can automatically classify vehicle types to support insurance processing, reducing manual work and improving efficiency.
- Initial Azure Computer Vision model only returned general labels such as "vehicle" instead of specific types like SUV or Sedan.
- Required training a Custom Vision model to achieve accurate SUV, Sedan, and Truck classification.
- Configuring the backend to correctly connect to the Custom Vision Prediction API required proper endpoint, project ID, and prediction key setup.
- Azure Custom Vision portal had compatibility issues when accessed using Firefox. Switching to Chrome resolved the issue.
- Some sedan images were incorrectly named as SUV, showing me the need for more diverse and balanced data to improve model accuracy.
- Improve model accuracy by training with more diverse vehicle images.
- Add support for additional vehicle categories and brand recognition.
- Implement authentication and authorization to secure the API.
- Deploy the backend to a cloud platform such as Azure App Service.
- Build a frontend interface for users to upload images directly.



