nicknochnack · ialmajai · Dec 11, 2024 · Dec 11, 2024 · Jan 27, 2025 · Feb 2, 2025
diff --git a/LipNet.ipynb b/LipNet.ipynb
diff --git a/README.md b/README.md
@@ -0,0 +1,25 @@
+# LipNet - Lipreading System with Automatic Lip ROI Extraction
+
+This repository is a fork of the **LipNet** implementation by [**Nicholas Renotte**](https://github.com/nicknochnack).
+[Watch his tutorial on YouTube](https://www.youtube.com/watch?v=uKyojQjbx4c&t=1453s)
+
+## Added features
+
+1. **Automatic Face Tracking**:
+   - Utilizes **dlib's facial landmark detector** to locate and track faces in video frames.
+
+
+2. **ROI Extraction for Lips**:
+   - Extracts a dynamic Region of Interest (ROI) around the lips from the detected facial landmarks.
+
+3. **Tracked Videos Caching**
+   - Extracted ROIs are cached to avoid reruning dlib tracking during data loading.
+
+## Example of calculated landmarks and ROI
+
+![Tracked Image](images/landmarks_ROI_extraction_example.jpg) (http://spandh.dcs.shef.ac.uk/gridcorpus)
+
+
+
+
+
diff --git a/images/landmarks_ROI_extraction_example.jpg b/images/landmarks_ROI_extraction_example.jpg
diff --git a/shape_predictor_68_face_landmarks.dat b/shape_predictor_68_face_landmarks.dat