Skip to content
View abdullah-mahmoud-datastack's full-sized avatar
💻
Architecting Solutions
💻
Architecting Solutions
0 followers · 5 following

Achievements

Achievement: YOLOAchievement: Quickdraw

Achievements

Achievement: YOLOAchievement: Quickdraw

Block or report abdullah-mahmoud-datastack

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
abdullah-mahmoud-datastack/README.md

Typing SVG

Turning raw data into scalable, production-ready data solutions.

👨‍💻 About Me

I'm Abdullah Mahmoud, a passionate Data Engineer and final-year Computer Science student dedicated to designing scalable data platforms, cloud-native ETL pipelines, and AI-powered automation systems.

I enjoy solving real-world business problems through modern data engineering technologies while continuously learning and building production-quality projects.

🚀 Currently

  • 🎓 Final-year Computer Science Student (Graduating July 2026)
  • 💼 Remote AI Engineer at Roto House
  • ☁️ Building cloud-native ETL & ELT pipelines
  • 📊 Developing scalable analytics solutions
  • 🤖 Exploring AI Agents & LLM Automation

💼 Experience

AI Engineer — Roto House (Remote)

Currently developing the complete backend data architecture for a production management platform, including:

  • Data modeling
  • Production workflow automation
  • ETL pipelines
  • Reporting infrastructure
  • AI-powered business automation
  • Operational analytics

🚀 Featured Projects

🌦️ Global Weather Analytics Pipeline

End-to-end automated ETL pipeline that:

  • Collects weather data from 155+ cities
  • Uses multithreading for faster extraction
  • Stores data in Parquet
  • Provides real-time Streamlit dashboards

🔗 https://github.com/abdullah-mahmoud-datastack/Global-Weather-Analytics-Pipeline

📺 YouTube AWS Serverless Data Pipeline

Production-grade cloud data pipeline using:

  • AWS Lambda
  • AWS Glue
  • Amazon S3
  • Snowflake
  • Python

🔗 https://github.com/abdullah-mahmoud-datastack/youtube-data-engineering-pipeline

🎬 IMDb Serverless ELT Pipeline

Cloud-native ELT architecture for processing large-scale IMDb datasets.

Technologies:

  • AWS Lambda
  • Amazon S3
  • Snowflake
  • Python

🔗 https://github.com/abdullah-mahmoud-datastack/imdb-serverless-elt-pipeline

🏭 Production Management System

Enterprise production management platform for manufacturing operations.

Features include:

  • Factory workflow management
  • Production scheduling
  • Employee tracking
  • Data automation
  • Real-time reporting

🤖 AI Shift Management Agent

An intelligent workforce management system powered by LLMs.

Capabilities:

  • Automated shift assignment
  • Employee deficit management
  • Surplus optimization
  • AI decision making
  • Gemini & Grok integration

🎓 IBM Data Engineering Capstone

Complete cloud-based Data Engineering project demonstrating:

  • ETL pipelines
  • Data Warehousing
  • Cloud Computing
  • Analytics

🔗 https://github.com/abdullah-mahmoud-datastack/ibm-data-engineering-capstone-project

🛠 Tech Stack

Programming

Data Engineering

  • Apache Spark
  • PySpark
  • Spark SQL
  • Apache Kafka
  • Apache Airflow
  • ETL / ELT
  • Data Warehousing

Cloud

Services:

  • AWS Lambda
  • AWS Glue
  • Amazon S3
  • Snowflake

Tools

🌱 Currently Learning

  • Apache Iceberg
  • dbt
  • Terraform
  • Kubernetes
  • Data Lakehouse Architecture
  • Apache Flink

🏆 Certifications

  • IBM Data Engineering L1
  • IBM Data Engineering Capstone
  • McKinsey Forward Program

📈 GitHub Statistics

📊 Contribution Graph

📄 Resume

📫 Connect With Me

"Building scalable data platforms that transform data into decisions."

Pinned Loading

  1. Global-Weather-Analytics-Pipeline Global-Weather-Analytics-Pipeline Public

    An automated data pipeline that fetches, cleans, and analyzes global weather patterns using a Medallion Architecture. This project demonstrates the full lifecycle of data—from raw API ingestion to …

    Python 1

  2. imdb-serverless-elt-pipeline imdb-serverless-elt-pipeline Public

    End-to-end data engineering project orchestrating daily IMDb dataset updates.An automated, event-driven ELT pipeline extracting IMDb metadata via AWS Lambda, integrating with Amazon S3, and utilizi…

    Python 1

  3. serverless-binance-pipeline serverless-binance-pipeline Public

    A fully serverless, real-time data streaming pipeline built on AWS Free Tier. Ingests live WebSocket trades, micro-batches via SQS and Lambda, stores in DynamoDB, and visualizes market metrics usin…

    Python 1

  4. ibm-data-engineering-capstone-project ibm-data-engineering-capstone-project Public

    End-to-end Data Engineering Capstone Project building a complete data pipeline. Features operational databases (MySQL), analytical data warehousing (PostgreSQL), Python-based ETL scripts, Apache Ai…

    Jupyter Notebook 1

  5. nlp-text-classifier-pipeline nlp-text-classifier-pipeline Public

    An end-to-end data pipeline for sourcing, preprocessing, and managing NLP datasets for machine learning workflows.

    Jupyter Notebook 1

  6. youtube-data-engineering-pipeline youtube-data-engineering-pipeline Public

    An end-to-end, multi-cloud data engineering pipeline analyzing YouTube trending metrics using AWS (S3, Glue, Lambda), Snowflake, Looker Studio, and Streamlit.

    Python 1