Skip to content

Add AI Skill from Sourabh Ghose#123

Open
PremRajendran wants to merge 4 commits into
mainfrom
feature/ai-skill
Open

Add AI Skill from Sourabh Ghose#123
PremRajendran wants to merge 4 commits into
mainfrom
feature/ai-skill

Conversation

@PremRajendran

Copy link
Copy Markdown
Collaborator

No description provided.

sourabhghose and others added 4 commits March 18, 2026 03:12
Comprehensive Genie Code Agent Skill for generating production-ready
pipeline bundles using the Data Flow Spec Framework
(databricks-solutions/lakeflow_framework).

Includes:
- SKILL.md: Complete skill definition with full schema reference
- 5 Data Flow Spec templates (bronze, cloudfiles, silver flows, joins, gold MVs)
- Energy domain examples (bronze, silver, gold layers)
- 7 StructType schemas, 5 DQ expectation files
- Pipeline resource and substitution templates
- Python extension stubs (sources, transforms, sinks)
- Scaffolding script for auto-generating pipeline bundles
- Validation script for Data Flow Spec files
- Deployment helper scripts
- Comprehensive docs: getting started, 30+ example prompts,
  architecture guide, tested medallion example, skill development guide
- Reference docs: patterns guide, schema reference, domain mapping

Tested end-to-end on e2-demo-west with 7 bronze streaming tables
(10.7M+ rows) and 3 gold materialized views.
git-subtree-dir: skills
git-subtree-mainline: 3fd7580
git-subtree-split: 882baf4
feat: merge skills_for_lakeflowframework into skills/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants