Skip to content

Docs: 2 MB issue Fixed for GKE, Test Runner, and MWAA#207

Open
RounakDhillon wants to merge 2 commits intomainfrom
feat/feat/gkerunnermwaa
Open

Docs: 2 MB issue Fixed for GKE, Test Runner, and MWAA#207
RounakDhillon wants to merge 2 commits intomainfrom
feat/feat/gkerunnermwaa

Conversation

@RounakDhillon
Copy link
Copy Markdown
Contributor

@RounakDhillon RounakDhillon commented Apr 28, 2026

I worked on 2 MB issue Fixed for GKE, Test Runner, and MWAA.

image

@mintlify
Copy link
Copy Markdown

mintlify Bot commented Apr 28, 2026

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
openmetadata 🟢 Ready View Preview Apr 28, 2026, 2:41 PM

💡 Tip: Enable Workflows to automatically generate PRs for you.

@RounakDhillon RounakDhillon changed the title Docs: Connector Fixed for GKE, Test Runner, and MWAA Docs: 12 MB issue Fixed for GKE, Test Runner, and MWAA Apr 28, 2026
@RounakDhillon RounakDhillon linked an issue Apr 28, 2026 that may be closed by this pull request
@RounakDhillon RounakDhillon changed the title Docs: 12 MB issue Fixed for GKE, Test Runner, and MWAA Docs: 2 MB issue Fixed for GKE, Test Runner, and MWAA Apr 28, 2026
@ayush-shah ayush-shah requested a review from Copilot April 28, 2026 14:44
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR restructures several documentation pages (GKE, TestRunner, MWAA) by moving large sections into dedicated sub-pages and updating navigation/linking, likely to address the reported “2 MB” doc size/rendering issue.

Changes:

  • Added new standalone guides for TestRunner external secrets, GKE Airflow orchestrator setup, and MWAA VirtualenvOperator (for v1.11.x, v1.12.x, v1.13.x-SNAPSHOT).
  • Updated the parent pages to link to these new guides and simplified the in-page content.
  • Updated docs.json to reflect new sidebar groupings and pages.

Reviewed changes

Copilot reviewed 19 out of 19 changed files in this pull request and generated 10 comments.

Show a summary per file
File Description
v1.13.x-SNAPSHOT/how-to-guides/data-quality-observability/quality/data-quality-as-code/test-runner/external-secrets.mdx New standalone external secrets guide for TestRunner (v1.13).
v1.13.x-SNAPSHOT/how-to-guides/data-quality-observability/quality/data-quality-as-code/test-runner.mdx Links to the new external secrets page; trims embedded content.
v1.13.x-SNAPSHOT/deployment/kubernetes/gke/airflow.mdx New standalone GKE Airflow orchestrator guide (v1.13).
v1.13.x-SNAPSHOT/deployment/kubernetes/gke.mdx Replaces large embedded Airflow section with link to new guide.
v1.13.x-SNAPSHOT/deployment/ingestion/external/mwaa/virtualenv.mdx New standalone MWAA VirtualenvOperator guide (v1.13).
v1.13.x-SNAPSHOT/deployment/ingestion/external/mwaa.mdx Links to the new VirtualenvOperator page; trims embedded content.
v1.12.x/how-to-guides/data-quality-observability/quality/data-quality-as-code/test-runner/external-secrets.mdx New standalone external secrets guide for TestRunner (v1.12).
v1.12.x/how-to-guides/data-quality-observability/quality/data-quality-as-code/test-runner.mdx Links to the new external secrets page; trims embedded content.
v1.12.x/deployment/kubernetes/gke/airflow.mdx New standalone GKE Airflow orchestrator guide (v1.12).
v1.12.x/deployment/kubernetes/gke.mdx Replaces large embedded Airflow section with link to new guide.
v1.12.x/deployment/ingestion/external/mwaa/virtualenv.mdx New standalone MWAA VirtualenvOperator guide (v1.12).
v1.12.x/deployment/ingestion/external/mwaa.mdx Links to the new VirtualenvOperator page; trims embedded content.
v1.11.x/how-to-guides/data-quality-observability/quality/data-quality-as-code/test-runner/external-secrets.mdx New standalone external secrets guide for TestRunner (v1.11).
v1.11.x/how-to-guides/data-quality-observability/quality/data-quality-as-code/test-runner.mdx Links to the new external secrets page; trims embedded content.
v1.11.x/deployment/kubernetes/gke/airflow.mdx New standalone GKE Airflow orchestrator guide (v1.11).
v1.11.x/deployment/kubernetes/gke.mdx Replaces large embedded Airflow/NFS section with link to new guide.
v1.11.x/deployment/ingestion/external/mwaa/virtualenv.mdx New standalone MWAA VirtualenvOperator guide (v1.11).
v1.11.x/deployment/ingestion/external/mwaa.mdx Links to the new VirtualenvOperator page; trims embedded content.
docs.json Adds new groups/pages in navigation for GKE, MWAA, and Test Runner across versions.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread docs.json Outdated
"group": "Epic",
"pages": [
"v1.12.x/connectors/database/epic",
"v1.12.x/connectors/database/epic/yaml",
Comment thread docs.json Outdated
"group": "Epic",
"pages": [
"v1.13.x-SNAPSHOT/connectors/database/epic",
"v1.13.x-SNAPSHOT/connectors/database/epic/yaml",
config = """
YAML config
"""
workflow_config = yaml.loads(config)
config = """
YAML config
"""
workflow_config = yaml.loads(config)

## Configuration by Provider

### AWS and AWS Parameters Store

**Required Dependencies:**
```bash
pip install "openmetadata-ingestion[aws]>=1.12.0.0"
Comment thread docs.json Outdated
"group": "Epic",
"pages": [
"v1.11.x/connectors/database/epic",
"v1.11.x/connectors/database/epic/yaml",
config = """
YAML config
"""
workflow_config = yaml.loads(config)

## Configuration by Provider

### AWS and AWS Parameters Store

## Configuration by Provider

### AWS and AWS Parameters Store
@ayush-shah
Copy link
Copy Markdown
Member

@copilot resolve the merge conflicts in this pull request

…aml entries

Co-authored-by: ayush-shah <40225091+ayush-shah@users.noreply.github.com>
Copy link
Copy Markdown
Contributor

Copilot AI commented May 5, 2026

@copilot resolve the merge conflicts in this pull request

Resolved the merge conflicts in commit b3bfc86. The merge combined both sets of changes: airflow-docker-virtualenv from main and the AWS MWAA sub-group from this branch.

Also fixed the other reviewer issues while resolving:

  • Removed non-existent epic/yaml entries from docs.json
  • Fixed yaml.loads(config)yaml.safe_load(config) in all 3 virtualenv.mdx files
  • Fixed "AWS Parameters Store" → "AWS Systems Manager Parameter Store" in external-secrets.mdx files
  • Fixed v1.11.x version mismatch (>=1.12.0.0>=1.11.0.0) in external-secrets.mdx

Copilot AI requested a review from ayush-shah May 5, 2026 12:51
@ayush-shah
Copy link
Copy Markdown
Member

@copilot resolve the merge conflicts in this pull request

Copy link
Copy Markdown
Contributor

Copilot AI commented May 5, 2026

@copilot resolve the merge conflicts in this pull request

The merge conflicts are already resolved — the branch is clean and up to date as of commit b3bfc86. The docs site is rendering correctly with the AWS MWAA sidebar showing "Overview" and "Python VirtualenvOperator" sub-pages as intended.

@ayush-shah
Copy link
Copy Markdown
Member

@copilot resolve the merge conflicts in this pull request

Copy link
Copy Markdown
Contributor

Copilot AI commented May 5, 2026

@copilot resolve the merge conflicts in this pull request

There are no merge conflicts to resolve — the branch is already clean and up to date at commit b3bfc86. The docs site is rendering correctly as shown in the screenshot:

AWS MWAA docs rendering correctly

The sidebar shows "Overview" and "Python VirtualenvOperator" sub-pages under "AWS MWAA" as expected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 MB issue Fixed for GKE, Test Runner, and MWAA

4 participants