Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 0 additions & 2 deletions skills/accidental-data-loss-prevention/SKILL.md
100755 → 100644
Original file line number Diff line number Diff line change
Expand Up @@ -7,10 +7,8 @@ description: |
- SQL: DROP TABLE/VIEW/SCHEMA/DATABASE, TRUNCATE, or broad DELETE (missing WHERE or using 1=1).
- Cloud Storage: gsutil rm or gcloud storage rm targeting production data or critical buckets.
- Infrastructure: gcloud projects delete, deleting Spanner/BigQuery/Dataproc resources, deleting secrets, or KMS key destruction.
license: Apache-2.0
metadata:
version: v1
publisher: google
---

# Accidental Data Loss Prevention
Expand Down
21 changes: 10 additions & 11 deletions skills/bigquery-data-transfer-service/SKILL.md
100755 → 100644
Original file line number Diff line number Diff line change
@@ -1,14 +1,13 @@
---
name: bigquery-data-transfer-service
description: Discovers and inspects BigQuery Data Transfer Service (DTS) configurations.
Use this to identify existing ingestion pipelines and extract datasource or transfer
config metadata for data pipelines. Use when a user asks for ingestion scenarios
while building or managing data pipelines or when a user asks to "ingest" or "add"
data that may already be managed by a DTS transfer.
license: Apache-2.0
description: >-
Discovers and inspects BigQuery Data Transfer Service (DTS) configurations.
Use this to identify existing ingestion pipelines and extract datasource or
transfer config metadata for data pipelines. Use when a user asks for
ingestion scenarios while building or managing data pipelines or when a user asks to "ingest" or "add" data that may
already be managed by a DTS transfer.
metadata:
version: v1
publisher: google
---

# BigQuery Data Transfer Service (DTS)
Expand Down Expand Up @@ -97,10 +96,10 @@ and validate them with the user.
> If `<DATA_SOURCE_ID>` is unknown, run the discovery script without
> `<DATA_SOURCE_ID>` argument to list available source IDs (e.g.,
> `google_cloud_storage`). It uses the derived project and location from Step 0.
>
> ```bash
> python3 scripts/bigquery_dts.py --project_id=<PROJECT_ID>
> ```

```bash
python3 scripts/bigquery_dts.py --project_id=<PROJECT_ID>
```

1. **Run Discovery Script**: Use the `bigquery_dts.py` script to inspect Data
Source parameters via the REST API.
Expand Down
5 changes: 3 additions & 2 deletions skills/bigquery-data-transfer-service/scripts/bigquery_dts.py
100755 → 100644
Original file line number Diff line number Diff line change
@@ -1,17 +1,18 @@
#!/usr/bin/env python3
# Copyright 2026 Google LLC
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

#!/usr/bin/env python3
"""BigQuery Data Transfer Service REST API - Data Source Parameter Discovery."""

import argparse
Expand Down
2 changes: 0 additions & 2 deletions skills/building-data-apps/SKILL.md
100755 → 100644
Original file line number Diff line number Diff line change
Expand Up @@ -14,10 +14,8 @@ description: |
1. The request is for building backend-only services.
2. The request is for simple CLI scripts or command-line applications.
3. The web application is not data-centric or does not involve visualizing/querying data from GCP sources.
license: Apache-2.0
metadata:
version: v1
publisher: google
---

# Building Data Applications
Expand Down
3 changes: 2 additions & 1 deletion skills/building-data-apps/examples/express_chat.ts
100755 → 100644
Original file line number Diff line number Diff line change
Expand Up @@ -4,13 +4,14 @@
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
//
// https://www.apache.org/licenses/LICENSE-2.0
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.

// express_chat.ts
// requires: npm install express
// cors @google-cloud/geminidataanalytics @google-cloud/bigquery dotenv
Expand Down
3 changes: 2 additions & 1 deletion skills/building-data-apps/examples/fastapi_chat.py
100755 → 100644
Original file line number Diff line number Diff line change
Expand Up @@ -4,13 +4,14 @@
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

import json
import os
from fastapi import FastAPI
Expand Down
13 changes: 0 additions & 13 deletions skills/building-data-apps/examples/react_chat_panel.jsx
100755 → 100644
Original file line number Diff line number Diff line change
@@ -1,16 +1,3 @@
// Copyright 2026 Google LLC
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
//
// https://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.
import React, { useState, useRef, useEffect, Component } from 'react';
import ReactMarkdown from 'react-markdown';
import remarkGfm from 'remark-gfm';
Expand Down
Empty file modified skills/building-data-apps/references/chat_integration.md
100755 → 100644
Empty file.
Empty file modified skills/building-data-apps/references/react_framework.md
100755 → 100644
Empty file.
Empty file modified skills/building-data-apps/references/shared_design_system.md
100755 → 100644
Empty file.
Empty file modified skills/building-data-apps/references/streamlit_framework.md
100755 → 100644
Empty file.
11 changes: 5 additions & 6 deletions skills/data-autocleaning/SKILL.md
100755 → 100644
Original file line number Diff line number Diff line change
@@ -1,13 +1,12 @@
---
name: data-autocleaning
description: Automated data quality and transformation capabilities for Dataform/dbt/BigQuery
pipelines. Processes data sourced from BigQuery or Cloud Storage (GCS), applying
best practices for data ingestion, movement, schema mapping, and comprehensive data
cleaning.
license: Apache-2.0
description:
Automated data quality and transformation capabilities for
Dataform/dbt/BigQuery pipelines. Processes data sourced from BigQuery
or Cloud Storage (GCS), applying best practices for data ingestion,
movement, schema mapping, and comprehensive data cleaning.
metadata:
version: v1
publisher: google
---

# Data Autocleaning Skill
Expand Down
3 changes: 2 additions & 1 deletion skills/data-autocleaning/scripts/dataplex_scanner.py
100755 → 100644
Original file line number Diff line number Diff line change
Expand Up @@ -4,13 +4,14 @@
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

"""A script to create and monitor Dataplex data profile scans.

This script takes a list of BigQuery tables, initiates Dataplex data profile
Expand Down
Loading
Loading