A test space where I'm learning ETL operations using Airflow and the Google Cloud Platform
-
Updated
Jul 15, 2021
A test space where I'm learning ETL operations using Airflow and the Google Cloud Platform
Simple PHP Big Query With PHP
bq-schema-validator is a CLI tool to detect the log entry that causes a BigQuery table schema error via log sink.
Schema Registry for BigQuery
Convert Zod to BigQuery Schema
Convert table schemas from various RDBMS' to BigQuery's JSON schema.
Stream CSV data from Google Cloud Storage to BigQuery using Apache Beam Dataflow, featuring dynamic schema detection and flexible runner options.
Analytics on Uber Data
Read step by step tutorial here: https://frazynondo.medium.com/etl-with-gcp-part-i-apache-beam-eclipse-gcs-and-bigquery-dc9529ee7f19
A protocol buffer compiler (protoc) plugin for generating Google BigQuery JSON table definitions.
(Script) Generates SQL query that selects all fields (recursively for nested fields) from the provided BigQuery schema file.
A CLI tool to perform migrations on BigQuery tables
python script to scrap AEMO data
This is the sentiment analysis on the #VisitRwanda on twitter, this is a campaign of eco tourism in Rwanda that promotes touristic places attraction in Rwanda.
BigQuery table schema Go struct generator
Python lib and cli tool to convert MySQL schemas into BigQuery schemas
Add a description, image, and links to the bigquery-schema topic page so that developers can more easily learn about it.
To associate your repository with the bigquery-schema topic, visit your repo's landing page and select "manage topics."