Data Fellowship 8 - Naufal Aldy Pradana
Popular repositories Loading
-
02-airflow-gcs-bigquery-pipeline
02-airflow-gcs-bigquery-pipeline PublicAirflow script that ingest data from API and upload it to gcs bucket
Python 2
-
01-upload-to-gcp-buckets
01-upload-to-gcp-buckets PublicSimple python scripts to upload local files into GCP's bucket containerized with docker.
Python
-
03-bigquery-query
03-bigquery-query PublicExample of complex query performed on BigQuery's public data. Task description are on REAMD.MD
-
04-dbt-analyticial-engineering
04-dbt-analyticial-engineering PublicPerforming transformation from staging into dim and fact tables used on Data Warehouse with dbt tools.
-
05-data-visualization-and-spark-install
05-data-visualization-and-spark-install PublicTask repo to try out visualization with Google Looker Studio and create pyspark installation guide
-
06-sparksql-dataframes
06-sparksql-dataframes PublicPerform certain task using spark dataframe and sql. Task description are on README.MD. Airflow orchestration on progress.
Python
Repositories
- 09-avro-schema-registry-bitcoin Public
This project goals is to integrate schema registry on producer and consumer while streaming csv file
df8-naufal-aldy-pradana/09-avro-schema-registry-bitcoin’s past year of commit activity - 08-postgre-ksqldb-connector Public
This project goals is to implement streams using ksqldb while connecting to postgreSQL database with jdbc-connector.
df8-naufal-aldy-pradana/08-postgre-ksqldb-connector’s past year of commit activity - 07-kafka-twitter-streaming Public
Python script use case to stream tweets from Twitter's API using Confluent Kafka basic components.
df8-naufal-aldy-pradana/07-kafka-twitter-streaming’s past year of commit activity - 06-sparksql-dataframes Public
Perform certain task using spark dataframe and sql. Task description are on README.MD. Airflow orchestration on progress.
df8-naufal-aldy-pradana/06-sparksql-dataframes’s past year of commit activity - 05-data-visualization-and-spark-install Public
Task repo to try out visualization with Google Looker Studio and create pyspark installation guide
df8-naufal-aldy-pradana/05-data-visualization-and-spark-install’s past year of commit activity - 04-dbt-analyticial-engineering Public
Performing transformation from staging into dim and fact tables used on Data Warehouse with dbt tools.
df8-naufal-aldy-pradana/04-dbt-analyticial-engineering’s past year of commit activity - 02-airflow-gcs-bigquery-pipeline Public
Airflow script that ingest data from API and upload it to gcs bucket
df8-naufal-aldy-pradana/02-airflow-gcs-bigquery-pipeline’s past year of commit activity - 03-bigquery-query Public
Example of complex query performed on BigQuery's public data. Task description are on REAMD.MD
df8-naufal-aldy-pradana/03-bigquery-query’s past year of commit activity - 01-upload-to-gcp-buckets Public
Simple python scripts to upload local files into GCP's bucket containerized with docker.
df8-naufal-aldy-pradana/01-upload-to-gcp-buckets’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…