This is a repo with links to everything you'd ever want to learn about data engineering
-
Updated
Jun 20, 2024
This is a repo with links to everything you'd ever want to learn about data engineering
OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
Compare tables within or across databases
This repository provides various demos/examples of using Snowpark for Python.
Efficient data transformation and modeling framework that is backwards compatible with dbt.
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
Data Engineering Pilipinas is a community for data engineers, data analysts, data scientists, developers, AI / ML engineers, and users of closed and open source data tools and methods / techniques in the Philippines. Data Engineering Pilipinas is a PyData group.
Airflow & DBT Cloud Integrated Project Presented at Lagos DBT Community Meetup & DataFestAfrica 23
Apply for a job at Olist's Data Team: https://olist.gupy.io/
Predict stock price based on financial news feeds
A Data Platform built for AWS, powered by Kubernetes.
Roadmap for Data Engineering
Simple stream processing pipeline
Dockerizing an Apache Spark Standalone Cluster
Recohut - Learn data engineering, data science
Forecasting Solar Power: Analysis of using a LSTM Neural Network
An open source development framework to help you build data workflows and modern data architecture on AWS.
Add a description, image, and links to the dataengineering topic page so that developers can more easily learn about it.
To associate your repository with the dataengineering topic, visit your repo's landing page and select "manage topics."