Harness the Power of dbt Core in Airflow with Astronomer Cosmos on MWAA
Learn how to set up and run Astronomer Cosmos, an open-source package that allows you to run dbt core projects as Apache Airflow DAGs and Task Groups with ease. This blog post, provides a comprehensive guide to running Cosmos on MWAA (Amazon Managed Workflows for Apache Airflow). You'll find step-by-step instructions, including setting up a virtual environment, adding Cosmos to your project, embedding a dbt project, creating an Airflow DAG, and more. Read More
Splitting Nested JSON Into Individual Rows in Redshift
Explore the art of transforming JSON data in Amazon Redshift databases, mastering elegant techniques to split and extract data from nested structures. Uncover time-saving strategies for managing one-to-many relationships and enhancing data manipulation workflows. Read More
Distinctions between Data Analysts, Data Scientists, and Data Engineers
Discover the distinctions between Data Analyst, Data Engineer, and Data Scientist roles and learn the essential skills required to transition from one to the other. Read More
The Power of Pre-Commit and SQLFluff
The Power of Pre-Commit and SQLFluff - Ensuring Consistent SQL Code Across Your Team's Projects Read More
Data Engineering Health Markers
You can approach your team's future growth and automation planning through a collaborative health markers session. Read More
Beginning a Career in Data
This is a post about how I landed a career in data and includes pathways and things that I would do the same or differently. Read More