Welcome

I’m Chengzhi Zhao

Data Engineer | Data Content Creator | Contributor of Airflow, Flink | Creator of Data Engineering Space

I write content on Data Engineering,  Productivity, and DIY projects

Feature Stories

The data engineering space is evolving. Here are the resources I collected for practical data engineering resource.

The list is keep updating. 

Is Apache Airflow due for a replacement? mage-ai is the new ETL tool for data engineers to check out as a substitution. 

This story help you on how to identify Spark data skew? How to handle data skew with different options? 

My Stories

Photo by Dan Cristian Pădureț on Unsplash
Data Engineering

Data Engineering: Why It’s About Much More Than Just the Tools You Use

One key learning I had while chasing the latest tool is: Tools are great, but many data engineering problems cannot be resolved by using the newest tool but by human — Data Engineers. I want to share my thoughts on Why data engineering is about much more than just the tools you use.

Read More
Photo by Erin Doering on Unsplash
Data Engineering

Building Better Data Warehouses with Dimensional Modeling: A Guide for Data Engineers

Let’s bring the data community’s attention to the essential- Building Better Data Warehouses with Dimensional Modeling: A Guide for Data Engineers.

Read More
Photo by Fahrul Azmi on Unsplash
Data Engineering

Boosting Spark Union Operator Performance: Optimization Tips for Improved Query Speed

We will focus on the Apache Spark Union Operator Performance with examples, show you the physical query plan, and share techniques for optimization in this story.

Read More
Photo by Jordan Rogers on Unsplash
Data Engineering

Why R for Data Engineering is More Powerful Than You Thought

R could add potential benefits to help the data engineering community. Let’s discuss about Why R for Data Engineering is More Powerful Than You Thought.

Read More
Photo by saeed karimi on Unsplash
Data Engineering

5 Hidden Apache Spark Facts That Fewer People Talk About

I want to share 5 hidden facts about Apache Spark that I learned throughout my career. Those can be helpful to you to save you some time reading the Apache Spark source code.

Read More
Uncovering the Truth About Apache Spark Performance: coalesce(1) vs. repartition(1) | Image By Author
Data Engineering

Uncovering the Truth About Apache Spark Performance: coalesce(1) vs. repartition(1)

We will discuss a neglected part of Apache Spark Performance between coalesce(1) and repartition(1), and it could be one of the things to be attentive to when you check the Spark job performance.

Read More
Photo by matthew Feeney on Unsplash
Data Engineering

The Practical Data Engineering Resource

The data engineering space is evolving. Here are the resources I collected for practical data engineering resource.

Read More
Image Create By Midjourney
Data Engineering

How to Find the Best Deals On Time with R and Mage

How to find the best deals and coupons promptly can save you money and time. We can quickly build a weekend project that automatically finds the best deals on time with R and Mage

Read More
Scroll to Top