Welcome

I’m Chengzhi Zhao

Content Creator on Data Engineering, Productivity | Contributor of Airflow, Flink | Creator of Data Engineering Space

Feature Stories

The data engineering space is evolving. Here are the resources I collected for practical data engineering resource.

The list is keep updating. 

The airflow schedule interval could be a challenging concept to comprehend, even for developers work on Airflow for a while find difficult to grasp. A confusing question arises every once a while on StackOverflow is “Why my DAG is not running as expected?”

This story help you on how to identify Spark data skew? How to handle data skew with different options? 

My Stories

Uncovering the Truth About Apache Spark Performance: coalesce(1) vs. repartition(1) | Image By Author
Data Engineering

Uncovering the Truth About Apache Spark Performance: coalesce(1) vs. repartition(1)

We will discuss a neglected part of Apache Spark Performance between coalesce(1) and repartition(1), and it could be one of the things to be attentive to when you check the Spark job performance.
Read More
Photo by matthew Feeney on Unsplash
Data Engineering

The Practical Data Engineering Resource

The data engineering space is evolving. Here are the resources I collected for practical data engineering resource.
Read More
Image Create By Midjourney
Data Engineering

How to Find the Best Deals On Time with R and Mage

How to find the best deals and coupons promptly can save you money and time. We can quickly build a weekend project that automatically finds the best deals on time with R and Mage
Read More
Photo by Kelly Sikkema on Unsplash
Data Engineering

4 Free Fantastic Diagramming Tools To Make Yours Stand Out

Many diagrams bring less excitement to work with and view as the final result. I will share 4 free fantastic diagramming tools to make yours stand out.
Read More
Second Iteration: Interactivity with User Click | Image By Author
Data Engineering

How to Engage with Users By Storytelling: Show Data Analytics in R and Shiny

Using R and Shiny, we can build an app where the end users can interact with the data analysis we have done. I will show you how to engage with users by storytelling - show data analytics in R and Shiny.
Read More
Photo by Tony Sebastian on Unsplash
Data Engineering

R For Data Analysis: How to Find the Perfect Cocomelon Video for Your Kids

I will share my journey on using R for Data Analysis: building an end-to-end solution for exploring trending Cocomelon videos using R from scratch.
Read More
Photo by Laura Chouette on Unsplash
Writing

Is ChatGPT Making People Lose Interest in Writing: Learning From Using ChatGPT

ChatGPT is powerful and scary. As people interested in writing, we have thoughts and manually type each word. Will this change how we write, and will more people lose interest?  After using ChatGPT for some time, my answer is: No. It isn't capable of changing anything humans produce. But it ...
Read More
Photo by Stephen Leonardi on Unsplash
Data Engineering

Streaming Data Is Exciting: What You Need to Know Before Taking the Plunge

Is streaming data necessary for this particular use case? Rather than blindly diving in, it's essential first to acknowledge the realities of working with streaming data.
Read More
Photo by Susan Q Yin on Unsplash
Data Engineering

The Essential Reading List for Data Engineers: 10 Classic Books You Can’t Miss

Discover the Essential Reading List for Data Engineers: 10 Classic Books You Can't Miss. While many free online resources are available, they often lack the depth and context needed to truly master the field. In this article, I will share ten classic books that cover everything from fundamental technical skills ...
Read More
Photo by Volodymyr Hryshchenko on Unsplash
Productivity

Mastering Gantt Charts: Learn How to Build Them Using Code Alone

Learn how to master Gantt charts using code alone in project management tracking. Many UI-based tools for Gantt chart creation can take a lot of work to manage. Discover the elegant and practical approach of building Gantt charts with code to reflect fast-paced project changes in this insightful story.
Read More
Photo by Katerina Pavlyuchkova on Unsplash
Data Engineering

Think In SQL – Window Function Demisify

Understanding window function is critical for anyone that writes SQL daily. In this story, let's think in SQL and demystify the window function with examples and diagrams.
Read More
Photo by George Flowers on Unsplash
Data Engineering

I Built a Game By Using Streaming Data: A Fun Way for Data Visualization

Data visualization has always been a delightful area for me to work as a data professional. Visualizing data is like an art. Can I visualize streaming data in another way? I built a game by using streaming data, and this is a fun way for data visualization.
Read More
Scroll to Top