Understanding window function is critical for anyone that writes SQL daily. In this story, let’s think in SQL and demystify the window function with examples and diagrams.
Think In SQL – Window Function Demisify Read More »
Data visualization has always been a delightful area for me to work as a data professional. Visualizing data is like an art. Can I visualize streaming data in another way? I built a game by using streaming data, and this is a fun way for data visualization.
I Built a Game By Using Streaming Data: A Fun Way for Data Visualization Read More »
Pandas is no doubt one of the most popular libraries in Python. However, Pandas doesn’t shine in the land of data processing with a large dataset. We will compare 4 faster pandas alternatives for data analysis: Polars, Dask, Vaex, Modin
4 Faster Pandas Alternatives for Data Analysis Read More »
SQL logical query processing order can help you understand why to change writing SQL in the top to bottom approach. It can also help you think in SQL clearly and develop your query more effectively
Think in SQL — Avoid Writing SQL in a Top to Bottom Approach Read More »
Have you seen any beautiful racing bar chart data animation on Youtube and wondered how it was built? I will show you how to use gganimate in R to animate data by creating a racing bar chart as an example.
How to Build Data Animation in R Read More »
Data engineers can work on some side projects to get experience. Those projects could initiate impressive discussions to help you land a dream job. We will introduce 6 data engineering side project ideas regardless of your experience.
6 Side Project Ideas for New and Experienced Data Engineers Read More »
Airflow has been widespread for years. Is Apache Airflow due for a replacement? mage-ai is the new ETL tool for data engineers to check out as a substitution. I have taken a first impression of mage-ai and will share my thoughts.
Is Apache Airflow Due for Replacement? The First Impression Of mage-ai Read More »
Apache Airflow is undoubtedly the most popular open-source project for data engineering for years. It gains popularity at the right time with The Rise Of Data Engineer. Today, I want to share my journey with Airflow and what I learned over 6 years.
Here Is What I Learned Using Apache Airflow over 6 Years Read More »
“Why my Spark job is running slow?” is an inevitable question. We will cover how to identify Spark data skew and how to handle data skew with different options, including key salting
Deep Dive into Handling Apache Spark Data Skew Read More »
Getting the work done isn’t the journey’s end. Your work should be your channel to get YOU self-promotion. I will give five tips to get self-promotion as data professionals
5 Tips for Self-Promotion as Data Professionals Read More »
