Trusty codes

I recently gave a talk called Data Transformation - Intelligent Querying with GenAI. This is a placeholder entry until I fully polish the step-by-step tutorial in the blog. Until then, you can experiment with the workshop’s official Google Colaboratory notebook to explore making your own GenAI-powered queries. It contains everything... [Read More]

As a software engineer, I frequently work to help popular websites more effectively serve their users. Data is a big part of that, since insight into user behavior is needed to improve performance and content. One day, my manager alerted me to a problem with our site data collection. While... [Read More]

Data Transformation is one of the most important operations in Data Engineering. Just like mixing and baking the raw materials of flour, butter, and sugar provides delicious shortbread, transforming data generates new business value. This tutorial shows how data can be joined and aggregated in #SQL to generate new insights.... [Read More]

Loading and storing data is an important part of a data engineer’s work. Just like buying food from a store is the beginning, Data Extraction only unlocks the other parts of a data pipeline. This tutorial showcases the process of taking ownership of your data by storing it in #BigQuery... [Read More]

Extract Load Transform is one of the most popular types of data pipelines. While the term combines multiple concepts, today we’ll be zooming in on the first concept of Data Extraction. This tutorial offers a simple and scalable way to extract large volumes of data in real-time via #Pydantic .... [Read More]