Phani Kumar Yadavilli – Medium

Phani Kumar Yadavilli

Phani Kumar Yadavilli

Optimizing Driver Allocation for Peak Hours in Ride-Hailing: A Data-Driven Approach

In the fast-paced world of ride-hailing, ensuring a seamless experience for riders during peak hours is a significant challenge. Long wait…

Aug 28, 2023

Optimizing Driver Allocation for Peak Hours in Ride-Hailing: A Data-Driven Approach

Aug 28, 2023

Phani Kumar Yadavilli

Navigating the Storm: Taming Rapidly Changing Dimensions in Data Management

In the dynamic realm of data management, change is the only constant. But what happens when that change accelerates into a whirlwind of…

Aug 23, 2023

Navigating the Storm: Taming Rapidly Changing Dimensions in Data Management

Aug 23, 2023

Phani Kumar Yadavilli

Managing Dimensional Data Changes: A Refresher to Slowly Changing Dimensions (SCDs) and their Types

Imagine you are working with a retail company that sells products online. One of the dimensions you are tracking is “Product”, and you want…

Aug 22, 2023

Managing Dimensional Data Changes: A Refresher to Slowly Changing Dimensions (SCDs) and their Types

Aug 22, 2023

Phani Kumar Yadavilli

Supercharging Data Analysis: Unleashing the Power of Cumulative Table Design

Unlocking the full potential of a Data Analysis solution is a quest that intrigues both Data Engineers and well as Data Analysts. Imagine a…

Aug 21, 2023

Aug 21, 2023

Phani Kumar Yadavilli

ShellStat Data Model: A Brief Overview & Significance

ShellStat, designed to offer deep insights into shell history, uses a robust data model to capture, store, and analyse terminal…

Aug 18, 2023

ShellStat Data Model: A Brief Overview & Significance

Aug 18, 2023

Phani Kumar Yadavilli

Time-series Data Model for ShellStat

📆 Temporal Nature of Shell Commands:

Aug 18, 2023

Time-series Data Model for ShellStat

Aug 18, 2023

Phani Kumar Yadavilli

ShellStat

Over the weekend, while reviewing some systems logs of my Mac, I came across one exciting use case. I was trying to run some commands, and…

Aug 17, 2023

ShellStat

Aug 17, 2023

Phani Kumar Yadavilli

Hacking Apache Airflow to trigger DAGs based on FileSystem events

In this blog, I would like to cover the concepts of triggering the Airflow DAGs basing on the events from a filesystem or simply a…

Mar 9, 2020

Hacking Apache Airflow to trigger DAGs based on FileSystem events

Mar 9, 2020

Phani Kumar Yadavilli

Writing UDFs (User Defined Functions) in Apache Spark

In this small tutorial, we will see how to create a User Defined Function aka UDF in Apache Spark.

Sep 28, 2019

Sep 28, 2019

Phani Kumar Yadavilli

Parsing Apache Kafka __consumer_offsets using Kafka command and Java API

__consumer_offsets is the topic where Apache Kafka stores the offsets. Since the time Kafka migrated the offset storage from Zookeeper to…

May 16, 2019

May 16, 2019

Phani Kumar Yadavilli

Phani Kumar Yadavilli

I am a Big Data Analytics Engineer passionate about writing good code and building highly scalable distributed systems.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams