Sending Data to Kafka using Pyspark Permalink
“Kafka is a distributed event-streaming platform designed to handle real-time data feeds with high throughput and low latency.”
Projects by Areas of Expertise
Blog
Transforming Bank’s Data using PySpark Permalink
“Combining similar types of information hierarchically not only improves data transfer efficiency but also simplifies decoding for downstream teams.”
An ETL pipeline using Pyspark for a Bank Permalink
“While notebooks are great for exploring and gaining an initial understanding of the data, they are not versatile enough for building end-to-end data pipe...
Data Wrangling and Exploration using Pyspark Permalink
“Data wrangling is not just about cleaning; it’s about structuring data to make it usable and insightful for analysis.”
Designing a Data Lake House for a Big Bank Permalink
“A data lakehouse blends the scalability of a data lake with the reliability of a data warehouse, creating a unified platform for all types of data.”
From Spark to Flame: The Evolutionary Tale of Apache Spark Permalink
“From batch to blazing, Apache Spark redefined big data analytics.”
Getting Started with Git Permalink
“Track your code, control your versions, and collaborate seamlessly with Git.”
Introduction to Command Line Interface for Data Science Permalink
“Master the command line — where efficiency meets the power of automation.”
Developing ‘A Word A Day’ Bot using Python Permalink
“Enrich your vocabulary with a daily dose of words, tailored just for you!”
Using Built-in Methods for User-defined Classes in Python. Permalink
“In Python, not just data but behavior can be redefined to make objects truly intuitive.”
Scraping Data Analyst Job Listings from Indeed Permalink
“Why search manually when you can let Python do the heavy lifting?”
Understanding Namespace and Scope for Classes in Python Permalink
“Namespaces are one honking great idea - let’s do more of those!” –The Zen of Python.