Hey readers, I am learning Data Engineering from last few months and I thought of sharing my learning with you all. Recently I made a project… Read More »Real world application project for Big Data – with Apache Spark and AWS-EMR
Hey readers, in previous post I have explained How to create a python ETL Project. In this post, I will explain how we can schedule/productionize our… Read More »Data Engineering Part 2 – Productionizing Big data ETL with Apache Airflow
I am so excited to start this journey. I am hoping to learn a lot of concepts and meet a lot of awesome people.… Read More »I am starting my Masters in Data Science at UTS
Hey Readers, this is my first blog on Deep Learning. From last few months I have started learning about Deep learning. Thanks to guru99 where… Read More »CNN with TensorFlow for Deep Learning Beginners
Hey Readers, I am a Data Science Student and recently I have started learning more about Data Engineering. Data Science and Data Engineering teams co-exist… Read More »Data Engineering Part 1 – How to become a Big Data Engineer
In the last post we discussed about how to generate synthetic data. Here we will talk about how to query S3 data via Hive. Provide… Read More »Query S3 data via Hive on local box
A lot of time, we want some synthetic data to start our journey on data analysis. In this post we will discuss how to generate… Read More »How to generate synthetic log data for data analysis
Are you an aspiring Data Scientist, or a greenhorn Data Science student like me ? Are you trying to start with SQL and are lost… Read More »Handson SQL guide for Data Science beginners – From databases to data lakes
This post is going to take you through – how to install and query MYSQL and MySQL Workbench on your local box. Let’s get started Let’s… Read More »Getting started with MySQL and MySQL Workbench
It was an eventful evening yesterday when I gave my first ever talk. I talked on Analytics with Apache Spark and Zeppelin on Amazon… Read More »Public Speaking at Web Analytics Wednesday Meetup, Sydney
Kaggle is a platform to explore our knowledge on Data Science, to learn new techniques or modelling from the experts. Kaggle competitions are the best way to… Read More »My secret recipe for Kaggle competition for top 8% on leaderboard
Exploratory Data Analysis (EDA) is an approach to analysing data sets to summarize their main characteristics, often with visual methods. Following are the different steps involved… Read More »Exploratory Data Analysis (EDA) techniques for kaggle competition beginners