How to install Sublime in Ubuntu
Why Sublime? Sublime is a light weight IDE and is very useful for general text editing purpose and programming. Sublime can be very useful if… Read More »How to install Sublime in Ubuntu
How to view content of parquet files on S3/HDFS from Hadoop cluster using parquet-tools
Sometimes we quickly need to check the schema of a parquet file, or to head the parquet file for some sample records. Here are some… Read More »How to view content of parquet files on S3/HDFS from Hadoop cluster using parquet-tools
How to run incremental and range run scripts in airflow
Here is a small post on a very specific use case of Airflow. While its not very difficult to do this, but I found really… Read More »How to run incremental and range run scripts in airflow
Spark-sql java.net.NoRouteToHostException on cluster reboot
We had a EMR cluster reboot and hit this error all of sudden. The error is independent of EMR so worth sharing. Error: Caused by:… Read More »Spark-sql java.net.NoRouteToHostException on cluster reboot
Debugging : Hive DAG did not succeed due to VERTEX_FAILURE. Unable to rename output.
This was a fun debug activity for a Hive-on-S3 use case. Thought of writing a log of debug steps here before I lose the details.… Read More »Debugging : Hive DAG did not succeed due to VERTEX_FAILURE. Unable to rename output.
How to create a raspberry pi powered car, remote controlled via mobile phone
This post is about creating a Raspberry pi powered remote control car. Before we start I hope you have got your raspberry pi ready and… Read More »How to create a raspberry pi powered car, remote controlled via mobile phone
SSH into a raspberry pi and connect pi to wifi
This quick post is on two important things in pi. Enable wifi and connect to internet Open the file for network interfaces, and look for a… Read More »SSH into a raspberry pi and connect pi to wifi
Getting started with the raspberry pi
Buy all the hardware stuffs Raspberry pi Display Screen HDMI Cable Keyboard Micro SD card and Card reader UBB Hub and 2 Micro USB cables… Read More »Getting started with the raspberry pi
Papers we love – Summary of Design and implementation of log-structured file system
Here are my takeway points from the papers we love meetup on – Design and implementation of log-structured file system. Here is the link to the… Read More »Papers we love – Summary of Design and implementation of log-structured file system
Whitepapers and research materials on all things computer science
Papers We Love (PWL) is a community built around reading, discussing and learning more about academic computer science papers. This repository serves as a directory… Read More »Whitepapers and research materials on all things computer science
Celebrating Durga puja / Dussehra away from home @ Sydney
Durga Puja or Dussehra is one of the biggest festivals in India, Puja means festival and Durga being the godess, celebrated almost all parts… Read More »Celebrating Durga puja / Dussehra away from home @ Sydney
Create a basic distributed system in Go lang – Part 2- http server & JSON request/response
Introduction So this is a part 2 of a series of posts I am planning to write to create a very basic distributed system in… Read More »Create a basic distributed system in Go lang – Part 2- http server & JSON request/response