You can ask me anything on my personal repo's discussions.

👇🏻 If you like what I do, support me by buying me a book and add to my knowledge!

I can help you either set up a data culture from scratch or grow it exponentially from the current state. I have worked on the scale of millions in the first organisation and billions in the second one, hoping to scale myself and the systems to handle trillions of data points.

• Helped build a team of upto 10 distributed data engineers from non existent team of 2 engineers in a span of 3 years along with fulfilling the analytics requirement of organisation and ever growing data
• Built "Data transformation platform" from scratch and led a team to build "Data integration platform" in the current organisation with the aim of data democratisation. These platforms handled most of the use-cases present with data and pushed the company to be more data centric.
• Built distributed, resilient and scalable the systems to handle millions of data points in first organisation and then upto 10s billions of data points per month in the current one.

A developer skills assessment platform; Leading the Runtime team that develops and maintains various development environments and collaborating with peers to optimize performance, cost, on-call, quality, and release processes.

• Enhanced customer delight culture by introducing a systematic customer support process that helped Customer success team achieve better SLOs, reduced ticket resolution time by 20x , and increased team accountability
• Accelerated release cycles by 6x by introducing Hubs, Spokes & Pods model to handle visionary and missionary goals in parent team
• Led the effort to migrate infrastructure to new efficient system resulting in around 75% cost savings and increased reliability

An API Development and testing platform; Managed a fully remote Data engineering team that delivered fast and reliable analytics solutions for various product and business goals and experiments.

• Mentored and grew 10 members remote team from 5 office based people by remotely hiring and smoothening out processes of onboard- ing, on-call, contribution and collaboration
• Designed and launched platform to scale data ingestion by1000x to10 billion rows/month and handle 100xmoredatain TBs of storage.
• Led the project to design and implement systems for data sourcing from data warehouse that enabled Universal Search and Enterprise Reporting features for 17 Million users of Postman API Platform https://bit.ly/postman-search

• Directly impacted 10+ teams and contributed to data driven culture by launching Data transformation platform and pushing for Data democratisation along with Data Analysis team https://bit.ly/postman-datademocratization
• Slashed storage cost by 2x in Redshift by implementing compression strategies in tables

• Increased queries speed by 6x and reduced data wait time by optimising Redshift storage distribution
• Introduced ELT philosophy after migrating from ETL which cut data processing time by 4x while bringing principle of Software engineering in data analytics using Data Build Tool (DBT) https://bit.ly/postman-datademocratization

Ecommerce Analytics and Intelligence platform; Built and managed the backend for all products and led teams to deliver real-time personalized recommendations.

• Improved Elasticsearch data model to shrink index size by 60x https://bit.ly/elasticsearch60x
• Saved 7x storage cost of MongoDB by implementing interoperable compression https://bit.ly/mongo7x
• Designed algorithms for live traffic distribution and path tracking of users

• Built and maintained stream-based analytics system, that processed 10s of millions of user events a day
• Managed distributed Systems and NoSQL databases while ensuring high availability and resiliency

• PROJECT: PinQuip Messenger (Node.js, JavaScript, WebRTC, Node Webkit)
  • Real-time messaging and communication platform implemented via Sockets
  • With support for File Sharing, Audio & Video call

• PROJECT: NETMIN - Server Administrator (Shell Scripting, LAMP stack)
  • Can manage complex Server management with a fluid web interface

• Why we chose Apache Spark for ETL (Extract-Transform-Load)
• Optimising ElasticSearch and save storage cost by 60x — Know Your Data (KYD)
• Optimising MongoDB and save storage cost by 7x — Know Your Data (KYD)
• Optimising E-Commerce Data — Know Your Data (KYD)