Abhishek Gupta

Senior Software Engineer at Goldman Sachs

ć [email protected] Ħ +91-8349920123 ] abhishek-20123

Education
Indian Institute Of Technology Roorkee Roorkee, Uttarakhand
B.Tech in Electrical Engineering CGPA: 8.108/10.0 2020

Experience
Goldman Sachs Bangalore, India
Software Development Engineer II - Associate July 2020 - Present
f Role and responsibilities
- Led a team of five, took ownership and drove multiple OKRs.
- Recognized as the top-performing peer for two years.
- As a Design Committee member, played a vital role in reviewing and making critical design decisions for the global
team while offering assistance and design-related suggestions to peers.
f LOTUS Data Streaming platform
- Held ownership and was subject matter expert (SME) of data streaming platforms which involves development and
oversight of a time-critical data distribution pipeline sharing across the firm and requiring expertise in distributed
systems and Big data streaming platforms such as Kafka, Flink and Kafka Connect.
- Made significant contributions to the development and designing of a data streaming platform from scratch, which
includes setting up Flink and Kafka Connect cluster.
- Significantly contributed to the development of the initial codebase, outlining the foundational architecture, code
structure and critical modules. Established core libraries and connectors for external databases and services, serving
as the backbone for other teams to implement features efficiently.
- Led the initiative to create a comprehensive monitoring and alerting solution for the data streaming platform using
Grafana and Prometheus. This involves the development of a custom plugin to integrate with Flink, exposing
critical functional metrics and designing an extensive dashboard with robust alerting capabilities.
f LOTUS Kafka Messaging bus
- Developed a real-time Kafka based solution to effectively disseminate critically time-sensitive compliance data across
the entire firm (30+ trading platforms).
- Successfully reduced propagation latency from 45 minutes to a few seconds, ensuring zero data loss and meeting the
SLA requirement for 99.9999% availability.
- The messaging bus has the capability to share data across over 10+ categories, supporting a data velocity of 1 million
events per minute. It is equipped with encryption for handling sensitive data and utilizes Avro for serialization.
f Contributed to several essential optimization initiatives
- Optimized the ETL pipeline, reducing the time for full ingestion from 3 days to 6 hours.
- Reduced encrypted data size by 6 times (83%) through optimized serialization and effective advanced structure.
- Investigated and optimized several SQL and MongoDB queries, reducing query time from minutes to a few seconds.
Cockroach Labs Remote
Open Source Contribution Mar 2020 - May 2020
- Contributed to CockroachDB, a cloud-native distributed SQL database for scalable, data-intensive applications.
- Implemented PostgreSQL functionality by introducing various fundamental operators and functions.
- Built comprehensive support for geometric and geospatial functionality for the database. This involved the addition
of various fundamental operators and functions in Go and the creation of C wrappers on top of PostGIS’s library.
D.E. Shaw India Pvt. Ltd Hyderabad, India
Software Engineering Intern May 2019 - July 2019
- Implemented generalized framework that allows logical caching of pre-computed data using Hdf5.
- Built low-latency Python APIs, leveraging caching framework to compute financial attributes from multiple sources.
- Created CLI tools in Python which allow developers to view, visualize and compare data across various data sources
and mail the report of data inconsistency.

Projects
Development of Visitor’s Vehicle Monitoring System May 2018 - June 2018
- Developed an Web application to enhance security on campus premises by monitoring each incoming vehicle.
- Built Python-based services to receive and parse real-time TCP packets from GPS devices.
- Developed a Web Application that displays the real-time location and status of every vehicle and allows security staff
to keep track of all the vehicles entering the campus
Distributed Key-Value Store Mar 2020 - May 2020
- Implemented a Go-based Key-Value store with the Raft consensus algorithm for high availability and data replication.
- Implemented effective inter-node communication in a Key-Value store using gRPC and Protobuf for serialization.
Skills
Programming languages: Java, Go, C++, Python, Bash
Apache Flink, Apache Kakfa, MongoDB, Db2, HDFS, S3, Google Guice,
Framework and Technologies:
Spring boot, Flask, Apache Avro, Google Protobuf, gRPC
Achievements
f Recognized as the top-performing peer for two years.
f Honorable Mention in ICPC Asia-Amritapuri onsite Regional Contest 2018 and 2019.
f Team Rank 35 in ICPC Asia Gwalior-Pune online Round 2018.
f Secured All India Rank 1495 in JEE Advance 2016 and 268/360 in JEE Mains 2016