Rahul Upadhyay

Rahul Upadhyay


Experienced Backend Engineer

I have over 15 years of IT industry experience. I am proficient in designing platforms with Event-Driven Architecture, I enjoy coding in Golang and solving business problems. I am skilled in developing microservices and serverless applications, implementing CI/CD pipelines, and enhancing system observability. I am adept at collaborating with cross-functional teams to deliver scalable and reliable backend solutions.

See projectsLinkedInGitHubDownload printable PDF

About Me

🎯 My mission:

To elevate product, enhance performance, and foster unwavering trust with stakeholders.

🚀 My Approach

I dissect complex product components, meticulously crafting software solutions, identifying possible issues and mitigating them. I orchestrate solutions, prioritizing steps with precision and ensuring seamless execution. Trust is my currency. I collaborate seamlessly with colleagues, moving swiftly and decisively. Leveraging cutting-edge technology and systems, I simplify intricate decisions, ensuring optimal outcomes.

🤝 Technical Acumen + Leadership:

My unique blend of technical prowess and leadership skills drives success. From concept to production, I own projects, fostering innovation and excellence.

🌱 Community & Growth:

Outside engineering, I contribute small open-source utilities when they're useful.

Tech Skills

Golang

Golang

AWS

AWS

Lambda

Lambda

DynamoDB

DynamoDB

ElasticSearch

ElasticSearch

PostgreSQL

PostgreSQL

MySQL

MySQL

MongoDB

MongoDB

Docker

Docker

K8s

K8s

Terraform

Terraform

Personalize

Personalize

Redis

Redis

Java

Java

Kotlin

Kotlin

Typescript

Typescript

Projects

Short summary of work showing problem & impact.

Real-time ETL Pipeline & CRM Migration

Built a robust ETL pipeline to stream ~2.4M transactional events/month into CRM platform with incremental processing, enabling real-time insights. Led the full migration of users, subscriptions, and historical data to a new CRM platform, ensuring data integrity and minimal downtime.

ETLData EngineeringEvent-DrivenCRMBrazeSystem ArchitectureGolang

Event-driven Data Ingestion & Search System

Designed an event-sourced architecture to capture high-throughput data changes with strong consistency. Delivered scalable APIs backed by Elasticsearch for low-latency search and enhanced user experience.

Event SourcingData EngineeringSystem ArchitectureElasticsearchSearchMicroservicesRest APIKotlinJava

Content Recommendation Service

Developed a personalized recommendation engine using AWS Personalize with custom APIs supporting advanced filters. Optimized response times through caching and data restructuring, improving user engagement.

Recommendation SystemsPersonalizeMicroservicesData EngineeringCachingSystem ArchitectureGolangRest APIRedis

Platform Data Migration & Multi-Locale Support

Led the migration of 100K+ users, content, subscriptions, and historical records from an acquired platform to the current system. Implemented multi-locale backend support, ensuring seamless global user experience.

Data MigrationBackend DevelopmentData EngineeringSystem ArchitectureGolang

AI-powered Healthy Meal Scanner

Built a serverless AI system to identify food images and provide personalized nutritional guidance. Leveraged AWS Lambda, DynamoDB, and S3, optimizing predictions through prompt engineering.

AIServerlessDynamoDBS3Rest APISystem ArchitecturePrompt EngineeringGolang

Unified API Gateway

Consolidated 12 client API calls into a single endpoint using AWS Lambda and Go routines for concurrent processing. Reduced client-side complexity, minimized errors, and improved performance for web and mobile apps.

API GatewayServerlessAWSGolangSystem Design

DTO Consistency Framework

Established standardized DTOs across services to ensure consistent, modular, and row-based API responses. Reduced client-side complexity and improved maintainability across multiple APIs.

System DesignArchitectureGolangAPI ContractsConsistency

Case studies

Descriptions of work showing problem, approach, and impact.

    The legacy system that connected customer data to the CRM (Emarsys) relied on multiple brittle handlers and nightly cron jobs. This caused scalability issues, delayed data availability, and hacky workarounds for real-time use cases. I conducted a deep audit of CRM use cases, designed a strategy to migrate operations to Braze (a modern engagement platform), and architected a real-time event-driven ETL pipeline in Go. This system supported sustained throughput of ~80k events/hour, migrated over 2.8M customer records, and replaced the entire legacy stack. The migration not only improved reliability and data freshness but also freed the CRM team from operational overhead. Key lessons: thoughtful event modeling, resilient consumer design, and investing in operational tooling are as critical as writing robust code.

    Impact:

    Reduced data latency from 24 hours to real time by replacing fragile nightly crons with a high-throughput event-driven pipeline. Sunset multiple legacy CRM handlers, streamlined CRM workflows, and enabled faster, more personalized customer engagement—directly improving win-back and repurchase metrics.

    Real-time ETL Pipeline & Legacy CRM Migration

    Real-time ETL Pipeline & Legacy CRM Migration

    ETLData EngineeringGolangEvent-DrivenCRMBrazeMigrationScalingArchitectureSystem DesignMysqlMongoDBPostgreDynamoDB

    Previously, client applications (Web, Android, iOS) made direct calls to multiple backend services, each with inconsistent DTO structures. This caused bloated client logic, fragile features, difficult debugging, and slow development velocity. Backend services were equally burdened—changes often required maintaining multiple API versions (v1, v2, v3), creating a maintenance nightmare. I partnered with product and client guild engineers to define a unified DTO contract, ensuring modular, row-based responses across services. I introduced a gateway layer using AWS Lambdas to handle all client data requests, aggregating responses from multiple backend services into standardized DTOs. By leveraging Go routines for concurrent processing and aggregation, the system delivered lower latency and reduced client-side overhead. This approach decoupled backend services from client DTOs, allowing services to focus solely on domain responsibilities while the gateway handled orchestration and data shaping. The result: simplified client integration, reusable gateway packages for page/screen-specific needs, and a significant improvement in scalability, reliability, and developer productivity.

    Impact:

    Standardized client-server contracts and unified multiple client API calls into a single gateway layer. Reduced client complexity, eliminated inconsistent implementations across platforms, and improved backend maintainability—accelerating feature delivery across Web, iOS, and Android.

    Unified API Gateway & DTO Consistency Framework

    GolangArchitectureConsistencyContractsMicroservicesAWS LambdaAPI GatewayServerless

Certifications

Programming with Google Go Specialization

Issued By: University of California, Irvine

Coursera

Show CredentialProgramming with Google Go Specialization

Architecting Solutions on AWS

Issued By: Amazon Web Services

Coursera

Show CredentialArchitecting Solutions on AWS

Concurrency in Go

Issued By: University of California, Irvine

Coursera

Show CredentialConcurrency in Go

Open Source Contributions

Simple Ava HTML Reporter

Simple Ava HTML Reporter is a reporting module for Ava to parse the JSON output to a beautiful report.

npmavahtmlreportertdd

See PackageSimple Ava HTML Reporter

Protractor simple cucumber html reporter plugin

This plugin will connect Protractor, CucumberJS and protractor-cucumber-framework to generate unique JSON files per feature with only a few lines of code.

npmprotractorhtmlplugincucumber

See PackageProtractor simple cucumber html reporter plugin

Simple Cucumber HTML Reporter

Simple Cucumber HTML Reporter is a reporting module for Cucumber to parse the JSON output to a beautiful report.

npmhtmlcucumberreporterbdd

See PackageSimple Cucumber HTML Reporter

Resume & Experience

Download printable PDF

  • Owned and delivered end-to-end microservices architecture, overseeing design, deployment, and long-term maintenance to ensure scalability and reliability.
  • Collaborated with cross-functional agile teams (Product Owners, Frontend Engineers, Designers, BI) to deliver features aligned with business goals.
  • Fostered a culture of knowledge sharing by promoting best practices, lessons learned, and architectural insights across teams.
  • Developed microservices and AWS Lambda functions for efficient data ingestion, transformation, and retrieval, reducing latency and improving system responsiveness.
  • Designed robust API contracts and optimized database schemas to improve query performance and ensure long-term scalability.
  • Implemented concurrent data aggregation using Go routines, reducing data processing time and delivering faster, actionable insights.
  • Built and maintained CI/CD pipelines with GitHub Actions, accelerating release cycles through automated integration and deployment.
  • Established monitoring, observability, and alerting systems to enhance reliability, improve uptime, and minimize production issues.
  • Led and mentored a high-performing team of 11 SDETs, strengthening collaboration, accelerating delivery, and embedding a culture of knowledge sharing.
  • Spearheaded automation and performance benchmarking for Telekom OneApp, improving release confidence and reducing regression effort.
  • Developed comprehensive native app (iOS + Android) and backend API automation suites, reducing manual testing cycles and improving release velocity.
  • Built and executed performance benchmarking test suites for backend APIs, identifying bottlenecks and improving scalability and reliability.
  • Integrated regression and performance automation into CI/CD pipelines, enabling continuous quality validation and faster developer feedback.
  • Coordinated testing across Android, iOS, and backend microservices to ensure seamless cross-platform delivery within the enterprise ecosystem.
  • Owned Agile SDLC delivery for mobile and backend systems, ensuring on-time, high-quality releases.
  • Defined and executed automation strategy for 30+ microservices, 7 Angular portals, and a native Android app, improving release velocity and reliability.
  • Developed scalable client (web + Android) and backend API automation suites, reducing manual effort and ensuring faster feedback cycles.
  • Designed and implemented performance benchmarking frameworks for backend APIs, driving scalability and reducing downtime.
  • Streamlined delivery by integrating automation and performance tests into CI/CD pipelines, accelerating deployment and feedback loops.
  • Oversaw Agile SDLC delivery for platform releases, ensuring predictable timelines and high-quality outcomes.
  • Led and mentored a team of 15 SDETs, fostering innovation, collaboration, and continuous skill growth.
  • Enhanced and maintained an automation suite of 2,200+ test cases, ensuring broad coverage and reliable test results for Data Integration (DI) and Platform projects.
  • Converted 2,200+ UI test cases into API-level automation, cutting execution time by 15%, eliminating flaky tests, and improving developer productivity.
  • Streamlined automation workflows and focused on API-level reliability, reducing maintenance overhead and accelerating feedback cycles.
  • Defined roadmap, strategy, scope, and timelines for automation of 5 enterprise-grade connectors, enabling structured delivery and predictable timelines.
  • Built automation frameworks and delivered 30+ connector releases, reducing release cycle time and improving overall delivery consistency.
  • Integrated regression automation into CI/CD pipelines, enabling continuous validation and reducing post-release defects.
  • Strengthened connector reliability and maintainability by improving test coverage and streamlining automation workflows.
  • Defined roadmap, strategy, and timelines for multiple projects, ensuring structured delivery and predictable outcomes.
  • Designed automation frameworks for Web & Mobile platforms and implemented performance benchmarking scripts, reducing regression effort and improving scalability insights.
  • Integrated automated regression tests into CI/CD pipelines, accelerating delivery and enabling continuous quality checks.
  • Developed automation test suite for SRS EHR, reducing manual regression effort and increasing coverage.
  • Implemented a VBA-based tool to generate reports from raw biometric attendance data, improving efficiency and eliminating manual reporting effort.
  • Authored and executed detailed test cases in HP Quality Center and logged defects using IBM ClearQuest.
  • Validated mainframe applications and backend databases (IBM DB2, MS SQL), ensuring functional accuracy and data integrity.

Get in touch

I'm available for full-time roles. Email: rahul841986@gmail.com

© 2025 — Built with ❤️ by Rahul