Software Engineer @ Microsoft

Building Hyperscale Systems
That Power the Cloud

With 4+ years of experience architecting and scaling distributed systems, I've engineered solutions that handle 100M+ requests per minute and process petabyte-scale data at Microsoft.

I'm a technology-agnostic problem solver who believes languages and frameworks are just tools—what matters is architecting robust systems, optimizing performance, and delivering measurable business impact. Whether it's distributed computing, real-time data processing, or building scalable platforms, I adapt and excel with the right technology for the challenge.

Arpan Sahu Cartoon Avatar
Python
Django
React
Docker
Kubernetes
AWS
PostgreSQL
Redis
About Me

I transform complex problems into elegant solutions.

As a Full Stack Developer, I've evolved into a highly versatile engineer capable of designing, building, and scaling robust systems. My journey has been driven by a love for technology and a passion for architecting reliable solutions.

Experience

4 years 9 months

Nationality

Indian

Languages

English, Hindi

Interests

Travel, Music, Gaming, Chess

Tech Stack

Languages & Frameworks
Python Django Flask FastAPI JavaScript React Redux C C++ HTML5 CSS3 Bootstrap MUI jQuery
Databases
PostgreSQL MySQL MongoDB Redis SQLite
DevOps & Cloud
Docker Kubernetes AWS Heroku Jenkins GitHub Actions GitLab Harbor Rancher Portainer Nginx
Message Queues & Streaming
Kafka RabbitMQ Celery
Tools & Technologies
Git GitHub GraphQL JWT WebSockets Selenium Scrapy Sentry MinIO Bash
Data Science & ML
Pandas Scikit-learn
Services & Integrations
PayPal Razorpay Google Maps Mailjet DNS Hostinger Namecheap
TIMELINE

Education & Experience

Education

Lakshmi Narain College of Technology & Excellence, Bhopal

CGPA: 8.55

  • Developed disease prediction app (Third Eye).
  • Built Premium Collection Point (Django Web App).

Shir Ram Adarsh Higher Secondary, Seoni

Percentage: 70.40%

Bhonsala Military School, Nagpur

Percentage: 88.60%

Experience

Noida, India

  • Engineered hyperscale orchestration systems powering Microsoft's data collection and analytics pipelines, enabling petabyte-scale processing and 100M+ requests per minute with high reliability.
  • Optimized distributed infrastructure for performance, fault tolerance, and automation, reducing operational overhead while ensuring SLA compliance and global availability.
  • Built systems that empower downstream data teams to efficiently collect, transform, and analyze massive datasets, serving as the foundation for Microsoft's data-driven insights and decision-making.
100M+ RPM Petabyte-scale Hyperscale Systems Global SLA Compliance

Bengaluru, India

  • Developed a SaaS platform for Extended Detection and Response (XDR), migrating customer data from individually owned, on-premises EC2 instances to a centralized architecture leveraging Kubernetes clusters and a unified database. This transition reduced infrastructure management overhead, enabled scalable, pay-as-you-go service offerings, optimized resource utilization, and facilitated modular cybersecurity services.
  • Enhanced the SaaS platform's (SOAR - security orchestration and response system) efficiency by building a robust CI/CD pipeline, automating testing, deployment, and scaling processes, reducing deployment times by 40% and increasing system reliability and responsiveness.
  • Architected integrations with Tenable, Microsoft Azure, VirusTotal, ServiceNow, and Trellix/McAfee. These integrations handled 3 million RPM and supported 500,000 concurrent playbook (REST APIs Integrations) executions, improving platform efficiency by 25% and enabling faster, more effective threat responses.
  • Engineered a high-performance data segregation engine to identify customer-specific threat impacts across billions of records. By transitioning from traditional database queries to Redis key-value pairs and ultimately optimizing to a bit-string representation, achieved a ~99.88% reduction in memory usage and improved query speeds by over 100x, enabling real-time threat analysis and decision-making at scale.
  • Made real-time streaming supported in an analytical system utilizing Kafka, worked with ACL and other Kafka cluster management along with Zookeeper.
  • Built a Search Microservice, consolidating the search functionalities of three existing Trellix products into a single interface, and implemented Elasticsearch for additional search capabilities. This innovation improved data retrieval speed by 80% and simplified the user experience by eliminating the need for multiple search portals.
  • Implemented a dynamic rule engine that enables the SaaS platform to define, manage, and execute complex cybersecurity rulesets stored in the database. By eliminating the need for hardcoded logic, this solution streamlined the creation and deployment of new threat detection rules, reducing response times and enhancing agility in addressing emerging threats.
  • Worked on developing the Trellix IAM microservice to enable seamless authentication across internal cybersecurity platforms, significantly reducing human involvement in the authentication process.
  • Leveraged Generative AI with LangChain, RAG, and gRPC to automate the generation of SOAR marketplace apps, reducing manual effort through intelligent code generation, playbook creation, and seamless microservice communication.
3M RPM 40% Faster Deployment 99.88% Memory Reduction 80% Speed Improvement 500K Concurrent Executions 25% Efficiency Gain 100x Faster Queries

Pune, India

Got merged with McAfee to form Trellix

Indore, India

  • Delivered high-quality, maintainable code by implementing best practices, automated testing, and code reviews, reducing bug resolution time by 15% and release cycles by 30%.
  • Collaborated with cross-functional stakeholders to define requirements and optimize implementation strategies, achieving a 25% decrease in project turnaround time.
  • Designed and implemented a scalable betting platform for Betfaro, supporting 50,000+ concurrent users during peak match times, processing over $1M in daily transactions, and leveraging the New Double Bet model to drive a 60% increase in client profitability and a 40% surge in website traffic.
  • Optimized data processing workflows for KodeKloud by 20% through the development of scalable features leveraging MongoDB, Flask, and AngularJS.
  • Designed and optimized database schemas to support high-volume transactions, ensuring scalability and efficiency for Betfaro's betting platform.
  • Integrated subscription-based and order-based payment systems with Crypto as well as real currency-based gateways like PayPal and Razorpay.
50K+ Concurrent Users $1M Daily Transactions 60% Profitability Increase 40% Traffic Surge 30% Faster Releases 25% Faster Turnaround
PORTFOLIO

Featured Projects

A collection of my work, ranging from web scraping bots to full-stack applications.

Scrape Optimus
Python Django HTML5 CSS3 JQuery Bootstrap JavaScript Redis PostgreSQL GitHub Docker Harbor Kubernetes Jenkins Nginx Minio Ubuntu MailJet Sentry Razorpay PayPal OpenVPN Kafka RabbitMQ Geocodify Rancher
A versatile web scraping solution.
  • Proxy Aggregator for integration with over 200 proxy providers.
  • Job Scheduling and Monitoring & Alerts for managing scraping jobs effectively.
  • AI integration planned for autonomous spider generation.
  • Deployed on Hostinger VPS
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment. Integrated Automatic Readme Generator Github
arpansahu | Django Personal Portfolio
Python Django HTML CSS JQuery Bootstrap Javascript Redis Postgres Github Docker Harbor Kubernetes Jenkins Nginx Minio Ubuntu MailJet Sentry Rancher
  • Developed a Django-based portfolio app featuring my profile, projects, a contact page with mailjet integration, and the ability to download my resume.
  • Integrated README-to-HTML conversion Github and allowed admin to upload resumes.
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment.
  • Integrated Automatic Readme Generator Github
Razorpay IPN Django Handler | OpenSource Python Library
Python Django Github Github Actions PyPI
A Django app for handling Razorpay Instant Payment Notification (IPN) webhook events.
  • designed to manage payment, order, and subscription notifications seamlessly with support for signal-based event tracking
Great Chat | Django Chat Project
Python Django HTML CSS JQuery Bootstrap Javascript Redis Postgres Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Channels Web Sockets Rancher
  • Developed a real-time chat app using Django Channels, Redis, and PostgreSQL..
  • Implemented private, group, and global chats with features for creating, deleting, joining, and leaving groups.
  • Added online/offline notifications and profile management.
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment.
  • Integrated Automatic Readme Generator Github
Borcelle CRM | Django Customer Relation Management
Python Django HTML CSS JQuery Bootstrap Javascript Redis Postgres Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Web Sockets Django Channels Celery RabbitMQ Rancher Flower
Customer Relationship Manager Django app with Email Contact and sheduling facility.
  • Developed a Django-based Customer Relationship Manager (CRM) with email communication capabilities.
  • Implemented a progress bar for users to track task completion.
  • Admins receive notifications when scheduled messages are successfully delivered and can schedule broadcast notifications to all customers.
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes. Enabled CI/CD pipelines for automated testing, building, and deployment.
  • Integrated Automatic Readme Generator Github
Clock Work | Django Reminder App
Python Django HTML CSS JQuery Bootstrap Javascript Redis Postgres Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Web Sockets Django Channels Celery Rancher Flower
Notes Taking Django app along with Reminder Scheduler
  • Django based Notes Email and Reminder App, Progress bar, where user can see how much task is remaining.
  • When Scheduled Reminders are successful, Users are notified and Admin can Schedule Broadcast Notifications for all Users.
  • Integrated Automatic Readme Generator Github
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment. Integrated Automatic Readme Generator Github
School Chale Hum | Django School Management App
Python Django HTML CSS JQuery Bootstrap Javascript Redis Postgres Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Rancher
  • Developed a Django application for managing students, their schools, and associated books.
  • Implemented functionality to track and display each student's progress with specific books.
  • Engineered a custom Django command for extracting data from CSV files and populating the database.
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment. Integrated Automatic Readme Generator Github
Third Eye | AI Disease Predictor
Python Django HTML CSS JQuery Bootstrap Javascript Postgres Redis Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Pandas Scikit Learn Google Maps Rancher
AI powered Disease Predictor.
  • A simple web interface with three primary views, all function-based, allowing users to interact with the application easily.
  • Provides users with an intuitive interface to input symptoms, view predictions, and locate nearby medical facilities.
  • Displays nearby hospital facilities based on the user’s location.
  • Deployed on AWS EC2, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment. Integrated Automatic Readme Generator Github
Altered Datum | React Blog App
React React Router MUI Redux CSS Javascript Github Rancher Docker Harbor Kubernetes Jenkins Nginx Ubuntu
  • Crud operations for Blogs for Admin
  • Used Material UI
  • Home page displays a list of existing blogs
  • Material UI
  • Integrated with REST API using axios at end point:
    click here
  • Forget Password and Social Login Integrated
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment. Integrated Automatic Readme Generator Github
Altered Datum API | Django Rest API App for React Blog App
Python Django Django Rest Framework HTML CSS JQuery Bootstrap Javascript Postgres Redis Github Docker Harbor Kubernetes Jenkins Nginx Minio Ubuntu MailJet Sentry Rancher
  • Implemented Complete Auth Using Django Custom Auth Model.
  • Implemented Social Login using drf-social-oauth2, which combines normal auth and social auth
  • Implemented Crud Operations with Django Rest Framework
  • Implemented Schema and Swagger with CORE API
  • Integrated with React Front End :
    click here
  • Forget Password and Social Login Integrated
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment. Integrated Automatic Readme Generator Github
Chew and Cheer | Django Project CRUD using AJAX, DJANGO FORMS, GRAPHQL and DJANGO REST/GRAPHQL APIs
Python Django HTML CSS JQuery Bootstrap Javascript Redis Postgres Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Rancher
  • Implemented a complete authentication system using Django's default auth model.
  • Developed CRUD operations for a restaurant menu with Django Forms, Ajax, and GraphQL.
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and set up CI/CD pipelines for automated testing, building, and deployment.
  • Integrated Automatic Readme Generator Github
Django Starter | Django QuickStarter Project
Python Django HTML CSS JQuery Bootstrap Javascript Redis Postgres Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Web Sockets Django Channels Celery Rancher Flower
  • This is a Django Starter Porject.
  • Latest Django Stable Version Updated
  • S3 Integration / Cache Integration/ Celery Progress Bar Integration / Sentry Intgeration with Logging/ MailJet
  • Deployed on Ubuntu VPS, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment.
  • Integrated Automatic Readme Generator Github
Numerical | Django Simple Numeric Calculator
Python Django HTML CSS JQuery Bootstrap Javascript Postgres Redis Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Rancher
  • Utilized SoftUI, Bootstrap, and jQuery to create dynamic and interactive pages.
  • Implemented calculator functionality supporting operations like addition, subtraction, multiplication, division, and bracket evaluation.
  • Integrated Automatic Readme Generator Github
  • Deployed on AWS EC2, containerized with Docker/Kubernetes, and enabled CI/CD pipelines for automated testing, building, and deployment. Integrated Automatic Readme Generator Github
Premium Collection Point
Python Django Selenium HTML CSS Bootstrap Javascript Postgres Heroku Github
This project is a working Project for Premium Collection Point. In this project there are two entities namely branch and manager. My father is a LIC Wealth Manager and I have built this project to help him manage his clients across PAN India.
Challenges Faced By My Father during Pandemic:
  • His 90% client used to pay their LIC Premiums using Cash.
  • Pre Pandemic they used to visit Fathers office or LIC branch to pay their premiums which was not possible due to lockdown across India.
  • Penalty Charges were increasing on my fathers clients and my Fathers Income was also reducing

This Project was build as a solution to the problem
Great Chat Legacy | Django Chat Project
Python Django HTML CSS JQuery Bootstrap Javascript Redis Postgres Github Docker Harbor Kubernetes Jenkins Nginx MinIO Ubuntu MailJet Sentry Channels Web Sockets Rancher
  • Implemented Complete Auth Using Django Default Auth Model.
  • Implemented Chat App using Django Channels/Redis/Tortoise ORM
  • Deployed on Hostinger VPS
  • Containerized using Docker
  • Deployed on Hostinger VPS
Geek Glasses | Django Custom Auth User Model from AbstractBaseUser
Python Django HTML CSS Bootstrap Javascript Postgres Heroku Github
  • Implemented Complete Auth Using Custom Auth Model.
  • Used built in AbstractBaseUser as parent Auth Model.
  • Build Custom Manager for the same
  • Login. SingUp, Logout, Account Views Implemented
  • In built views of PasswordChangeDoneView, PasswordChangeView, PasswordResetCompleteView, PasswordResetConfirmView, PasswordResetView, PasswordResetCompleteView. Build Custom Templates for These Inbuilt Views
  • Implemented Forget Password
  • Deployed on Hostinger VPS
OWL EYES | Django All Auth Implementation
Python Django HTML CSS Bootstrap Javascript Postgres Heroku Github
  • Implemented Complete Auth Using Django All Auth @https://django-allauth.readthedocs.io/en/latest/installation.html.
  • Django All Auth with built-in Django Auth Model
  • You can log in with username/email/social accounts
  • Build custom templates for a lot of functionalities, you juts have to place template with same name inside same location which would be used by all auth
  • In built views of PasswordChangeDoneView, PasswordChangeView, PasswordResetCompleteView, PasswordResetConfirmView, PasswordResetView, PasswordResetCompleteView. Build Custom Templates for These Inbuilt Views
  • Used GitHub Social Login and Google social Login
  • Deployed on Hostinger VPS

Get in touch!

I’m currently looking for new opportunities. My inbox is always open.
Whether you have a question or just want to say hi, I’ll try my best to get back to you!

+91 7828007426 9:00am to 7:00pm
arpansahu@zohomail.in Monday to Sunday