Portrait of Harshveer Singh

Harshveer Singh

Director of Engineering, Elucidata · Noida, India

Director of Engineering | Cloud & AI/ML Leader | AWS Architect | Data & Security Innovator | Serverless & Microservice

I have around 13+ years of experience in Software Development domain. I graduated(B.Tech.) from IIT Delhi in 2013, started my career as Software Engineer(III).

Started out with technologies and languages like C++, Java, JS, HTML/CSS, SQL. Then progressively started adapting new technologies and languages like .NET, C#, .NET Core, Node.js, AngularJS, Angular, python, postgres DB, PWA and mobile app development, ionic, AWS Cloud Services, NoSql DB(dynamo), micro-services architecture, Kubernetes, CI/CD tools, log management and monitoring tools, serverless application architecture, performance tuning(SQL Queries performance, Application logic performance). I have hands on experience with developing AI and ML solutions. With increasing experience, started mentoring new developers, started leading development teams.

Right now I am working as Director of Engineering and leading multiple product engineering teams(spanning across different tech stacks of front-end, back-end, cloud infra, ML/AI) at Elucidata, building and delivering highly scalable, performant cloud native application and ML and AI solutions. Also leading overall infra security framework of company.

Experience

  1. 2022 — now

    Elucidata

    • Director of EngineeringJan 2023 — now

      In my role as Director of Engineering, I work to foster the culture of innovation and research-driven development. My responsibilities include strategic leadership, coordinating multiple product engineering teams, hands- on technical expertise, improving delivery quality and efficiency, upholding latest industry standards, leading security of overall infra.

      Engaging actively with a diverse technology stack, I bring hands-on experience in Python, Node.js, Angular, and various AWS services. I have experience with designing ML/AI powered solutions, leading a team of ML engineers and development efforts for creating agentic AI solutions for various workflows of applications. My proficiency extends to implementing serverless and microservice enterprise grade applications. I have hands-on experience with architecting applications for Cloud(AWS, Azure, GCP) or for on-premise servers with focus on Reliable, Scalable and Maintainable solutions. I am also leading development efforts of hosting resource intensive applications like bioinformatics pipelines on kubernetes cluster.

      • Designed a multi-agent AI co-scientist system to help generate hypothesis and experimental designs
      • Improved data curation accuracy and reduced curation time by almost 6x by using ML powered auto curation
      • Created AI system to query graph based knowledge graph of genomics data and generate insights from it
      • Architected solutions using federated learning frameworks for privacy-preserving ML model training on siloed data, adhering to data security compliances
      • Initiated project to bring compute intensive workloads from AWS cloud to baremetal cluster setup
      • Reduced cost of processing by 4x and speed of processing by 2.5x(Link to Webinar (opens in a new tab)) for Foundational models
      • Rearchitected managed jobs and jupyter notebooks hosting infrastructure using cloud native services to reduce maintenance to almost zero
      • Designed and architected lakehouse/data warehousing solutions and federated data products on Snowflake & Databricks to enable scalable analytics for genomics & clinical data
      • Leading organization security initiatives which includes getting SOC2 compliance certification, HIPAA certification, GDPR compliance, regular VAPT of the platform etc.
      • Aligning individual teams to organizational goals to achieve quarterly org KRAs
    • Sr. Engineering ManagerMar 2022 — Dec 2022
      • As an Engineering Manager I am leading, guiding, mentoring multiple product engineering teams.
      • Working actively hands-on with Python, Node.js, Angular, AWS services. Using serverless approach to host our webapps on AWS cloud Using Terraform to manage infra.
      • Building and hosting resource intensive applications like jupyter notebooks, dockerised jobs environment, tools to run bioinformatics pipelines on kubernetes cluster to provide cost effective, fast and highly available environment.
      • Managing deployments via helm charts on kubernetes cluster.
  2. 2018 — 2022

    CareerBuilder

    • Engineering LeadDec 2018 — Mar 2022

      Here at CareerBuilder I am leading teams of developers working on multiple projects. I own complete development cycle of various microservices, some of which I have designed from scratch. I am working mainly with .NET/.NET Core, Node.js, Angular, SQL Server/MySql, various AWS Services.

      Below are some of the projects I have owned/worked on:

      Communication System: Designed and implement communication microservice from scratch. This micro service is used by other systems to send and receive 2-way email and SMS. This is implemented in .NET Core and storage is MySql. Deployed in AWS cloud(Packaged in Docker container and deployed in ECS, usage autoscaling), used Jenkins and Terraform scripts for CI/CD. Various services used by this microservice are - AWS Pinpoint, SNS, Lambda, Kinesis, Twilio, SendGrid, SparkPost etc. Owned complete development cycle for this service.

      Document Management System: System to fill forms and sign documents digitally. Implemented in .NET core and MySql on backend, Angular in frontend. Deployed in AWS cloud(Packaged in Docker container and deployed in ECS, usage autoscaling), used Jenkins and Terraform scripts for CI/CD. Managed complete development cycle for this service.

      Job Processing: A collection of multiple microservices for processing incoming job postings and various operations related to that. Implemented in Node.js mainly. Completely hosted in AWS cloud(Packaged in Docker container and deployed in ECS) utilizing various AWS services like - S3, Lambda, SQS, SNS, RDS.

  3. 2013 — 2018

    SumTotal Systems

    • Principal Software EngineerMay 2018 — Dec 2018

      Working as Full Stack developer on multiple products in C++, C#, .NET, SQL, HTML/CSS, JavaScript, AngularJS/Angular4. Working on implementing new features, designing and reviewing architecture, code reviews, mentoring and leading a team developers.

    • Sr. Software Design EngineerApr 2015 — May 2018

      Working as Full Stack developer on multiple products in C++, C#, .NET, SQL, HTML/CSS, JavaScript, AngularJS/Angular4. Working on implementing new features.

    • Software Design Engineer - IIAug 2013 — Mar 2015

      Working on product development in C++, JavaScript, HTML/CSS and SQL. My main responsibility is to implement new product features according to requirements. I have received appreciations from Customer Support for timing flexibility & quick resolutions. Received 2 Spot Award for good work in customer satisfaction & meeting compliances.

  4. 2012

    Defence Laboratory

    • InternMay 2012 — Jul 2012
      • Main area of my internship was Digital Image Processing.
      • Interfaced Mightex and Lumenera camera in C++ and MATLAB.
      • MATLAB scripts to perform Spatial Domain Operations on digital images.
      • MATLAB script for Image Segmentation using Graph Theory & Normalized Cut.
      • Application for Edge Detection in digital images using Frequency Domain Operators.
      • MATLAB script to Smooth & Remove Noise in image using low-pass & nonlinear filters.
      • Algo to select Optimal Bands in Hyperspectral Imaging System using Relative Entropy.

What I work on

AI in production
Agents and AI systems that hold up on real biomedical data.
Knowledge graphs
Queryable, versioned graphs behind reproducible answers.
Platform and cost
Infrastructure, compute economics and compliance.
Engineering leadership
Building AI capability inside existing teams.

Expertise

Languages
Python · Node.js · C++ · C · C# · SQL · JavaScript · HTML/CSS
Databases
SQL Server · Postgresql · DynamoDB · Elastic/Open Search
Cloud
AWS(EC2, ECS, Batch, Lambda, S3, EFS, FsX, Eventbridge, API Gateway, IAM, VPC, SNS etc.) · Azure(Basic)
Frameworks & Technologies
.NET · django · Angular · Kubernetes · Dockers · Prometheus · Grafana

Education

Indian Institute of Technology, Delhi

B.Tech., Engineering Physics (Major), Computer Science and Engineering (Minor) · 2009 – 2013

Short bio

For events and introductions.

Harshveer Singh is Director of Engineering at Elucidata, where he leads product engineering teams across front-end, back-end, cloud infrastructure and ML/AI, and heads the company's infrastructure security. His work spans AI systems for biomedical data, from a multi-agent AI co-scientist to ML-powered data curation; cloud-native and on-premise platforms, including moving compute-heavy workloads from AWS to bare metal; lakehouse data products on Snowflake and Databricks; and the SOC 2, HIPAA and GDPR programme. With more than 13 years in software, he previously led engineering teams at CareerBuilder and was a principal engineer at SumTotal Systems. He holds a B.Tech in Engineering Physics, with a minor in Computer Science and Engineering, from IIT Delhi.

Download headshot

Elsewhere