Dynamic and motivated 12+ years IT professional as a Lead Data Engineer with expertise in designing data intensive applications using AWS and GCP cloud Technologies, Data Warehouse, building CI/CD Pipelines, Data Visualization, Reporting, Data Quality solutions and AI/ML technologies.
Work Experience
Empowering Creativity through
FEB 2015 - CURRENT
Capital One (Remote)
Lead Data Engineer
Developed and optimized ETL pipelines using AWS Glue, Databricks, and Snowflake to process large-scale structured and semi-structured data. Designed and implemented data lake architectures on AWS S3, integrating with Snowflake and Redshift for efficient analytics.
SEP 2024 - JAN 2025
bioMérieux, St. Louis, MO (Remote)
Senior Data Engineer
Designed and deployed scalable data pipelines using AWS services like S3, Glue, Redshift, EMR, and Lambda for efficient data processing. Built real-time data streaming solutions with Amazon Kinesis and Apache Kafka for low-latency analytics.
JAN 2020 - JULY 2024
Reputation.com, San Ramon, CA (Offshore/Onsite)
Senior Data Engineer
Developed and maintained the company’s comprehensive data strategy, ensuring alignment with business goals and digital transformation initiatives. Designed and implemented scalable, secure, and efficient data architectures, enabling the ingestion, storage, and analysis of large volumes of structured and unstructured data.
JUNE 2016 - JAN 2020
Valeo, Chennai, India
Data Engineer
Designed and implemented data pipelines in GCS for processing large-scale telemetry data generated by Battery Electric Vehicles (BEVs). Integrated BEV performance metrics into a GCS-based data lake for real-time analysis and monitoring.
OCT 2013 - FEB 2016
Caterpillar, Peoria, IL
ETL Developer
Used this existing database, the system should analyze the sales and profit and generates reports for Sales and Profits in month wise, Quarter wise and year wise. Developed so many mappings from source to stage and stage to star schema.
OCT 2012 - SEP 2013
Discover Financial Services, Deerfield, IL
ETL Developer
Understanding of the functionality as per the business requirements. Extracted data from various source systems like files and Oracle and loaded to the warehouse.
Google Cloud Platforms (GCP) (Google Data Flow, Google Data Fusion, Google Cloud Scheduler, Google Data prep, Google Cloud Storage, Google Bigquery, Looker Studio)95 %
ETL/ELT Tools
Apache Airflow, AWS Glue, Snow Pipe, Google Data Flow, Google Data Fusion, Informatica94 %
Apache Spark
Spark Core, Data Frames, Spark SQL, Spark Stream92 %
Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book.
JUNE 2006 - JUNE 2010
Bachelor of Technology
JNTU, Hyderabad, India
Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book.