Senior Data Engineer

Simplify Alpha™

Hyderabad

On-site

INR 4,000,000 - 6,000,000

Full time

6 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Simplify Alpha™ is seeking a Senior Data Engineer to design and maintain data pipelines across AWS-native services and legacy SQL Server/SSIS. The role includes migrating workloads to AWS data platforms, ensuring data quality, and collaborating with BI and DevOps teams.

You will optimize performance, mentor engineers, and support analytics use cases with dimensional modeling and Power BI integrations.

Qualifications

  • Bachelor's degree in CS, Engineering, Info Systems or related field.
  • 1

Responsibilities

  • Design, build, and maintain ETL/ELT pipelines using AWS Glue, Lambda, Step Functions.
  • ,

Skills

AWS
S3
Redshift
Glue
Athena
Lambda
Step Functions
SQL Server
SSIS
T-SQL
Python
Dimensional Modeling
DMS
AI Tools
Power BI

Education

Bachelor's degree in Computer Science/Engineering/Information Systems

Tools

SQL Server
SSIS
Power BI
AWS Data Services
ETL/ELT tooling

Job description

Job Description:

We are looking for a Senior Data Engineer to design, build, and maintain data pipelines across our health plan technology platform, spanning AWS-native data services and existing SQL Server/SSIS ETL processes. This role sits alongside the other engineering teams in this application landscape (software engineering, Data/BI & Integration, DevOps, and Edifecs EDI), and carries dual responsibility: keeping current SQL Server/SSIS workloads reliable, and helping migrate and modernize them onto AWS-native pipelines.

Key Responsibilities
  • Design, build, and maintain ETL/ELT pipelines using AWSGlue, Lambda, and Step Functions to ingest, transform, and load data acrossAWS-based data platforms (S3, Redshift, Athena)
  • Maintain, enhance, and troubleshoot existing SQLServer-based ETL processes built in SSIS, including packages, control flows,data flows, and error handling
  • Write and optimize complex T-SQL queries, storedprocedures, and views supporting reporting and downstream applications
  • Support ongoing migration and modernization of legacySQL Server/SSIS ETL workloads to AWS-native data pipelines
  • Design and maintain data models (dimensional/starschema) supporting analytics and reporting use cases
  • Use AWS Database Migration Service (DMS) and relatedtools to support data migration from on-premises SQL Server to AWS
  • Implement data quality checks, validation, andmonitoring across ETL pipelines
  • Optimize pipeline performance, reliability, and costacross both AWS-native and SQL Server/SSIS workloads
  • Partner with BI, integration, and application teams(including the Power BI and Edifecs/EDI teams within this applicationlandscape) to ensure data availability and consistency across systems
  • Document data flows, pipeline architecture, and datamodels to support internal knowledge sharing
  • Troubleshoot and resolve production data pipelineissues, including root-cause analysis
  • Mentor junior engineers on data engineering and ETL/ELTbest practices
Required Qualifications
  • Bachelor's degree in Computer Science, Engineering,Information Systems, or a related field
  • 8–12 years of experience in data engineering or ETLdevelopment
  • Strong, hands-on experience with AWS data services: S3,Redshift, Glue, Athena, Lambda, and Step Functions
  • Strong, hands-on experience with SQL Server, includingT-SQL development, query optimization, and performance tuning
  • Strong, hands-on experience building and maintainingETL packages in SSIS (control flow, data flow, error handling, and deployment)
  • Working proficiency in Python for scripting,automation, and Glue/PySpark-based ETL development
  • Solid understanding of dimensional data modeling (starschema) for analytics and reporting use cases
  • Experience with data migration tools and approaches(e.g., AWS DMS) for moving workloads from on-premises SQL Server to AWS
  • Strong understanding of data quality, governance, andlineage practices
  • Strong debugging, performance-tuning, andproduction-support skills across ETL pipelines
  • Excellent written and verbal communication skills forcross-functional collaboration
AI Knowledge & AI-Assisted Development (Required)
  • Daily, practical use of AI coding/assistant tools(e.g., Claude Code, GitHub Copilot, Cursor, or similar) to acceleratedevelopment of Glue/PySpark scripts, SSIS package logic, and T-SQL queries
  • Able to critically review and validate AI-generatedcode, queries, and transformations for correctness, performance, and dataintegrity before deployment
  • Practical use of AI tools to assist with dataprofiling, anomaly detection, and technical documentation
  • Understanding of secure and compliant AI tool usage,including never entering PHI, member data, or other sensitive information intoprompts or external AI tools
  • Able to identify where AI-driven automation can improvepipeline development, testing, or migration efficiency, and champion adoptionwithin the team
Preferred Qualifications
  • Experience in the US health insurance or payer domain:claims, eligibility, enrollment, provider, or member data, with HIPAA-awaredata handling practices
  • Exposure to healthcare data standards (X12 EDI, HL7,FHIR)
  • Experience with Power BI or other BI/reporting toolsconsuming the data pipelines you build
  • Experience with additional AWS data services: EMR,Kinesis, or Redshift Spectrum
  • Experience with modern orchestration tools (e.g.,Apache Airflow) as an alternative or complement to SSIS
  • Relevant certifications: AWS Certified DataEngineer/Analytics Specialty, Microsoft SQL Server certifications
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Sr. Data Engineer (Consultant)
Sr. Data Engineer (Consultant)

Minfy • Chennai District

On-site
INR 1,800,000 - 2,800,000
Sr. Data Engineer
Sr. Data Engineer

Minfy Technologies • Gurugram District

On-site
INR 1,800,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

AagatiServe Pvt Ltd • Delhi

On-site
INR 1,800,000 - 2,400,000
Lead AWS Data Engineer
Lead AWS Data Engineer

Weekday (YC W21) • Bengaluru

On-site
INR 1,000,000 - 1,500,000
AWS Data Engineer
AWS Data Engineer

Objectways • Bengaluru

On-site
INR 1,500,000 - 2,200,000
Aws Data Engineer
Aws Data Engineer

Tata Consultancy Services • India

On-site
INR 900,000 - 1,500,000
Data Engineer (AWS)
Data Engineer (AWS)

Weekday (YC W21) • Gurugram District

On-site
INR 1,500,000 - 2,500,000
Data Engineer
Data Engineer

Minfy • India

On-site
INR 1,500,000 - 2,300,000
Senior Software Engineer – AWS Data Pipeline
Senior Software Engineer – AWS Data Pipeline

Jobtailor • Bengaluru

On-site
INR 1,500,000 - 2,100,000
Data Engineer
Data Engineer

Acldigital • Pune District

On-site
INR 1,000,000 - 1,500,000