Senior Data Engineer

Vaco Binary Semantics; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

A leading data engineering company seeks a Senior Data Engineer to design and maintain scalable data pipelines. The ideal candidate will collaborate closely with teams to implement data solutions, enforce compliance standards, and mentor junior engineers, leveraging strong skills in Python and AWS data services.

Qualifications

• 5+ years of hands-on experience in building production-grade data pipelines.
• Experience with workflow orchestration tools like Dagster and DBT.
• Familiarity with AWS services such as Athena, Glue, and CloudWatch.

Responsibilities

• Design, implement, and optimize ETL/ELT pipelines using Python, Dagster, DBT.
• Monitor pipeline health and troubleshoot data incidents.
• Conduct code reviews and mentor junior data engineers.

Skills

Python

SQL

Data Pipeline Management

ETL/ELT Design

Data Quality Assurance

Communication

Education

Bachelor's or Master's in Computer Science

Tools

AWS Glue

PostgreSQL

Dagster

DBT

GitHub

Job description

Job Title: Senior Data Engineer

Location:Remote

Job Type:Fulltime

YoE:7 to 10 years relevant experience

Shift:6.30pm to 2.30am IST

Job Purpose:

The Senior Data Engineer designs, builds, and maintains scalable data pipelines and architectures to support the Denials AI workflow under the guidance of the Team Lead, Data Management. This role ensures data is reliable, compliant with HIPAA, and optimized.

Duties & Responsibilities:

• Collaborate with the Team Lead and crossfunctional teams to gather and refine data requirements for Denials AI solutions.
• Design, implement, and optimize ETL/ELT pipelines using Python, Dagster, DBT, and AWS data services (Athena, Glue, SQS).
• Develop and maintain data models in PostgreSQL; write efficient SQL for querying and performance tuning.
• Monitor pipeline health and performance; troubleshoot data incidents and implement preventive measures.
• Enforce data quality and governance standards, including HIPAA compliance for PHI handling.
• Conduct code reviews, share best practices, and mentor junior data engineers.
• Automate deployment and monitoring tasks using infrastructure-as-code and AWS CloudWatch metrics and alarms.
• Document data workflows, schemas, and operational runbooks to support team knowledge transfer.

Qualifications:

• Bachelors or Masters degree in Computer Science, Data Engineering, or related field.
• 5+ years of handson experience building and operating productiongrade data pipelines.
• Solid experience with workflow orchestration tools (Dagster) and transformation frameworks (DBT) or other similar tools such (Microsoft SSIS, AWS Glue, Air Flow).
• Strong SQL skills on PostgreSQL for data modeling and query optimization or any other similar technologies (Microsoft SQL Server, Oracle, AWS RDS).
• Working knowledge with AWS data services: Athena, Glue, SQS, SNS, IAM, and CloudWatch.
• Basic proficiency in Python and Python data frameworks (Pandas, PySpark).
• Experience with version control (GitHub) and CI/CD for data projects.
• Familiarity with healthcare data standards and HIPAA compliance.
• Excellent problemsolving skills, attention to detail, and ability to work independently.
• Strong communication skills, with experience mentoring or leading small technical efforts.