Azure Data Engineer - ETL Pipelines & Compliance

Abacus; United States; On-site; USD 90,000 - 130,000; Full time

Job summary

Abacus is seeking a Data Engineer to develop, maintain, and support data pipelines using Python and SQL Server within an Azure-based data platform. You will collaborate with data analysts, software engineers, and DevOps teams to ensure reliable data processing across regulated environments such as healthcare and financial services.

You will build ETL workflows, write T-SQL queries, and contribute to data quality, security, and compliance.

Qualifications

• 1–4 years of professional experience in Data Engineering, Software Engineering, or a related technical role — Required
• Strong hands-on proficiency in Python, including writing functions, handling errors, and debugging code — Required
• Experience working with relational databases, preferably SQL Server — Required
• Strong working knowledge of SQL, including joins, aggregations, subqueries, and basic performance considerations — Required
• Exposure to integrating or consuming data from RESTful APIs or external data sources — Required
• Familiarity with Git or similar version control systems — Required
• Strong analytical and problem-solving skills with the ability to learn quickly — Required

Responsibilities

• Develop and maintain ETL pipelines using Python and SQL Server for data ingestion, transformation, and integration from diverse sources.
• Write, test, and debug Python code for data processing and automation.
• Create and maintain T-SQL queries, views, and stored procedures to support business logic and reporting.
• Assist in building and operating data workflows using Azure Data Factory, Azure SQL, and Azure Blob Storage.
• Monitor data pipelines, troubleshoot data quality issues, and resolve pipeline failures.
• Follow data quality, security, and compliance procedures in regulated environments.
• Collaborate with data analysts, software engineers, and DevOps teams to understand data requirements.
• Participate in code reviews and continuously improve engineering practices.
• Create and maintain clear documentation for data pipelines, logic, and operational processes.

Skills

Python

SQL Server

Relational databases

Git

Analytical thinking

Problem solving

Education

Bachelor’s Degree — Preferred

Tools

Azure Data Factory

Azure SQL

Azure Synapse

Azure Functions

T-SQL

RESTful APIs

Job description

Abacus is seeking a Data Engineer to develop, maintain, and support data pipelines using Python and SQL Server within an Azure-based data platform. You will collaborate with data analysts, software engineers, and DevOps teams to ensure reliable data processing across regulated environments such as healthcare and financial services.

You will build ETL workflows, write T-SQL queries, and contribute to data quality, security, and compliance.