Senior Data Engineer — ETL Pipelines, Python & Azure

CSpring; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

CSpring helps clients unlock the power of data through strategy, engineering, and analytics. The Data Engineer role drives end-to-end ETL pipelines and scalable processing across Azure, Databricks, and Snowflake, enabling Medicaid analytics and federal reporting initiatives.

The position emphasizes collaboration with analysts, QA, and reporting teams, plus participation in cloud migrations and production support in a fast-paced, mission-driven consulting environment.

Qualifications

• 5+ years of data engineering experience with a focus on enterprise data warehousing.
• 5+ years of hands-on ETL development using Informatica PowerCenter, Teradata, Azure Data Factory, or similar tools.
• 5+ years of Python development for data engineering and automation.
• 5+ years of Teradata experience, including Teradata loader utilities.
• 3+ years of experience with Spark-based processing frameworks (Databricks or equivalent).
• Solid SQL expertise and experience with relational databases (such as Snowflake, Oracle, SQL Server).
• 3+ years of experience with Snowflake using SnowSQL and Snowpark (Python).
• Experience with source control and DevOps practices (Azure DevOps, GitHub, CI/CD).
• Proven analytical, problem-solving, and troubleshooting skills.
• Periodic travel may be required.

Responsibilities

• Design, develop, and maintain enterprise ETL pipelines using Azure Data Factory (ADF), Informatica PowerCenter, and Python frameworks.
• Build and optimize data processing solutions using Python, Spark, and Databricks.
• Write and optimize SQL and stored procedures across Snowflake, Oracle, SQL Server.
• Follow data engineering best practices for performance, reliability, reusability, and security.
• Support Medicaid analytics and federal reporting initiatives (e.g., T-MSIS, PERM, MARS, Quality of Care).
• Develop robust data validation, reconciliation, and audit-traceable pipelines.
• Collaborate with analysts, QA, and reporting teams to ensure data quality and timeliness.
• Participate in cloud migration and modernization within Azure-based architectures.
• Support production operations, incident resolution, and root cause analysis.
• Participate in code reviews, source control, and CI/CD using Azure DevOps and GitHub.

Skills

Data warehousing

ETL development

Python

SQL

Azure Data Factory

Informatica PowerCenter

Teradata

Spark

Snowflake

DevOps

Problem solving

Education

Bachelor’s degree (CS/Engineering/Analytics)

Azure certifications in data engineering/analytics

Tools

Databricks

GitHub

SnowSQL

Snowpark (Python)

CI/CD

Job description

CSpring helps clients unlock the power of data through strategy, engineering, and analytics. The Data Engineer role drives end-to-end ETL pipelines and scalable processing across Azure, Databricks, and Snowflake, enabling Medicaid analytics and federal reporting initiatives.

The position emphasizes collaboration with analysts, QA, and reporting teams, plus participation in cloud migrations and production support in a fast-paced, mission-driven consulting environment.