Senior Data Engineer - ETL, Python & Azure Analytics

CSpring; Indianapolis (IN); On-site; USD 120,000 - 180,000; Full time

Job summary

CSpring, a data-focused consulting firm, seeks a senior data engineer to design, build, and optimize enterprise ETL pipelines in Azure Data Factory and Python.

You will work across Snowflake, Oracle, and SQL Server, apply best practices for data quality, security, and scalable processing, and collaborate with analysts and clients.

Join a people-first culture that values curiosity, collaboration, and impact, with opportunities to modernize legacy systems and support Medicaid analytics initiatives.

Qualifications

• 5+ years of data engineering experience with a focus on enterprise data warehousing.
• 5+ years of hands-on ETL development using Informatica PowerCenter, Teradata, Azure Data Factory, or similar tools.
• 5+ years of Python development for data engineering and automation.
• 5+ years of Teradata experience, including Teradata loader utilities.
• 3+ years of experience with Spark-based processing frameworks (Databricks or equivalent).
• Solid SQL expertise and experience with relational databases (such as Snowflake, Oracle, SQL Server).
• 3+ years of experience with Snowflake using SnowSQL and Snowpark (Python).
• Experience with source control and DevOps practices (Azure DevOps, GitHub, CI/CD).
• Proven solid analytical, problem-solving, and troubleshooting skills.
• Periodic travel may be required based on project or customer needs.

Responsibilities

• Design, develop, and maintain enterprise ETL pipelines using Azure Data Factory (ADF), Informatica PowerCenter, and Python-based frameworks.
• Build and optimize scalable data processing solutions using Python, Spark, and Databricks.
• Write and optimize SQL and stored procedures across relational platforms such as Snowflake, Oracle, and SQL Server.
• Follow data engineering best practices for performance, reliability, reusability, and security.
• Support Medicaid analytics and federal reporting initiatives (e.g., T-MSIS, PERM, MARS, Quality of Care).
• Develop robust data validation, reconciliation, and audit-traceable data pipelines.
• Collaborate with analysts, QA, and reporting teams to ensure data quality, accuracy, and timeliness.
• Participate in cloud migration and modernization initiatives within Azure-based architectures.
• Support production operations, incident resolution, and root cause analysis.
• Participate in code reviews, source control, and CI/CD processes using Azure DevOps and GitHub.

Skills

Data warehousing

ETL development

Python development

Teradata

Spark/Databricks

SQL

Snowflake

SnowSQL

Azure Data Factory

Informatica PowerCenter

Azure DevOps

GitHub

CI/CD

Education

Bachelor’s degree in Computer Science, Engineering, Analytics, or related field

Tools

Azure Data Factory

Informatica PowerCenter

Teradata

Snowflake

SnowSQL

Spark/Databricks

Azure DevOps

GitHub

Job description

CSpring, a data-focused consulting firm, seeks a senior data engineer to design, build, and optimize enterprise ETL pipelines in Azure Data Factory and Python.

You will work across Snowflake, Oracle, and SQL Server, apply best practices for data quality, security, and scalable processing, and collaborate with analysts and clients.

Join a people-first culture that values curiosity, collaboration, and impact, with opportunities to modernize legacy systems and support Medicaid analytics initiatives.