Senior Data Engineer: Real-Time Azure Pipelines & FinOps

ADM; Erlanger (KY); Hybrid; USD 153,000 - 163,000; Full time

Benefits offered by this job

Medical benefits

Dental/Vision

401(k) with match

Paid time off

Job summary

ADM is seeking a Sr. Data Engineer in Erlanger, KY to design, build, and maintain data pipelines supporting reporting, analytics, and data science.

You will advance DataOps/MLOps practices and design fault-tolerant pipelines that optimize performance and cost across Azure ecosystems. The role requires deep experience with Azure, PySpark, Databricks, SAP Datasphere, and Power BI, plus collaboration with end users and a delivery team.

Qualifications

• Bachelor's degree or foreign equivalent in a related field and seven years of experience in data engineering.
• Experience with cloud-based data systems including Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, PySpark, SAP Datasphere, and Power BI.
• CI/CD experience with Azure DevOps and GitHub.
• Experience designing real-time and batch data pipelines with CDC support across heterogeneous systems.
• Experience building scalable ETL/ELT frameworks using REST/Graph APIs, event-based ingestion, and cross-platform data connectivity.

Responsibilities

• Design, build, refactor, and maintain data pipelines to meet reporting, analysis, and data science needs.
• Contribute to DataOps and MLOps standards and improve data system performance.
• Integrate real-time and event-driven workflows, orchestration across enterprise systems, and secure APIs.
• Lead a delivery team and partner with business users for reliable cost-to-serve visibility.
• Deliver analytics using Power BI on nutrition product volumes, costs, margins, and spend trends.

Skills

Data engineering

DataOps

MLOps

API design

Cost optimization

Education

Bachelor's degree or foreign equivalent in Engineering/CS/related field

Tools

Microsoft Azure

SQL

Azure Data Factory

Azure Synapse

Databricks

Python

PySpark

SAP Datasphere

Power BI

Qlik Replicate

Qlik Compose

Job description

ADM is seeking a Sr. Data Engineer in Erlanger, KY to design, build, and maintain data pipelines supporting reporting, analytics, and data science.

You will advance DataOps/MLOps practices and design fault-tolerant pipelines that optimize performance and cost across Azure ecosystems. The role requires deep experience with Azure, PySpark, Databricks, SAP Datasphere, and Power BI, plus collaboration with end users and a delivery team.