Senior Data Engineer: Real-Time Ingest & Data Platform

Alimentiv; United States; Remote; USD 110,000 - 160,000; Full time

Job summary

Alimentiv is seeking a data engineer to architect end-to-end data solutions using Databricks, PySpark, and Azure Data Factory. You will maintain pipelines across bronze, silver, and gold layers and implement API-based, real-time ingestion with automated CI/CD pipelines.

You will mentor junior engineers, lead technical design reviews, and partner with business stakeholders to align data engineering with organizational goals.

Qualifications

• Architect end-to-end data solutions using Databricks, PySpark, and Azure Data Factory.
• Maintain data pipelines and models across bronze, silver, and gold layers.
• Implement API-based and real-time ingestion with automated CI/CD pipelines.
• Build reusable pipeline templates and automated testing frameworks.
• Mentor junior engineers and lead technical design reviews.
• Partner with business stakeholders to align data engineering with goals.

Responsibilities

• Architect end-to-end data solutions using Databricks, PySpark, and Azure Data Factory.
• Maintain data pipelines across bronze to gold layers.
• Implement API-based and real-time ingestion with CI/CD pipelines.
• Mentor junior engineers and lead design reviews.
• Collaborate with stakeholders to align data engineering with business goals.

Skills

PySpark

Databricks

Real-time ingestion

CI/CD pipelines

API ingestion

Data modeling

Mentoring

Technical design reviews

Tools

Azure Data Factory

CI/CD tooling

Job description

Alimentiv is seeking a data engineer to architect end-to-end data solutions using Databricks, PySpark, and Azure Data Factory. You will maintain pipelines across bronze, silver, and gold layers and implement API-based, real-time ingestion with automated CI/CD pipelines.

You will mentor junior engineers, lead technical design reviews, and partner with business stakeholders to align data engineering with organizational goals.