Onsite Senior Data Engineer: Cloud Pipelines & AI

Casey; Ankeny (IA); On-site; USD 102,000 - 141,000; Full time

Job summary

Casey’s is seeking a Senior Data Engineer to design, build, and optimize data ingestion and transformation pipelines for analytics. You will collaborate with Data Engineering, Analytics, and Technology teams to deliver scalable cloud-based solutions using Databricks, PySpark, and SQL.

You will own data models, CI/CD pipelines, and performance-cost optimization while ensuring data quality across APIs, streaming, and batch sources on-site in Ankeny, IA.

Qualifications

• Bachelor's degree in CS/Analytics/Engineering or equivalent years of related work experience.
• 5+ years designing and developing enterprise data solutions and ETL.
• Strong Python, PySpark and SQL proficiency.
• Experience with Databricks or Snowflake.
• Experience with Azure Data Factory, ADLS Gen2, Key Vault, and Functions.

Responsibilities

• Lead complex data engineering initiatives and refine technical solutions as business needs evolve.
• Mentor other engineers on data engineering best practices, data modeling, and pipeline development.
• Experience using AI to accelerate data engineering practices and enforce standards.
• Tests data pipelines and models to ensure data accuracy and pipeline resilience.
• Ingests data from API, streaming, event, and batch sources.
• Evaluate technology landscape and suggest continuous improvements to the data platform.
• Provide on-call support for data platform issues.
• Builds and maintains CI/CD pipelines in GitHub.
• Serve as escalation point for Data Engineering team on data/platform issues.

Skills

Python

PySpark

SQL

Data modeling

Education

Bachelor's degree in CS/Analytics/Engineering

Tools

Databricks

Snowflake

Azure Data Factory

Azure

Job description

Casey’s is seeking a Senior Data Engineer to design, build, and optimize data ingestion and transformation pipelines for analytics. You will collaborate with Data Engineering, Analytics, and Technology teams to deliver scalable cloud-based solutions using Databricks, PySpark, and SQL.

You will own data models, CI/CD pipelines, and performance-cost optimization while ensuring data quality across APIs, streaming, and batch sources on-site in Ankeny, IA.