Senior Data Engineer: Python, AWS & ML Pipelines

Lever, Inc.; Ireland; On-site; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Collegial environment

Agile culture

Continuous learning

Career growth

Business travel

Flexible working

Healthcare benefits

Job summary

Lever, Inc. is seeking a Senior Data Engineer in Ireland to build and operate large-scale data and ML pipelines in production.

You will work across data engineering, cloud infrastructure, and ML operations to turn models into reliable production workflows, focusing on Python, AWS, ETL, and scalable ML infrastructure. You will collaborate with Data Scientists and ML Engineers to productionize forecasting solutions, improve reliability, and drive observable data platforms in distributed Agile

Qualifications

• Strong experience with Python for data engineering and production systems.
• Proven track record building and maintaining data or ML pipelines in production.
• Hands-on experience with Apache Airflow for workflow orchestration.
• Practical experience with AWS Step Functions and AWS Glue.
• Experience deploying and supporting machine learning models using AWS SageMaker.
• Strong hands-on experience with AWS cloud services and production environments.
• Experience working at scale with reliability and performance considerations.
• Excellent written and verbal English communication skills.
• Comfortable working independently and in distributed, cross-functional teams.

Responsibilities

• Build, maintain, and improve production-grade data and ML pipelines for forecasting and data-driven decision-making.
• Develop ETL and data-processing workflows using Python, ensuring scalability and reliability.
• Design and orchestrate workflows with Apache Airflow and AWS Step Functions.
• Leverage AWS Glue for data processing, transformation, and pipeline execution.
• Support deployment and operationalization of ML models using AWS SageMaker.
• Collaborate with Data Scientists and ML Engineers to productionize models.
• Monitor pipeline health, troubleshoot issues, and improve reliability and performance.
• Contribute to architectural decisions for data platform and ML infrastructure.
• Work with distributed Agile teams to refine engineering practices.

Skills

Python

Data pipelines

Apache Airflow

AWS Step Functions

AWS Glue

AWS SageMaker

AWS Cloud

Reliability

Collaboration

English proficiency

GCP knowledge

Observability tools

Tools

Airflow

SageMaker

Glue

Job description

Lever, Inc. is seeking a Senior Data Engineer in Ireland to build and operate large-scale data and ML pipelines in production.

You will work across data engineering, cloud infrastructure, and ML operations to turn models into reliable production workflows, focusing on Python, AWS, ETL, and scalable ML infrastructure. You will collaborate with Data Scientists and ML Engineers to productionize forecasting solutions, improve reliability, and drive observable data platforms in distributed Agile