Senior Data Engineer: Python, AWS & ML Pipelines

Jobgether SRL; New Zealand; On-site; NZD 120,000 - 170,000; Full time

Benefits offered by this job

Collegial working environment

Flexible working arrangements

Ongoing training and mentoring

Career growth opportunities

Travel possibility

Job summary

Lever, Inc. in New Zealand is seeking a Senior Data Engineer to build and operate large-scale data and machine learning pipelines in production.

The role focuses on Python, AWS, ETL, workflow orchestration, and scalable ML infrastructure, and involves collaborating with Data Scientists and ML Engineers to productionize forecasting solutions. You will work within distributed Agile teams to improve reliability, performance, and observability of critical data pipelines while contributing to

Qualifications

• Strong professional experience with Python in data engineering and production systems.
• Proven experience building and maintaining production data/ML pipelines.
• Hands-on Apache Airflow for workflow orchestration.
• Practical experience with AWS Glue and AWS Step Functions.
• Experience deploying ML models with AWS SageMaker.
• Strong knowledge of AWS cloud services and scale-oriented production environments.
• Experience collaborating with Data Scientists, ML Engineers, and stakeholders.

Responsibilities

• Build, maintain, and improve production-grade data and ML pipelines for forecasting and data-driven decisions.
• Develop ETL and data-processing workflows using Python, ensuring scalability and reliability.
• Design and orchestrate workflows with Apache Airflow and AWS Step Functions.
• Use AWS Glue for processing, transformation, and pipeline execution.
• Support deployment and operationalization of ML models using AWS SageMaker.
• Collaborate with Data Scientists and ML Engineers to productionize solutions.
• Monitor pipeline health, troubleshoot issues, and improve reliability and performance.
• Contribute to architectural decisions across the data platform and ML infra.
• Work with distributed, cross-functional Agile teams to improve engineering practices.

Skills

Python

ETL

Airflow

SageMaker

AWS

ML pipelines

Data pipelines

Cloud

Troubleshooting

English communication

Tools

AWS Glue

AWS Step Functions

GCP

SageMaker

Job description

Lever, Inc. in New Zealand is seeking a Senior Data Engineer to build and operate large-scale data and machine learning pipelines in production.

The role focuses on Python, AWS, ETL, workflow orchestration, and scalable ML infrastructure, and involves collaborating with Data Scientists and ML Engineers to productionize forecasting solutions. You will work within distributed Agile teams to improve reliability, performance, and observability of critical data pipelines while contributing to