Senior Data Engineer - AI Infrastructure & Pipelines

Placements24; Queenstown; Vor Ort; NZD 140.000 - 190.000; Vollzeit

Benefits dieser Stelle

Competitive salary

Health, dental, and vision insurance

Paid time off and holidays

Professional development and training

Collaborative and innovative work env.

Retirement savings plan

Zusammenfassung

Placements24 is seeking a Senior Data Engineer in Queenstown to design and maintain scalable data pipelines, data warehouses, and data lakes powering AI initiatives. You will work closely with data scientists and AI engineers to ensure reliable data delivery for model training and deployment.

The role emphasizes robust ETL/ELT processes, data governance, security, and cost-efficient infrastructure, with opportunities for professional growth within a collaborative team.

Qualifikationen

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of professional experience in data engineering.
• Proven experience building and managing data pipelines using Apache Spark, Kafka, Airflow.
• Strong proficiency in SQL and NoSQL databases.
• Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including their data services.
• Experience with data warehousing concepts and technologies (e.g., Redshift, Snowflake, BigQuery).
• Familiarity with big data technologies and distributed systems.
• Understanding of AI/ML concepts and data requirements is highly desirable.
• Excellent programming skills in Python or Scala.
• Strong analytical and problem-solving skills.

Aufgaben

• Design, build, and maintain scalable data pipelines for ingesting, transforming, and processing large volumes of data.
• Develop and manage data warehouses, data lakes, and other data storage solutions.
• Implement ETL/ELT processes to ensure data quality, consistency, and availability.
• Optimize data infrastructure for performance, cost-efficiency, and scalability to support AI/ML workloads.
• Collaborate with Data Scientists and AI Engineers to understand their data requirements and provide necessary data solutions.
• Implement data governance, security, and compliance best practices.
• Automate data infrastructure operations and monitoring.
• Troubleshoot and resolve data-related issues promptly.
• Stay current with emerging technologies in data engineering and cloud platforms.

Kenntnisse

Apache Spark

Kafka

Airflow

SQL

NoSQL

Python

Scala

AWS

Azure

GCP

Data warehousing

Data governance

ETL/ELT

Ausbildung

Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field

Tools

Redshift

Snowflake

BigQuery

Spark

Kafka

Airflow

Python

Jobbeschreibung

Placements24 is seeking a Senior Data Engineer in Queenstown to design and maintain scalable data pipelines, data warehouses, and data lakes powering AI initiatives. You will work closely with data scientists and AI engineers to ensure reliable data delivery for model training and deployment.

The role emphasizes robust ETL/ELT processes, data governance, security, and cost-efficient infrastructure, with opportunities for professional growth within a collaborative team.