Data Pipeline Architect - Spark, Airflow & Cloud Mastery

Kula Example; New York (NY); Sur place; USD 140 000 - 190 000; Plein temps

Résumé du poste

Kula Example is seeking a Data Pipeline Architect to design and implement scalable ETL/ELT pipelines supporting analytics and ML workloads. You will drive standardized data modeling and governance while collaborating with cross-functional teams to deliver reliable data solutions.

You will mentor engineers, develop documentation, and stay current with evolving data engineering technologies to keep the organization competitive and innovative.

Qualifications

• 5+ years of experience in data engineering.
• Proven ability to design scalable ETL/ELT pipelines.
• Strong SQL and Python skills.
• Experience with Spark, Airflow, Kafka, and cloud platforms (AWS/GCP).
• Experience with data governance, modeling standards, and reliability practices.

Responsabilités

• Design and implement end-to-end data pipelines for batch and real-time streaming.
• Define and enforce standardized data modeling standards and governance policies.
• Collaborate with cross-functional teams to identify business requirements and design data solutions.
• Mentor junior engineers and drive best practices in data reliability.
• Develop and maintain technical documentation.
• Stay up-to-date with emerging technologies and trends in data engineering.

Connaissances

SQL

Python

Data governance

Data modeling

Data reliability

Big data concepts

Communication

Cross-functional collaboration

Outils

Apache Spark

Airflow

Kafka

AWS

GCP

Description du poste

Kula Example is seeking a Data Pipeline Architect to design and implement scalable ETL/ELT pipelines supporting analytics and ML workloads. You will drive standardized data modeling and governance while collaborating with cross-functional teams to deliver reliable data solutions.

You will mentor engineers, develop documentation, and stay current with evolving data engineering technologies to keep the organization competitive and innovative.