Lead Data Engineer: Real-Time Pipelines & Spark/Kafka

Mode.Inc; United States; Remoto; USD 140.000 - 210.000; Tempo pieno

Descrizione del lavoro

Mode is seeking a Senior Data Platform Engineer to architect and lead large-scale data pipelines and streaming systems. You will own live production data platforms with emphasis on uptime, reliability, and security, collaborating with infrastructure, engineering, product, data science, and business teams.

You should have 5+ years building live data systems, strong SQL, and hands-on experience with Spark, Kafka, AWS data services, Terraform, and languages like Python/Scala/Java.

Competenze

• 5+ years of experience designing and operating live production data systems.
• Expert-level SQL skills.
• Hands-on experience with Spark and Kafka.
• Experience with AWS data services.
• Terraform for infrastructure as code.
• Proficiency in Python, Scala, or Java.
• Strong understanding of data modeling and ETL/ELT design patterns.

Mansioni

• Architect and lead the development of large-scale data pipelines and streaming systems
• Design robust solutions for real-time and batch processing
• Own data systems in live production environments focusing on uptime and reliability
• Partner with infrastructure and engineering teams to ensure security and compliance
• Collaborate with product engineers, data scientists, and business teams to deliver high-impact solutions
• Mentor other engineers and raise technical excellence standards
• Evaluate new tools and technologies to improve the data platform

Conoscenze

SQL

Data modeling

ETL/ELT design

Python/Scala/Java

Mentoring

Live production systems

Strumenti

Spark

Kafka

Terraform

AWS

Python

Descrizione del lavoro

Mode is seeking a Senior Data Platform Engineer to architect and lead large-scale data pipelines and streaming systems. You will own live production data platforms with emphasis on uptime, reliability, and security, collaborating with infrastructure, engineering, product, data science, and business teams.

You should have 5+ years building live data systems, strong SQL, and hands-on experience with Spark, Kafka, AWS data services, Terraform, and languages like Python/Scala/Java.