Data Platform Engineer: Build Scalable Data Infra

OpenKrill; United States; Remote; USD 120,000 - 190,000; Full time

Job summary

Doodle is seeking a Data Infrastructure Engineer to design, build and operate scalable data platforms that power analytics and product teams. You’ll work with SRE, data engineering and security to keep data reliable, secure and easy to use.

Key focus includes streaming with Kafka and Avro, batch workflows in Airflow, and optimizing Redshift for performance and cost. You’ll own data cataloging, lineage and documentation to empower analytics teams.

Qualifications

• 2+ years in data platform engineering or scalable software systems.
• Kafka and Avro: schema design, serialization and evolution.
• Redshift and production Airflow: data modeling and performance tuning.
• Cloud and DevOps: CI/CD, infrastructure as code and Kubernetes, plus data lakes and open table formats.
• Reliability and security: observability, incident response and debugging pipeline failures, with a security-conscious approach to data access, privacy and secrets.
• Clear communication with both technical and non-technical stakeholders.
• dbt: experience with it is a plus.

Responsibilities

• Build the platform: design, build and operate scalable infrastructure for data ingestion, transformation, storage and serving. Run streaming flows with Kafka and Avro, orchestrate batch workflows in Airflow, and keep Redshift performant, well-modeled and cost-effective.
• Run infrastructure as code: manage secure, reproducible cloud environments for development, testing and production, with sensible cost controls.
• Keep it reliable and secure: own SLOs, runbooks and alerts for critical data systems. Protect sensitive data through access controls, encryption, secrets management and retention policies.
• Fix problems at the root: investigate incidents, lead root-cause analysis and implement preventative improvements.
• Make data easy to use: improve discoverability through cataloging, lineage, ownership and quality testing, and build documentation, tooling and self-service workflows so analytics and engineering teams can work independently.

Skills

Data platform engineering

Kafka

Avro

Redshift

Airflow

Data modeling

Kubernetes

CI/CD

Infrastructure as code

Data lakes

Open table formats

Observability

Security

dbt

Communication

Tools

Kafka

Avro

Redshift

Airflow

Job description

Doodle is seeking a Data Infrastructure Engineer to design, build and operate scalable data platforms that power analytics and product teams. You’ll work with SRE, data engineering and security to keep data reliable, secure and easy to use.

Key focus includes streaming with Kafka and Avro, batch workflows in Airflow, and optimizing Redshift for performance and cost. You’ll own data cataloging, lineage and documentation to empower analytics teams.