Data Platform Engineer — Scale Pipelines & Security

OpenKrill; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Doodle is seeking a Data Infrastructure Engineer to design, build and run scalable data platforms. You will work with SRE, product, engineering, analytics and security teams to simplify data access and reliability.

Responsibilities include streaming with Kafka, batch workflows with Airflow and cost-efficient Redshift management, plus implementing robust security controls and self-service tooling for analytics teams.

Qualifications

• 2+ years in data platform engineering or scalable software systems.
• Kafka and Avro: schema design, serialization and evolution.
• Redshift and production Airflow: data modeling and performance tuning.
• Cloud and DevOps: CI/CD, infrastructure as code and Kubernetes, plus data lakes and open table formats.
• Reliability and security: observability, incident response and debugging pipeline failures, with a security-conscious approach to data access, privacy and secrets.
• Clear communication with both technical and non-technical stakeholders.
• dbt: experience with it is a plus.

Responsibilities

• Build the platform: design, build and operate scalable infrastructure for data ingestion, transformation, storage and serving.
• Run infrastructure as code: manage secure, reproducible cloud environments for development, testing and production, with sensible cost controls.
• Keep it reliable and secure: own SLOs, runbooks and alerts for critical data systems. Protect sensitive data through access controls, encryption, secrets management and retention policies.
• Fix problems at the root: investigate incidents, lead root-cause analysis and implement preventative improvements.
• Make data easy to use: improve discoverability through cataloging, lineage, ownership and quality testing, and build documentation, tooling and self-service workflows so analytics and engineering teams can work independently.

Skills

Data platform experience

Kafka & Avro

Redshift & Airflow

Cloud & DevOps

Reliability & security

Communication

dbt

Tools

Kubernetes

Job description

Doodle is seeking a Data Infrastructure Engineer to design, build and run scalable data platforms. You will work with SRE, product, engineering, analytics and security teams to simplify data access and reliability.

Responsibilities include streaming with Kafka, batch workflows with Airflow and cost-efficient Redshift management, plus implementing robust security controls and self-service tooling for analytics teams.