Lead Data Platform Engineer

Octus; United States; Remote; USD 170,000 - 250,000; Full time

Benefits offered by this job

Health benefits

401k / pension

PTO

Parental leave

Gym subsidies

Educational reimbursements

Recognition programs

Job summary

Octus is seeking a Principal Data Engineer to design, build, and lead scalable data ingestion and transformation pipelines. This is a hands-on IC role that encompasses mentoring, architecture guidance, and providing technical leadership across the data platform.

You will collaborate with data analysts, scientists, and backend engineers to ensure data quality and reliability using AWS services, Airflow, Terraform, and modern data tools.

Qualifications

• Strong foundation in software engineering principles, including SOLID and scalability.
• Expert proficiency in Python for data pipelines and automation.

Responsibilities

• Lead the overarching technical strategy for the data platform and align with business goals.
• Design and develop data ingestion and transformation pipelines across diverse data sources.
• Mentor senior engineers and guide architecture and implementation decisions.

Skills

Python

SQL

AWS

Terraform

CI/CD

Data pipelines

Leadership

Airflow

Docker

8+ years

Tools

MWAA (Airflow)

Airflow

Lambda

ECS

SQS

Glue

S3

Redshift

Snowflake

Databricks

Terraform

Docker

Job description

Octus is seeking a Principal Data Engineer to design, build, and lead scalable data ingestion and transformation pipelines. This is a hands-on IC role that encompasses mentoring, architecture guidance, and providing technical leadership across the data platform.

You will collaborate with data analysts, scientists, and backend engineers to ensure data quality and reliability using AWS services, Airflow, Terraform, and modern data tools.