Data Platform Engineer: Real-Time Pipelines & Lakehouse

Baxter Planning Systems, Inc.; United States; Remote; USD 62,000 - 73,000; Full time

Benefits offered by this job

Health insurance

Gym membership

Learning opportunities

Flexible benefits

Team events

Office snacks

Job summary

Baxter Planning is seeking a Data Engineer to build and evolve our data lake platform using AWS and Python, delivering production-grade data pipelines and BI-ready datasets. You will design data models, ensure data quality, and support near-real-time ingestion for analytics.

You will collaborate with engineers and stakeholders on architecture, CI/CD, and IaC, applying best practices. 4+ years of experience and strong AWS skills are required; competitive benefits accompany the role.

Qualifications

• 4+ years building and operating production data pipelines.
• Strong Python programming skills.
• Strong AWS across services (S3, Glue, Athena, Redshift, etc.).
• Experience with lakehouse tables and star-schema data modelling.

Responsibilities

• Build the data-serving layer: curated datasets, marts, and product-ready tables.
• Develop incremental / micro-batch pipelines and near-real-time ingestion (DMS).
• Design BI-friendly data models (star schema) and manage schemas.
• Build ETL/ELT in Python (Polars) and query via Athena/Redshift.
• Implement data quality + observability (freshness, completeness, duplicates, schema drift).
• Orchestrate with Airflow and AWS Step Functions.
• Contribute to CI/CD, IaC, architecture discussions, and best practices.

Skills

Python programming

Data pipelines

Data modeling

Async/concurrency

Tools

S3

Glue

Athena

Redshift

Lake Formation

CloudWatch

DMS

Lambda

Step Functions

SQS/SNS

ECS

DynamoDB

CloudFormation

Job description

Baxter Planning is seeking a Data Engineer to build and evolve our data lake platform using AWS and Python, delivering production-grade data pipelines and BI-ready datasets. You will design data models, ensure data quality, and support near-real-time ingestion for analytics.

You will collaborate with engineers and stakeholders on architecture, CI/CD, and IaC, applying best practices. 4+ years of experience and strong AWS skills are required; competitive benefits accompany the role.