Senior Data Engineer – Data Platform

OEC; Town of Poland (NY); Hybrid; USD 120,000 - 160,000; Full time

Job summary

OEC is seeking a Senior Data Platform Engineer to contribute to building cloud-native data infrastructure on AWS. You'll be key in shaping a platform for data producers and consumers, ensuring self-service capabilities and observability.

The ideal candidate will have over 5 years of relevant experience and be proficient in AWS services, Python, and Terraform, with a strong emphasis on data modeling and ETL practices.

If you're passionate about creating robust data solutions, we invite you to apply!

Qualifications

• 5+ years of experience as a Data Engineer or Platform Engineer.
• Strong focus on AWS services and production-grade data platforms.
• Proficient in Python for pipeline development and automation.

Responsibilities

• Contribute to the design and implementation of reusable ETL pipeline templates.
• Help build reusable, self-service platform components for data producers and consumers.
• Implement data lineage tracking and observability tooling.

Skills

AWS services

ETL best practices

Python

Data modeling

Event-driven architectures

Data ingestion mechanisms (APIs, SFTP, message queues)

Terraform

Streaming platforms (Kafka, AWS Kinesis)

Tools

Jenkins

GitHub Actions

Soda Core

Datadog

Job description

We’re looking for a Senior Data Platform Engineer to join the team building our cloud-native data infrastructure on AWS. You will be an active contributor to the design and evolution of a platform that serves both data producers and consumers, providing reusable, self-service capabilities for ingestion, curation, aggregation, governance, access interfaces, and observability. This is a platform engineering role: the solutions you build are generic, shared infrastructure, not one-off pipelines.

Responsibilities

• Contribute to the design and implementation of reusable ETL pipeline templates, scalable, serverless, and event-driven for processing and transforming large datasets from diverse sources
• Help build reusable, self-service platform components that abstract infrastructure complexity for data producers and consumers.
• Define and evolve standards of data contracts and pipeline configuration schemas that standardize how teams onboard to the platform.
• Implement data lineage tracking, and observability tooling to give producers and operators full visibility into platform health.
• Implement and maintain CI/CD pipelines and infrastructure as code using Terraform.
• Contribute to the technical direction of future platform capabilities, including streaming integrations, consumption interfaces, data democratization, and AI-assisted features such as failure remediation and automated contract suggestions.

You Will Be a Great Fit If You…

• Have 5+ years of professional experience as a Data Engineer or Platform Engineer with strong focus on AWS services
• Have a proven track record of contributing to production-grade data platforms or complex data infrastructure.
• Understand data modeling and have a solid grasp of ETL best practices.
• Are proficient in Python for pipeline development, automation, and scripting.
• Are familiar with data ingestion mechanisms such as APIs, SFTP, or message queues.
• Have experience building event-driven architectures and scalable, cloud-native data pipelines.
• Have hands-on experience with streaming platforms such as Kafka or AWS Kinesis.
• Implement and maintain data quality rules using Soda Core, integrate quality check results with the DataZone catalog, and define the platform's approach to quality failure handling within the pipeline execution flow.
• Are comfortable building and managing infrastructure using Terraform.
• Use observability tools to monitor logs, performance, and system health.
• Can communicate technical concepts clearly and contribute to cross-team alignment.
• Cloud AWS: S3, Iceberg, DynamoDB, RDS, Glue, Athena, Lambda, Step Functions, EventBridge, Transfer Family, SageMaker, Lake Formation, DataZone, KMS, IAM Identity Center, SES
• Languages: Python, SQL
• Infrastructure as Code: Terraform
• CI/CD: Jenkins, GitHub Actions

Nice to Have

• Experience with Datadog for cloud observability and alerting.
• Familiarity with AI-assisted developer tools such as Claude Code or similar.

If you have a passion for building robust, reusable data infrastructure and want to help shape a platform that will power data-driven products across the organization, we’d love to hear from you!