Data Platform Engineer: Orchestration & Cloud Pipelines

Optomi; Naperville (IL); On-site; USD 130,000 - 170,000; Full time

Job summary

Optomi in partnership with a leader in the U.S. home warranty and home repair service industry is seeking a Data Platform Engineer to design, build, and productionize a workflow orchestration platform that supports marketing operations.

You will work with data engineers, frontend developers, and cloud engineers to deliver an orchestration engine coordinating campaign execution across multiple systems using Python, Prefect, AWS, and Snowflake.

Qualifications

• Strong commercial experience developing applications in Python.
• Experience building and supporting production workflow orchestration platforms.
• Hands-on experience with Prefect or a comparable orchestration framework.
• Infrastructure as Code (Terraform is preferable).
• Strong SQL skills and experience working with Snowflake or another modern cloud data warehouse.
• Experience deploying and operating applications in AWS.
• Experience building and maintaining CI/CD pipelines.
• Strong understanding of monitoring, logging and observability.
• Experience troubleshooting production systems and data pipelines.
• Experience integrating applications through APIs and distributed services.
• Strong software engineering practices, including testing, version control and code reviews.
• A practical approach to security, including secrets management, least-privilege access and environment separation.

Responsibilities

• Design, develop, and maintain workflow orchestration using Python and Prefect.
• Integrate with Snowflake, REST APIs, middleware, and internal applications.
• Implement monitoring, logging, and alerting for production workloads.
• Work closely with a cross-functional team to deliver end-to-end solutions.

Skills

Python development

Production workflow orchestration

CI/CD pipelines

Monitoring and observability

API integration

Security basics

Tools

Prefect

Terraform

Snowflake

AWS

REST APIs

Job description

Optomi in partnership with a leader in the U.S. home warranty and home repair service industry is seeking a Data Platform Engineer to design, build, and productionize a workflow orchestration platform that supports marketing operations.

You will work with data engineers, frontend developers, and cloud engineers to deliver an orchestration engine coordinating campaign execution across multiple systems using Python, Prefect, AWS, and Snowflake.