Senior AWS Real-Time Data Platform Engineer

IDEXX; Worcester (MA); On-site; USD 110,000 - 130,000; Full time

Benefits offered by this job

Health benefits

Dental benefits

Vision benefits

401k matching (5%)

Job summary

IDEXX in Massachusetts is seeking a Senior Data Engineer to join the IT Data Engineering team. You will build production-grade data systems, streaming ingestion, API-driven data flows, and CI/CD pipelines in a near-real-time environment using AWS services like Kinesis, Lambda, Glue, and S3.

On-site eight times per month in MA; requires 4+ years of experience, Python and shell scripting, REST APIs, and IaC with Terraform/CloudFormation.

Qualifications

• 4+ years building production-grade data systems and services
• Experience designing streaming and batch data pipelines on AWS
• Strong Python skills and shell scripting
• Experience building RESTful APIs and data ingestion APIs
• Infrastructure as Code with Terraform or CloudFormation and CI/CD tooling

Responsibilities

• Build and maintain streaming ingestion and API-based data workflows using AWS services (Kinesis, Lambda, Glue, Spark, EMR, S3)
• Develop and maintain REST APIs for data ingestion and consumption
• Design and implement automated deployment workflows and deterministic releases (versioned releases, environment promotion)
• Develop and optimize data lake and operational data models for near-real-time use cases
• Collaborate across streaming and batch layers to ensure high-quality data delivery and observability

Skills

Python programming

Shell scripting

REST APIs

CI/CD

Distributed data systems

Education

Bachelor's degree in CS/IT/Engineering

Tools

Terraform

CloudFormation

Jenkins

Job description

IDEXX in Massachusetts is seeking a Senior Data Engineer to join the IT Data Engineering team. You will build production-grade data systems, streaming ingestion, API-driven data flows, and CI/CD pipelines in a near-real-time environment using AWS services like Kinesis, Lambda, Glue, and S3.

On-site eight times per month in MA; requires 4+ years of experience, Python and shell scripting, REST APIs, and IaC with Terraform/CloudFormation.