Senior Data Engineer, AWS Data Platform & Real-Time Ingest

IDEXX; Boston (MA); On-site; USD 110,000 - 130,000; Full time

Benefits offered by this job

Health benefits day-one

Dental and Vision benefits day-one

5% 401(k) matching

Employee stock program

Volunteer paid days off

Foundation donation matching

Pet insurance

Job summary

IDEXX is seeking an experienced data platform engineer to build streaming ingestion and REST APIs, working with AWS services like Kinesis, Lambda, Glue, and EMR. You will design automation for releases and environment promotion, and optimize data models for real-time analytics.

You will also help improve reliability and observability across the data platform while participating in an on-call rotation to support data systems. A strong background in Python, shell scripting, and IaC is required.

Qualifications

• 4+ years building and supporting production-grade data systems.
• 3+ years designing solutions on AWS (Lambda, Glue, Kinesis, EMR, S3).
• Strong Python and shell scripting skills.
• Experience with distributed data systems, streaming pipelines, and APIs.
• Experience Infrastructure as Code (Terraform / CloudFormation).
• Experience CI/CD with Jenkins.

Responsibilities

• Build and maintain streaming ingestion and API-based data workflows on AWS.
• Develop and maintain REST APIs for data ingestion and consumption.
• Design platform automation and deterministic deployment workflows.
• Develop and optimize data lake and operational data models for near real-time use cases.
• Work across streaming and batch layers to ensure data delivery quality.
• Improve reliability, automation, and observability of the data platform.
• Participate in an on-call rotation for data systems support.

Skills

Python

Shell scripting

AWS

REST APIs

Distributed systems

CI/CD

Terraform

CloudFormation

Jenkins

Data modeling

Education

Bachelor's degree in CS/IT/Engineering

Tools

Kinesis

Lambda

Glue

EMR

S3

DynamoDB

API Gateway

IAM

Terraform

CloudFormation

Job description

IDEXX is seeking an experienced data platform engineer to build streaming ingestion and REST APIs, working with AWS services like Kinesis, Lambda, Glue, and EMR. You will design automation for releases and environment promotion, and optimize data models for real-time analytics.

You will also help improve reliability and observability across the data platform while participating in an on-call rotation to support data systems. A strong background in Python, shell scripting, and IaC is required.