AWS Data Platform Engineer II — Real-Time Data & APIs

IDEXX Laboratories, Inc; Westbrook (ME); On-site; USD 90,000 - 110,000; Full time

Benefits offered by this job

Health / Dental / Vision Day-One

Annual cash bonus

5% 401k match

Employee stock program

Job summary

IDEXX Laboratories, Inc is seeking a Data Engineer to build streaming ingestion pipelines, REST APIs, and automated deployment solutions on AWS. The role focuses on reliable data delivery for both streaming and batch use cases, emphasizing observability and platform automation.

You will help implement scalable data lake models and participate in on-call rotations to support production data systems, with a path toward advanced data engineering responsibilities in a pet-health focused company.

Qualifications

• 2–4 years of experience building, operating, and supporting production-grade data systems.
• 2–4 years of hands-on experience designing and developing solutions on AWS, including services such as Lambda, Glue, Kinesis, EMR, S3, SNS, SQS, DynamoDB, API Gateway, and IAM.
• Strong proficiency in Python and experience with shell scripting.
• Experience troubleshooting, debugging, and optimizing distributed data systems, including streaming pipelines, Spark workloads, APIs, messaging queues, and storage layers.
• Experience designing, building, and maintaining RESTful APIs.
• Experience implementing Infrastructure as Code using Terraform and/or CloudFormation.
• Experience building CI/CD pipelines and automated testing frameworks using tools such as Jenkins.
• Knowledge of relational, document, and key-value database technologies.
• Experience working with semi-structured event data (JSON, XML) and evolving data schemas.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent combination of education and practical experience

Responsibilities

• Build and maintain streaming ingestion, API-based data workflows, and distributed data transformations using AWS services (Kinesis, Lambda, Glue/Spark, EMR, S3)
• Develop and maintain REST APIs for data ingestion and consumption
• Design and implement platform automation and standardized, repeatable deployment mechanisms (e.g., versioned releases, environment promotion, and deterministic deployment workflows)
• Develop and optimize data lake and operational data models for near-real-time use cases
• Work across both streaming (operational) and batch (analytical) layers to ensure consistent, high-quality data delivery
• Help improve reliability, automation, and observability across the RDE data platform
• Participate in an on-call rotation to help provide support for the team's data systems and services

Skills

Python

Shell scripting

AWS

Distributed data systems

REST APIs

Infrastructure as Code

CI/CD pipelines

Jenkins

Databases (RDBMS/NoSQL)

JSON/XML

Education

Bachelor's degree in Computer Science or related field

Tools

Terraform

CloudFormation

Jenkins

AWS CLI

Job description

IDEXX Laboratories, Inc is seeking a Data Engineer to build streaming ingestion pipelines, REST APIs, and automated deployment solutions on AWS. The role focuses on reliable data delivery for both streaming and batch use cases, emphasizing observability and platform automation.

You will help implement scalable data lake models and participate in on-call rotations to support production data systems, with a path toward advanced data engineering responsibilities in a pet-health focused company.