Senior AWS Data Engineer - Batch Pipelines & Spark

Polarits; Greenwood Village (CO); On-site; USD 120,000 - 180,000; Full time

Job summary

Polarits in Greenwood Village, CO, is seeking a Senior AWS Data Engineer for a contract opportunity to support a large-scale mobile data platform. The role is onsite (4 days/week) and focuses on owning day-to-day data engineering within a high-volume batch environment.

You will design and optimize ETL pipelines, Spark/SQL transformations, and AWS data services to ensure reliable, scalable data delivery for downstream systems and stakeholders.

Qualifications

• Experience with ETL processes and data pipelines.
• Strong SQL skills and Spark-based transformations.
• Hands-on with AWS services (S3, Athena).
• Experience in large-scale batch processing.

Responsibilities

• Monitor and ensure reliability and accuracy of ETL processes.
• Improve and automate data pipeline monitoring.
• Maintain and enhance Spark and SQL-based transformations.
• Design and implement new data integrations.
• Optimize AWS jobs and storage for performance and cost efficiency.
• Contribute to data architecture standards and engineering best practices.
• Maintain stability and scalability of the platform.
• Work with ~300 Spark-based batch jobs.
• Handle heavy SQL-based transformations.
• AWS ecosystem (S3, Athena, Spark).
• Large-scale batch processing (non-real time).
• 150 critical daily data transformations feeding downstream systems.
• Daily reliability is essential for downstream tools and stakeholders.

Skills

ETL

Data pipeline

Spark

SQL

AWS

Data architecture

Reliability

Batch processing

Tools

AWS (S3)

Athena

Spark

Job description

Polarits in Greenwood Village, CO, is seeking a Senior AWS Data Engineer for a contract opportunity to support a large-scale mobile data platform. The role is onsite (4 days/week) and focuses on owning day-to-day data engineering within a high-volume batch environment.

You will design and optimize ETL pipelines, Spark/SQL transformations, and AWS data services to ensure reliable, scalable data delivery for downstream systems and stakeholders.