Senior Big Data Engineer - Spark, AWS, Flexible Time Off

Epsilon; Westminster (CO); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Flexible time off

Paid holidays and sick time

Parental leave

Healthcare coverage

401(k)

Tuition assistance

Commuter benefits

Professional development

Employee recognition

Charitable donation matching

Health coaching

Childcare and elder care assistance

Adoption assistance

Job summary

Epsilon seeks a Senior Software Engineer for its Data Practice, focusing on TotalSource Plus demographic and lifestyle products in Westminster, CO. You will design and implement scalable data pipelines, mentor junior engineers, and collaborate with cross-functional teams to extract insights from large datasets.

Qualifications include 5+ years in distributed software development, expertise in Spark, Hadoop, Hive, and cloud platforms (AWS). Strong problem solving and communication skills required.

Qualifications

• 5+ years of software development experience in scalable distributed environments.
• Proficiency in Scala, Python, or Java.
• Experience with Apache Spark, Hadoop, and Hive.
• Cloud platforms (AWS preferred) and Kubernetes/Docker.
• Machine learning experience and relevant certifications (AWS, Databricks, or Spark).

Responsibilities

• Design and implement scalable data processing solutions using Python and Apache Spark on Databricks.
• Optimize Spark jobs and build fault-tolerant data pipelines with monitoring.
• Leverage AWS cloud services and develop SQL queries.
• Apply data modeling best practices and use Git for source control.
• Collaborate with cross-functional teams and mentor junior engineers.
• Extract insights from large datasets.

Skills

Scala

Python

Java

Apache Spark

Hadoop

Hive

Kubernetes

Docker

Airflow

ML experience

Communication

Problem solving

Education

BA/BS in Computer Science or related field

Tools

Databricks

AWS

Git

Job description

Epsilon seeks a Senior Software Engineer for its Data Practice, focusing on TotalSource Plus demographic and lifestyle products in Westminster, CO. You will design and implement scalable data pipelines, mentor junior engineers, and collaborate with cross-functional teams to extract insights from large datasets.

Qualifications include 5+ years in distributed software development, expertise in Spark, Hadoop, Hive, and cloud platforms (AWS). Strong problem solving and communication skills required.