Senior Big Data Engineer

Epsilon; Westminster (CO); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Flexible time off

Paid holidays and sick time

Parental leave

Healthcare coverage

401(k)

Tuition assistance

Commuter benefits

Professional development

Employee recognition

Charitable donation matching

Health coaching

Childcare and elder care assistance

Adoption assistance

Job summary

Epsilon seeks a Senior Software Engineer for its Data Practice, focusing on TotalSource Plus demographic and lifestyle products in Westminster, CO. You will design and implement scalable data pipelines, mentor junior engineers, and collaborate with cross-functional teams to extract insights from large datasets.

Qualifications include 5+ years in distributed software development, expertise in Spark, Hadoop, Hive, and cloud platforms (AWS). Strong problem solving and communication skills required.

Qualifications

• 5+ years of software development experience in scalable distributed environments.
• Proficiency in Scala, Python, or Java.
• Experience with Apache Spark, Hadoop, and Hive.
• Cloud platforms (AWS preferred) and Kubernetes/Docker.
• Machine learning experience and relevant certifications (AWS, Databricks, or Spark).

Responsibilities

• Design and implement scalable data processing solutions using Python and Apache Spark on Databricks.
• Optimize Spark jobs and build fault-tolerant data pipelines with monitoring.
• Leverage AWS cloud services and develop SQL queries.
• Apply data modeling best practices and use Git for source control.
• Collaborate with cross-functional teams and mentor junior engineers.
• Extract insights from large datasets.

Skills

Scala

Python

Java

Apache Spark

Hadoop

Hive

Kubernetes

Docker

Airflow

ML experience

Communication

Problem solving

Education

BA/BS in Computer Science or related field

Tools

Databricks

AWS

Git

Job description

Seeking a Senior Software Engineer for Epsilon's Data Practice focused on TotalSource Plus demographic and lifestyle products.

Responsibilities

• designing
• developing
• and maintaining scalable data processing solutions using Python and Apache Spark on Databricks
• optimizing Spark jobs
• building fault-tolerant data pipelines with monitoring
• leveraging AWS cloud services
• developing SQL queries
• applying data modeling best practices
• using Git for source control
• collaborating with cross-functional teams
• extracting insights from large datasets
• and mentoring junior engineers

Requirements

• 5+ years of software development experience in scalable distributed environments
• proficiency in Scala, Python, or Java
• experience with Apache Spark
• Hadoop
• Hive
• cloud platforms (AWS preferred)
• Kubernetes
• Docker
• Airflow
• strong problem-solving and communication skills
• BA/BS in Computer Science or related field
• machine learning experience
• and preferred certifications in AWS, Databricks, or Spark

Benefits

• flexible time off
• paid holidays and sick time
• parental leave
• childcare and elder care assistance
• adoption assistance
• health coverage
• 401(k)
• tuition assistance
• commuter benefits
• professional development
• employee recognition
• charitable donation matching
• and health coaching