Senior Data Engineer - Spark, Databricks & AWS

UNAVAILABLE; Westminster (CO); On-site; USD 88,900 - 165,100; Full time

Benefits offered by this job

Flexible time off

Paid sick time

Childcare assistance

401(k)

Tuition assistance

Job summary

Epsilon is looking for a qualified Senior Software Engineer to join their Development Team in Westminster, Colorado. In this role, you will work on Epsilon's TotalSource Plus (TSP) demographic and lifestyle products. The role involves designing, developing, and maintaining scalable data processing solutions using Python and Apache Spark on Databricks.

The ideal candidate will have over 5 years of software development experience and significant exposure to big data technologies. Epsilon offers various benefits including flexible time off, comprehensive health coverage, and opportunities for professional development.

Qualifications

• 5+ years of software development experience in a scalable, distributed, or multi-node environment.
• Significant experience with Apache Spark and exposure to Hadoop, Hive, and related big data technologies.
• Experience in Machine Learning and integrating ML workflows into data pipelines.

Responsibilities

• Design, develop, and maintain scalable data processing solutions.
• Optimize and fine-tune Spark jobs for performance, maximizing efficiency.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.

Skills

Software development experience

Apache Spark

Python or Scala programming

AWS cloud services

Data modeling

Collaboration

Education

BA/BS in Computer Science or related discipline

Tools

Databricks

Git

Kubernetes

Job description

Epsilon is looking for a qualified Senior Software Engineer to join their Development Team in Westminster, Colorado. In this role, you will work on Epsilon's TotalSource Plus (TSP) demographic and lifestyle products. The role involves designing, developing, and maintaining scalable data processing solutions using Python and Apache Spark on Databricks.

The ideal candidate will have over 5 years of software development experience and significant exposure to big data technologies. Epsilon offers various benefits including flexible time off, comprehensive health coverage, and opportunities for professional development.