Senior Spark & Scala Developer

Highbrow LLC; Morris Plains, Austin (NJ, TX); On-site; USD 120,000 - 150,000; Full time

Job summary

A technology consulting firm is looking for an experienced Scala and Spark Developer to join their team. The role requires over 7 years of development experience in Spark, Scala, Hadoop, and related technologies. Responsibilities include collaborating with leadership, participating in sprint planning, troubleshooting production issues, and ensuring application monitoring. Candidates should possess knowledge in DevOps practices and AWS services, with an emphasis on performance optimization and SQL proficiency. This is a long-term position based in Morris Plains, NJ.

Qualifications

• 7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop.
• In depth knowledge on Hadoop architecture and its components.
• Strong working knowledge on Single Store (MEMSQL) database.
• Basic to moderate Terraform development experience needed.
• Health care domain knowledge is a plus.

Responsibilities

• Work with business and technical leadership to understand requirements.
• Participate in sprint planning sessions and help TPOs.
• Provide effective solutions and application monitoring in production environment.

Skills

Spark

Scala

Python

Shell scripting

PostgreSQL

Hadoop

DevOps

AWS

Unix Shell scripting

Tools

Airflow

Jira

Confluence

Terraform

Maven

Jenkins

Sonar Cube

Checkmarks

Job description

A technology consulting firm is looking for an experienced Scala and Spark Developer to join their team. The role requires over 7 years of development experience in Spark, Scala, Hadoop, and related technologies. Responsibilities include collaborating with leadership, participating in sprint planning, troubleshooting production issues, and ensuring application monitoring. Candidates should possess knowledge in DevOps practices and AWS services, with an emphasis on performance optimization and SQL proficiency. This is a long-term position based in Morris Plains, NJ.