Senior Big Data Engineer: Spark, Scala & Cloud Analytics

Madison-Davis, LLC; United States; On-site; USD 150,000 - 175,000; Full time

Job summary

A global financial institution is seeking a Big Data Engineer to develop scalable data solutions and enhance analytics capabilities. The role involves working with modern big data technologies and collaborating with various teams to ensure data quality and stability. Candidates should have extensive experience in Scala, Spark, and distributed systems, with a focus on regulated financial environments. This is a full-time position at a mid-senior level.

Qualifications

• Extensive experience with big data technologies.
• Background in developing solutions in regulated environments.
• Ability to produce system design documentation.

Responsibilities

• Build and enhance large-scale data pipelines.
• Contribute to system design and architecture decisions.
• Ensure data quality and stable processing.

Skills

Scala

Spark

Data systems

SQL

NoSQL

Hadoop ecosystem

Communication skills

Git

Azure services

Airflow

Tools

Cassandra

Maven

Jenkins

Gradle

Databricks

Job description

A global financial institution is seeking a Big Data Engineer to develop scalable data solutions and enhance analytics capabilities. The role involves working with modern big data technologies and collaborating with various teams to ensure data quality and stability. Candidates should have extensive experience in Scala, Spark, and distributed systems, with a focus on regulated financial environments. This is a full-time position at a mid-senior level.