Big Data Engineer

Madison-Davis, LLC; United States; On-site; USD 150,000 - 175,000; Full time

Job summary

A global financial institution is seeking a Big Data Engineer to develop scalable data solutions and enhance analytics capabilities. The role involves working with modern big data technologies and collaborating with various teams to ensure data quality and stability. Candidates should have extensive experience in Scala, Spark, and distributed systems, with a focus on regulated financial environments. This is a full-time position at a mid-senior level.

Qualifications

• Extensive experience with big data technologies.
• Background in developing solutions in regulated environments.
• Ability to produce system design documentation.

Responsibilities

• Build and enhance large-scale data pipelines.
• Contribute to system design and architecture decisions.
• Ensure data quality and stable processing.

Skills

Scala

Spark

Data systems

SQL

NoSQL

Hadoop ecosystem

Communication skills

Git

Azure services

Airflow

Tools

Cassandra

Maven

Jenkins

Gradle

Databricks

Job description

This range is provided by Madison-Davis, LLC. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$150,000.00/yr - $175,000.00/yr

A global financial institution is seeking a Big Data Engineer to enhance a core analytics platform that supports daily regulatory reporting and business insights. This role focuses on building scalable data solutions using modern big data technologies and contributing to the strategic technical direction of the platform.

You will work closely with liquidity, risk, and technology stakeholders to deliver reliable datasets, strengthen analytics capabilities, and evolve the platform as regulatory and business needs grow.

What You’ll Tackle

• Build and enhance large-scale data pipelines using Scala, Spark, and Cassandra
• Contribute to system design, architecture decisions, and platform modernization
• Support development of daily liquidity metrics and analytics datasets
• Ensure data quality, stability, and performant batch/real-time processing
• Partner with product, reporting, and liquidity teams within an agile environment
• Support releases, troubleshoot technical issues, and improve automation
• Contribute to cloud integration and strategic technology initiatives

What You Bring

• Extensive experience with Scala, Spark, and distributed data systems
• Strong background in SQL and NoSQL databases
• Experience developing big data solutions in regulated financial environments
• Ability to produce system design documentation and guide technical direction
• Proficiency with Hadoop ecosystem, APIs, and development frameworks (Git, Maven, Jenkins, Gradle)
• Strong communication skills and ability to collaborate across technical and business groups
• Self-directed, detailed, and highly organized working style
• Liquidity or liquidity risk experience
• Experience with JMS/MQ
• Familiarity with cloud services such as Azure Kubernetes Service, Azure SQL, Functions, EventHub, and Databricks
• Workflow tools such as GitHub Actions or Airflow

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology
• Staffing and Recruiting

Referrals increase your chances of interviewing at Madison-Davis, LLC by 2x

Sign in to set job alerts for “Big Data Developer” roles.