Senior Databricks Engineer – AWS Lakehouse (Capital Markets)

SMBC Group; New York (NY); Hybrid; USD 97,000 - 156,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

SMBC Group is seeking a Senior Databricks Engineer with deep AWS expertise to design, build, and maintain our enterprise data Lakehouse infrastructure. You will design high-performance data pipelines and enable real-time reporting and advanced analytics for financial trading data.

Key responsibilities include Databricks architecture, CI/CD deployment, and close collaboration with Data Scientists and Risk Managers to deliver trusted data views that power reporting and AI models.

Qualifications

• 4+ years of architectural design and development on the Databricks platform.

Responsibilities

• Design, build, and maintain enterprise Databricks data lakehouse pipelines.
• Implement real-time reporting and analytics integration with AWS services.
• Collaborate with data scientists, risk managers, and analytics teams to deliver clean data views.

Skills

Databricks

AWS

Python

SQL

CI/CD

Git

Spark

Delta Lake

Tools

Terraform

Databricks Asset Bundles

GitHub Actions

GitLab CI/CD

AWS CodePipeline

Job description

SMBC Group is seeking a Senior Databricks Engineer with deep AWS expertise to design, build, and maintain our enterprise data Lakehouse infrastructure. You will design high-performance data pipelines and enable real-time reporting and advanced analytics for financial trading data.

Key responsibilities include Databricks architecture, CI/CD deployment, and close collaboration with Data Scientists and Risk Managers to deliver trusted data views that power reporting and AI models.