Senior Databricks Engineer – AWS Lakehouse (Capital Markets)

SMBC Group; New York (NY); Hybrid; USD 97.000 - 156.000; Vollzeit

Benefits dieser Stelle

Hybrid work model

Zusammenfassung

SMBC Group is seeking a Senior Databricks Engineer with deep AWS expertise to design, build, and maintain our enterprise data Lakehouse infrastructure. You will design high-performance data pipelines and enable real-time reporting and advanced analytics for financial trading data.

Key responsibilities include Databricks architecture, CI/CD deployment, and close collaboration with Data Scientists and Risk Managers to deliver trusted data views that power reporting and AI models.

Qualifikationen

• 4+ years of architectural design and development on the Databricks platform.

Aufgaben

• Design, build, and maintain enterprise Databricks data lakehouse pipelines.
• Implement real-time reporting and analytics integration with AWS services.
• Collaborate with data scientists, risk managers, and analytics teams to deliver clean data views.

Kenntnisse

Databricks

AWS

Python

SQL

CI/CD

Git

Spark

Delta Lake

Tools

Terraform

Databricks Asset Bundles

GitHub Actions

GitLab CI/CD

AWS CodePipeline

Jobbeschreibung

SMBC Group is seeking a Senior Databricks Engineer with deep AWS expertise to design, build, and maintain our enterprise data Lakehouse infrastructure. You will design high-performance data pipelines and enable real-time reporting and advanced analytics for financial trading data.

Key responsibilities include Databricks architecture, CI/CD deployment, and close collaboration with Data Scientists and Risk Managers to deliver trusted data views that power reporting and AI models.