Senior Data Architect - Databricks & Cloud for Banking

MSR Technology Group; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

A leading tech consulting firm in New York is seeking a Mid-Senior level Information Technology professional to build and optimize ETL pipelines using PySpark and Databricks. This role requires a minimum of 12 years of experience, particularly in investment banking. Ideal candidates will have strong skills in data architecture and CI/CD pipeline implementation. The position is contract-based with a focus on local candidates who can work on W2.

Qualifications

• Minimum 12 years of experience in a relevant field.
• Experience in building and optimizing ETL pipelines.
• Strong understanding of data architecture standards.

Responsibilities

• Build and optimize ETL pipelines using PySpark and Databricks.
• Define and enforce data architecture standards.
• Lead data strategy initiatives aligned with investment banking goals.
• Architect big data solutions across various platforms.
• Implement CI/CD pipelines for automated deployment.

Skills

Databricks

Python

Investment banking experience

Tools

PySpark

Azure Synapse

Snowflake

Redshift

Azure DevOps

GitHub

Job description

A leading tech consulting firm in New York is seeking a Mid-Senior level Information Technology professional to build and optimize ETL pipelines using PySpark and Databricks. This role requires a minimum of 12 years of experience, particularly in investment banking. Ideal candidates will have strong skills in data architecture and CI/CD pipeline implementation. The position is contract-based with a focus on local candidates who can work on W2.