Senior Director, Software Engineering – Data Platform, MDM Integration

Jobtailor; New Jersey; On-site; USD 180,000 - 240,000; Full time

Job summary

Jobtailor seeks a seasoned software and data leader to drive enterprise-scale data solutions in the US. You will architect MDM integrations between Databricks lakehouse and NeoXam, modernize cloud infrastructure on AWS, and guide multiple product‑focused engineering teams toward scalable, resilient systems.

Responsibilities include leading data migrations, implementing AI/ML automation for data quality, and building robust data pipelines with Delta Live Tables and Unity Catalog.

Qualifications

• Bachelor's degree in computer science, engineering, or related field.
• At least 9 years in software engineering and data platform development for enterprise-scale solutions.
• At least 7 years of people management leading technical teams.
• Expertise in cloud data platforms (Databricks, Snowflake) with data lakehouse architectures.
• Experience with AWS services (S3, EMR, Glue, Lambda) or comparable clouds (Azure, GCP).
• Proven track record leading large-scale data migrations and modernization initiatives.

Responsibilities

• Lead strategic MDM integration initiatives and architect high-volume data integration between Databricks lakehouse and NeoXam MDM.
• Design modern cloud data architecture to optimize pipelines using Unity Catalog, Delta Live Tables, and Serverless compute.
• Develop and apply AI/ML automation to transform data and detect anomalies across conversion lifecycle.
• Build and scale engineering teams, mentoring software and data engineers.
• Migrate legacy assets to AWS cloud, decomposing monoliths into microservices.
• Promote engineering excellence and scalable, resilient software practices.

Skills

MDM integration

Databricks

Unity Catalog

Delta Live Tables

Serverless compute

AI/ML automation

AWS (S3/EMR/Glue/Lambda)

ETL/ELT

Data lakehouse

Leadership / people management

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Databricks platform

Snowflake

AWS

Azure

GCP

Job description

Responsibilities

• Lead strategic MDM integration initiatives – Architect and oversee seamless, high‑volume data integration between Databricks lakehouse and NeoXam MDM platform, establishing foundational data architecture for multi‑billion‑dollar index‑linked investment products.
• Drive advanced cloud data architecture – Utilize cutting‑edge Databricks features including Unity Catalog, Delta Live Tables, and Serverless compute to optimize data pipelines and maximize performance for massive‑scale financial datasets.
• Pioneer AI/ML automation solutions – Implement Databricks Mosaic AI and agentic frameworks to automate data transformation, quality assurance, and anomaly detection across the entire conversion lifecycle.
• Build and scale high‑performing engineering teams – Lead, manage, and grow multiple teams of product‑focused software and data engineers while mentoring their professional and technical development.
• Modernize legacy infrastructure – Spearhead mission‑critical migration of legacy assets and terabytes of data to modern AWS cloud ecosystem, breaking monolithic applications into microservice architectures.
• Champion engineering excellence and innovation – Foster a culture of cutting‑edge technology adoption, continuous improvement of software engineering practices, and delivery of scalable, resilient solutions.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related technical field.
• Minimum 9 years of experience in software engineering and data platform development with a proven track record in enterprise‑scale solutions.
• Minimum 7 years of people‑management experience leading technical teams and driving organizational growth in fast‑paced environments.
• Advanced expertise in cloud data platforms such as Databricks, Snowflake, or similar, with hands‑on experience in data lakehouse architectures and ETL/ELT processes.
• Strong experience with cloud infrastructure including AWS services (such as S3, EMR, Glue, Lambda) or equivalent cloud platforms (Azure, GCP).
• Proven leadership in large‑scale data migrations and system modernization initiatives, with experience managing complex technical transformations.