Databricks Engineer Manager - US NY

Kubrick Group; New York (NY); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Leadership opportunities

Certifications funded

Databricks community collaboration

Job summary

Kubrick Group is seeking a Databricks Engineering Manager to lead delivery on client engagements and own outcomes for defined workstreams in a hybrid New York setup. You will grow Kubrick’s Databricks capabilities while guiding data engineering teams across cloud platforms.

Ideal candidates will have deep Databricks, Spark and Delta Lake experience, strong Python/SQL skills, and a track record in leading technical delivery, CI/CD practices, and data governance.

Qualifications

• Experience delivering data engineering on cloud platforms.
• Proficiency with Databricks, Spark and Delta Lake.
• Strong Python and SQL skills.
• Experience with CI/CD, automated testing, and data governance.

Responsibilities

• Lead delivery on client engagements and own outcomes for defined workstreams.
• Design, build, and optimise scalable cloud-based data pipelines on AWS/Azure/GCP.
• Provide technical leadership within Kubrick's delivery squads and grow capabilities.
• Collaborate with clients and internal teams to translate requirements into robust data solutions.

Skills

Databricks

Spark

Delta Lake

Python

SQL

Leadership

Tools

CI/CD

AWS

Azure

GCP

Job description

The opportunity

We are seeking a Databricks Engineering Manager to lead delivery on client engagements, own outcomes for defined workstreams, and grow the capability of our delivery teams

About Kubrick

Kubrick is an award-winning consultancy that helps organizations design, build and scale data and AI solutions that deliver lasting impact.

We work with organizations across industries including financial services, healthcare, retail, energy, aviation, and the public sector, and partner with leading technology providers such as Microsoft, Snowflake, Databricks, and Collibra.

What sets us apart is how we build capabilities and careers. Through continuous learning, real-world experience, and a collaborative culture, we help our people develop the skills, confidence, and experience to build rewarding careers.

The opportunity

We’re looking for an experienced Data Engineer with expertise in Databricks, Apache Spark, Delta Lake, Python and SQL to lead technical delivery in our innovative client projects. You’ll design, build, and optimise scalable cloud-based data pipelines on platforms like AWS, Azure, or GCP, while providing technical leadership within Kubrick’s delivery squads.

In this role, you’ll collaborate with clients and internal teams, translate business requirements into robust data solutions, and help grow Kubrick’s Databricks capabilities. Strong problem-solving, communication skills, and a client-focused mindset are essential.

What We Offer

• Leadership opportunities on high-impact data projects
• Continuous learning and Kubrick-funded certifications
• Collaboration with a top-tier Databricks developer community

You’ll take ownership of meaningful work from early on, contributing to projects that deliver real impact for clients. You’ll be part of a collaborative, high-performing environment where you’re encouraged to think differently, influence outcomes, and continue developing your expertise.

What We’re Looking For

• Must be able to demonstrate Data Engineering with cloud experience
• Expertise in Databricks, Spark and Delta Lake
• Advanced Python & SQL skills
• Experience with CI/CD, automated testing, and data governance

We don’t expect you to tick every box. If you’re excited about the role and believe you have the potential to succeed, we’d still love to hear from you.

Benefits

• 15 PTO days plus 11 public holidays (26 days total)
• 401(k) retirement program with company match up to 3%
• Healthcare insurance (80% premium employer paid)
• Dental insurance
• Vision insurance
• Long-term disability insurance (100% employer paid)
• Additional caregiver leave
• Enhanced maternity, adoption and paternity leave
• Financial wellbeing support
• Flexible working options
• Learning and development opportunities, including professional certifications
• Internal mobility and career development opportunities
• Mental health, diversity and inclusion support
• Additional voluntary benefits

We also offer a hybrid working environment with a requirement to be in our NY office 2-3 days a week/client meetings and home working

Diversity & inclusion

We're committed to building a more diverse and inclusive tech industry and encourage applications from people currently underrepresented in data and AI, including women, people from underrepresented racial and ethnic backgrounds, LGBTQ+ people, people with disabilities, and people who are neurodivergent.

If you need any adjustments during the recruitment process, just let us know. We're here to support you.