Senior Databricks Engineer

NTT DATA

Atlanta (GA)

Presencial

USD 83 000 - 96 000

Tempo integral

Há 5 dias
Torna-te num dos primeiros candidatos

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Medical, Dental, Vision Insurance
401k program
Flexible Spending Account (FSA) or HSA
AD&D Insurance
Employee Assistance Program

Resumo da oferta

NTT DATA is seeking a Senior Databricks Engineer with deep expertise in Python, Databricks, Unity Catalog, Data Governance, and Data Quality to design and implement scalable data governance and platform solutions. This role is 80% hands-on engineering and 20% product management, requiring collaboration with stakeholders on roadmaps and requirements.

The ideal candidate combines software engineering and data platform expertise with the ability to translate governance and business needs into

Qualificações

  • 8+ years in Data Engineering, Analytics Engineering, or Data Platform Engineering.
  • 5+ years hands-on Databricks experience.
  • Expert-level Python programming skills.
  • Experience with Databricks Lakehouse Platform, PySpark, SQL, Delta Lake, Unity Catalog.
  • Strong knowledge of Data Governance, Data Quality, Metadata Management, Data Lineage.

Responsabilidades

  • Lead Databricks data platform engineering and governance initiatives.
  • Develop scalable data pipelines and governance automation frameworks.
  • Implement Unity Catalog, access controls, data lineage and metadata standards.
  • Collaborate on architecture reviews and mentoring of junior engineers.
  • Partner with product teams to translate requirements into technical solutions.

Conhecimentos

Data Governance
Data Quality
Metadata Management
Data Lineage
Master Data Concepts
Reference Data Concepts
APIs & Automation
CI/CD / DevOps
Stakeholder Communication
Mentoring

Ferramentas

Databricks Lakehouse Platform
PySpark
SQL
Delta Lake
Unity Catalog
Azure

Descrição da oferta de emprego

Company Overview

Req ID: 398192

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us.

NTT DATA's Client is currently seeking a Senior Databricks Engineer to join their team in Atlanta, Georgia (US-GA), United States (US).

Job Description

Job Title: Senior Databricks Engineer / Technical Product Manager (80% Engineering | 20% Product Management)

Job Summary

We are seeking a highly skilled Senior Databricks Engineer with deep expertise in Python, Databricks, Unity Catalog, Data Governance, and Data Quality to lead the design and implementation of scalable data governance and data platform solutions. This role is primarily hands-on technical (80%), requiring strong engineering capabilities, while also partnering with business and technology stakeholders on product management activities (20%), including roadmap planning, requirements gathering, and stakeholder alignment.

The ideal candidate combines strong software engineering and data platform expertise with the ability to translate governance and business requirements into scalable technical solutions.

Key Responsibilities
  • Technical Engineering (80%)
  • Databricks & Data Platform Engineering
  • Design, develop, and support enterprise-scale solutions on the Databricks Lakehouse Platform.
  • Build and optimize data pipelines using Databricks, PySpark, SQL, and Python.
  • Develop reusable, configuration-driven frameworks for data quality validation, metadata management, and governance automation.
  • Implement scalable ingestion, transformation, and validation processes across structured and semi-structured data.
  • Troubleshoot performance bottlenecks and optimize Databricks workloads.
  • Unity Catalog & Data Governance
  • Implement and manage Unity Catalog governance capabilities, including:
  • Catalogs, Schemas, and Tables
  • Access controls and permissions
  • Data lineage
  • Data classification and tagging
  • Business and technical metadata management
  • Partner with governance teams to establish data ownership, stewardship, and governance controls.
  • Enable governance integration between enterprise governance tools and Databricks.
  • Define and implement metadata standards, data quality controls, and governance policies.
  • Python Development
  • Design and develop enterprise-grade Python applications and utilities.
  • Build APIs, automation tools, and governance accelerators.
  • Develop reusable Python modules, testing frameworks, and deployment pipelines.
  • Perform code reviews and establish engineering best practices.
  • Data Quality & Metadata Management
  • Design and implement automated data quality validation frameworks.
  • Define quality rules, thresholds, monitoring, and exception handling processes.
  • Develop metadata harvesting, synchronization, and lineage solutions.
  • Support data observability and monitoring initiatives.
  • Architecture & Technical Leadership
  • Contribute to platform architecture and design reviews.
  • Define engineering standards, governance frameworks, and development best practices.
  • Mentor junior engineers and provide technical leadership.
  • Collaborate with cloud, security, architecture, and governance teams.
Product Management Activities (20%)
  • Stakeholder Engagement
  • Partner with business, governance, and technology stakeholders to understand requirements and priorities.
  • Translate business needs into technical specifications and delivery plans.
  • Facilitate discussions between engineering and business teams.
  • Product Delivery
  • Define and manage backlog, epics, features, and user stories.
  • Support roadmap planning and prioritization activities.
  • Drive solution adoption through demonstrations and stakeholder engagement.
  • Track delivery progress, risks, dependencies, and outcomes.
  • Strategy & Governance
  • Help define the strategic direction for governance and data platform capabilities.
  • Evaluate new technologies, governance tools, and platform enhancements.
  • Develop business cases and recommendations for platform investments.
Must have Technical Skills
  • 8+ years of experience in Data Engineering, Analytics Engineering, or Data Platform Engineering.
  • 5+ years of hands-on Databricks experience.
  • Expert-level Python programming skills.
  • Strong experience with:
  • Databricks Lakehouse Platform
  • PySpark
  • SQL
  • Delta Lake
  • Unity Catalog
  • Deep understanding of:
  • Data Governance
  • Data Quality
  • Metadata Management
  • Data Lineage
  • Master and Reference Data Concepts
  • Experience building APIs and automation frameworks.
  • Strong understanding of CI/CD, Git, and DevOps practices.
  • Experience with Azure cloud platform.
Ideal Candidate
  • Thinks like an engineer and builds like an architect.
  • Has deep Databricks and Unity Catalog expertise.
  • Understands governance beyond compliance and can operationalize it through technology.
  • Can independently drive technical solutions from concept to production.
  • Effectively balances hands-on engineering with stakeholder and product management responsibilities.

Allocation: 80% Technical Engineering | 20% Product Management

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is [$60-$70 hourly]. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications.

This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits

NTT DATA endeavors to make us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications.

Equal Employment Opportunity Statement

NTT DATA is an equal opportunity employer.

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

For our EEO Policy Statement, please click here.

If you'd like more information on your EEO rights under the law, please click here.

For Pay Transparency information, please click here.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Databricks Engineer (Hybrid)
Senior Databricks Engineer (Hybrid)

NTT DATA Services • Atlanta (GA)

Híbrido
USD 98 000 - 163 000
Medical, dental, and vision insurance
HSA/FSA
Life & AD&D insurance
+5
Senior Data Engineering Support Engineer - Databricks & PySpark
Senior Data Engineering Support Engineer - Databricks & PySpark

NTT DATA, Inc. • Addison (TX)

Presencial
USD 76 000 - 85 000
Medical insurance
Dental insurance
Vision insurance
+2
Senior Data Engineering - Support Engineer
Senior Data Engineering - Support Engineer

NTT DATA Services • Addison (TX)

Presencial
USD 92 000 - 138 000
Medical insurance
Dental insurance
Vision insurance with employer contrib
+6
Product Owner
Product Owner

NTT DATA • Atlanta (GA)

Híbrido
USD 110 000 - 140 000
Data Architect (Hybrid)
Data Architect (Hybrid)

NTT DATA Services • Atlanta (GA)

Híbrido
USD 98 000 - 163 000
Product Owner
Product Owner

NTT Data Americas, Inc. • Atlanta (GA)

Híbrido
USD 120 000 - 180 000
Data Architect
Data Architect

NTT DATA, Inc. • Atlanta (GA)

Híbrido
USD 83 000 - 98 000
Databricks leader
Databricks leader

NTT DATA, Inc. • Dallas (TX)

Híbrido
USD 155 000 - 359 000
Data Engineer Advisor
Data Engineer Advisor

NTT DATA, Inc. • Atlanta (GA)

Teletrabalho
USD 138 000 - 152 000
Medical, dental, and vision insurance
401k program
Senior Data Engineer
Senior Data Engineer

NTT DATA • Charlotte (NC)

Híbrido
USD 140 000 - 190 000