Senior Databricks Data Engineering Consultant

SDG Group USA

Indianapolis (IN)

Hybrid

USD 120,000 - 180,000

Full time

37 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

401(k) retirement plan
Medical, Dental, Vision
Disability coverage
Hybrid work model

Job summary

SDG Group USA is seeking a Senior Databricks Data Engineering Consultant to lead design, development, and delivery of modern data solutions for clients. You will partner with stakeholders to shape data requirements, guide solution design, and ensure scalable, reliable delivery across analytics, reporting, and AI initiatives.

You will bring deep Databricks experience, emphasis on Databricks SQL, and hands-on delivery with strong data modeling, ETL/ELT, and cloud data platform modernization.

Qualifications

  • Approximately 5–7+ years in data engineering, warehousing, or related technical delivery with client-facing experience.
  • Extensive hands-on Databricks experience including SQL-based workloads.
  • Advanced SQL plus Python or similar scripting language proficiency.
  • Strong understanding of ETL/ELT, data warehousing, and modern data architectures.

Responsibilities

  • Lead design, development, and delivery of scalable Databricks data solutions.
  • Design complex SQL queries and transformations for enterprise workloads.
  • Guide data engineering workstreams and mentor engineers.
  • Design data integrations across structured/unstructured sources using ETL/ELT.
  • Model and optimize data warehouses to support analytics and AI.
  • Lead cloud-based data platform modernization and governance.
  • Drive data quality, performance, and validation across pipelines.
  • Collaborate with clients to clarify requirements and communicate tradeoffs.

Skills

Databricks
SQL
Python
Data modeling
Cloud data platforms
Data integration
Data quality
Technical leadership
Consulting & communication

Tools

Matillion
dbt
Snowflake

Job description

Job Title: Senior Databricks Data Engineering Consultant

Location: Hybrid – Indianapolis, IN

Job Type: Full-Time

About SDG Group

SDG Group is a global consulting firm specialized in Data, Analytics & AI. We are committed to unlocking organizations’ potential and hidden value by offering in-depth expertise that empowers our clients’ business models to become successful data-driven enterprises.

Innovation is in our DNA. We constantly evolve our value proposition through cutting-edge laboratories, advanced analytics, and AI technologies — enabling our clients to accelerate their data transformation journeys.

SDG Group operates on a model of Triple Expertise — combining deep industry domain knowledge, technological proficiency, and strategic partnerships with leading software providers such as Snowflake, Matillion, Databricks, and Microsoft.

With proven experience across 700+ clients, we deliver Data & AI solutions tailored to diverse industries. Our unique IP includes over 50 technology accelerators, frameworks, and tools designed to fast-track implementation. We have strong alliances with major AI hyperscalers including Microsoft, Google, and AWS, and are recognized globally as a leader in Data and AI services.

Our AI practice is anchored by Orbitae®, SDG’s agentic AI brand, and INSIGHTGEN®, together with 50+ accelerators and industry agent frameworks that shorten the distance between fragmented enterprise data and deployed, governed AI agents — in the cloud, on-premises, or across hybrid and sovereign environments.

If you’re seeking to join a team fully specialized in Data, Analytics, and AI, we can’t wait to meet you.

Position Overview

As a Senior Databricks Data Engineering Consultant, you will lead the design, development, and delivery of modern data solutions for SDG Group’s clients, serving as a senior technical contributor and trusted partner across complex engagements.

Working as part of a consulting delivery team, you will partner closely with technical and business stakeholders to shape data requirements, guide solution design, and ensure reliable, scalable delivery that supports analytics, reporting, AI, and broader data-driven initiatives.

This opportunity requires deep, hands‑on Databricks experience, with particular emphasis on Databricks SQL and SQL‑based data engineering workloads. You will work across complex enterprise data environments, lead technical decisions, optimize transformations and pipelines, validate data, and help establish scalable patterns and best practices for downstream business and analytical use cases.

This role is well suited for an experienced data engineer who enjoys combining hands‑on delivery with technical leadership, client partnership, mentoring, and ownership of complex data engineering workstreams.

Key Responsibilities
  • Databricks Architecture & Development: Lead the design, build, testing, and maintenance of scalable data solutions within Databricks, with a strong focus on SQL‑based transformation and data processing workloads.
  • Advanced SQL Development: Design, troubleshoot, and optimize complex SQL queries and transformation logic used for data processing, validation, reconciliation, and analytical workloads.
  • Technical Leadership: Own or lead data engineering workstreams, guide technical decisions, establish development approaches, and help ensure high‑quality delivery across complex client engagements.
  • Data Integration: Design and implement integrations across structured and unstructured data sources using modern ETL/ELT methodologies and data integration tools.
  • Data Modeling & Warehousing: Design and review scalable data models and warehouse structures that support reporting, analytics, AI and downstream applications.
  • Cloud Data Solutions: Lead or contribute to the architecture and modernisation of cloud‑based data platforms using Databricks and related cloud technologies.
  • Technical Delivery & Governance: Drive technical delivery while promoting strong practices for development, testing, documentation, deployment, maintainability, and governance.
  • Data Quality & Performance: Lead troubleshooting and optimization efforts across data quality, reliability, scalability, and query or pipeline performance.
  • Client Leadership: Partner directly with client stakeholders to clarify requirements, explain tradeoffs, recommend solutions, manage technical expectations, and connect engineering decisions to business outcomes.
  • Team Leadership & Mentorship: Collaborate across multidisciplinary teams, review technical work, share best practices, and mentor less experienced engineers and consultants.
  • Continuous Learning: Stay current with evolving Databricks capabilities, data engineering methodologies, and industry best practices while contributing knowledge and technical leadership to the broader SDG community.
Qualifications
  • Professional Experience: Approximately 5–7+ years of experience in data engineering, data warehousing, data integration, analytics engineering, or a related technical discipline, with demonstrated ownership of complex technical delivery. Consulting or other client‑facing experience is strongly preferred.
  • Databricks Experience: Extensive hands‑on professional experience working within Databricks is required, including production data engineering and analytical workloads.
  • Databricks SQL: Advanced experience using Databricks SQL, including designing, troubleshooting, and optimizing complex queries and transformations for enterprise‑scale workloads.
  • SQL & Programming: Advanced SQL skills, including joins, CTEs, window functions, aggregations, complex transformations, performance tuning, and data validation. Strong working proficiency in Python or another relevant programming or scripting language.
  • Data Engineering Fundamentals: Deep understanding of data pipelines, ETL/ELT processes, data integration, data warehousing, transformation patterns, and production data engineering best practices.
  • Data Modeling: Strong understanding of dimensional modeling and modern data modeling concepts, with the ability to design scalable analytical data structures.
  • Cloud & Data Platforms: Strong experience working with modern cloud environments and enterprise‑scale data platforms, including architecture and modernization initiatives.
  • Data Integration Tools: Experience with modern data engineering, orchestration, or transformation tools. Experience with Matillion and/or dbt is highly preferred.
  • Data Quality & Performance: Demonstrated ability to lead data validation, reconciliation, troubleshooting, and performance optimization across multiple source and target systems.
  • Problem Solving & Technical Judgment: Strong analytical and architectural judgment with the ability to evaluate tradeoffs, solve ambiguous technical problems, and translate complex business requirements into scalable solutions.
  • Consulting & Communication Skills: Strong written and verbal communication skills with the ability to lead technical discussions, influence stakeholders, explain complex concepts clearly, and build credibility with clients.
  • Leadership & Growth Mindset: A proactive, collaborative approach with demonstrated ability to mentor others, raise delivery standards, and continuously expand technical and consulting expertise.
Preferred Experience
  • Databricks SQL Warehouses
  • Databricks Workflows and orchestration
  • Unity Catalog and data governance
  • Databricks query, cluster, and performance optimization
  • Matillion
  • dbt
  • Python / PySpark
  • Snowflake
  • Experience leading enterprise‑scale data migration or modernization initiatives
  • Experience working within pharmaceutical, life sciences, healthcare, or another highly regulated industry
What We Offer
  • Stability and Growth: Full‑time employment in a growing high‑tech industry with a meritocratic culture that supports career advancement and professional development.
  • Competitive Compensation: Competitive salary and a 401(k) retirement plan with employer match.
  • Comprehensive Benefits: Robust healthcare and benefits package including Medical, Dental, Vision, and Disability coverage.
  • Work-Life Balance: 3+ weeks of paid vacation, a flexible holiday schedule, and hybrid working arrangements that balance on‑site and remote work.
  • Supportive Community: A collaborative environment where you will work alongside experienced professionals, learn from your colleagues, and contribute to meaningful client engagements.
  • Focus on Technology: Continuous training and exposure to modern Data, Analytics, and AI technologies, supported by SDG Group’s partnerships with leading technology providers.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Data Engineering Consultant
Databricks Data Engineering Consultant

SDG Group • Bedminster Township (NJ)

Hybrid
USD 100,000 - 150,000
Stability and Growth
Competitive Compensation
Healthcare benefits
+3
Senior Databrick Data Engineering Consultant
Senior Databrick Data Engineering Consultant

SDG Group • Chicago (IL)

Hybrid
USD 140,000 - 190,000
Data Analytics Manager
Data Analytics Manager

SDG Group USA • Bedminster Township (NJ)

Hybrid
USD 120,000 - 180,000
Stability and Growth
Competitive Compensation
Comprehensive Benefits
+3
Senior Databricks Data Engineer
Senior Databricks Data Engineer

GAP Careers • Austin (TX)

On-site
USD 140,000 - 200,000
Solution Architect, Delivery (Databricks)
Solution Architect, Delivery (Databricks)

Jobgether • United States

Remote
USD 140,000 - 210,000
Remote work within the United States
Competitive compensation
Professional development
+1
Senior Data Engineer (Databricks) - Contractor
Senior Data Engineer (Databricks) - Contractor

Job Envoy • United States

Remote
USD 140,000 - 190,000
Fully remote in US
6-month+ contract option
Flexible start date
+2
Senior Data Engineer in Indianapolis
Senior Data Engineer in Indianapolis

Energy Jobline ZR • Indianapolis (IN)

Hybrid
USD 115,000 - 145,000
Medical, dental, and vision
401(k) with company match
PTO + company holidays
+2
Senior Databricks Architect
Senior Databricks Architect

Snowrelic Inc • Kansas City (MO)

On-site
USD 150,000 - 190,000
Data Team Lead
Data Team Lead

Incedo Inc. • San Rafael (CA)

Hybrid
USD 130,000 - 150,000
Medical insurance
Vision insurance
401(k)
Databricks Solutions Architect
Databricks Solutions Architect

TEKsystems • United States

On-site
USD 125,000 - 190,000