Databricks Practice Lead & Engineering Manager

DCM Infotech Limited; United States; On-site; USD 180,000 - 260,000; Full time

Job summary

DCM Infotech Limited is seeking an experienced Databricks Practice Lead / Engineering Manager to provide hands-on technical leadership while managing a team of data engineers, architects, and consultants supporting complex enterprise and government programs.

The role requires a senior Databricks expert to design and oversee modern data platforms, establish technical standards, guide delivery teams, and stay actively involved in architecture, troubleshooting, code reviews, and client-facing

Qualifications

• Bachelor's degree in computer science, information technology, data engineering, engineering, or a related discipline.
• At least 10 years of experience in data engineering, data architecture, analytics engineering, or related technology roles.
• At least 5 years of hands-on experience designing and implementing solutions using Databricks.
• At least 3 years of experience managing or formally leading technical engineering teams.
• Advanced experience with: Databricks Lakehouse Platform, Apache Spark and PySpark, Spark SQL and advanced SQL development, Delta Lake and medallion architecture, Unity Catalog and enterprise data governance, ETL and ELT pipeline architecture, Batch and real-time data processing, Data modeling and data warehousing, Python-based data engineering, Databricks Workflows, Jobs, and cluster management, Experience deploying Databricks solutions in Azure, AWS, or Google Cloud, Experience with CI/CD, Git-based development, automated testing, and infrastructure as code, Demonstrated ability to optimize Spark workloads, cluster configurations, query performance, reliability, and cloud costs, Experience managing technical delivery, resource assignments, risks, schedules, and client expectations, Strong written, verbal, presentation, documentation, and stakeholder-management skills, Ability to explain complex technical concepts to executives, business stakeholders, and nontechnical audiences.

Responsibilities

• Provide hands-on technical leadership while managing a team of data engineers, architects, and consultants.
• Design scalable, secure data architectures using Databricks, Delta Lake, and cloud-native technologies.
• Lead batch, streaming, ETL/ELT, analytics, ML/AI data solutions and platform migrations.
• Establish development standards for source control, automated testing, CI/CD, and IaC.
• Oversee architecture reviews, code reviews, and root-cause analyses.
• Guide workspace design, cluster management, and cost optimization.
• Coordinate with cloud platforms (Azure, AWS, GCP) and governance frameworks.
• Lead client-facing solution development and proposals.
• Build reusable accelerators, reference architectures, and delivery playbooks.
• Mentor teams, recruit, and develop technical competencies.

Skills

Databricks Lakehouse Platform

Apache Spark

PySpark

SQL (Spark SQL)

Delta Lake

Unity Catalog

CI/CD & IaC

Cloud platforms (Azure, AWS, GCP)

Team leadership

Solution architecture

Education

Bachelor's degree in CS/IT/Data Engineering

Tools

Databricks Workflows

Git

MLflow

Airflow

Job description

DCM Infotech Limited is seeking an experienced Databricks Practice Lead / Engineering Manager to provide hands-on technical leadership while managing a team of data engineers, architects, and consultants supporting complex enterprise and government programs.

The role requires a senior Databricks expert to design and oversee modern data platforms, establish technical standards, guide delivery teams, and stay actively involved in architecture, troubleshooting, code reviews, and client-facing