Databricks Tech Lead - Scalable Data Pipelines

Saama-Technologies; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Saama-Technologies in the United States is seeking a Technical Lead - Databricks Developer to design and implement robust, scalable data engineering solutions using the Databricks Lakehouse architecture.

This hands-on technical leader will bridge complex data processing and business needs, own end-to-end pipelines, drive performance optimization, and oversee governance and security with Unity Catalog while collaborating with enterprise architects and client teams.

Qualifications

• Experience delivering enterprise Databricks projects end-to-end.
• Deep knowledge of Delta Lake, Unity Catalog, Databricks Workflows and data governance principles.
• Proficiency in Python, SQL, Spark-SQL; strong Spark and Hive data processing knowledge.
• Strong foundations in data structures, algorithms and analytical problem-solving.
• Excellent verbal and written communication with enterprise clients.

Responsibilities

• Architecture & Solution Design: design and build enterprise solutions meeting functional and non-functional requirements.
• Pipeline Engineering: build and manage scalable data pipelines for batch and streaming data.
• Databricks Orchestration & Governance: implement and manage Databricks workflows and Unity Catalog governance.
• Performance Optimization: identify bottlenecks and drive optimization to reduce compute costs.
• Client Engagement: work with customers and stakeholders translating business challenges into deliverables.

Skills

Python

SQL

Apache Spark

Hive data processing

Performance optimization

Communication skills

Leadership

Education

Bachelor's or Master’s in Information Technology or Computer Science

Tools

Delta Lake

Unity Catalog

Databricks Workflows

Job description

Saama-Technologies in the United States is seeking a Technical Lead - Databricks Developer to design and implement robust, scalable data engineering solutions using the Databricks Lakehouse architecture.

This hands-on technical leader will bridge complex data processing and business needs, own end-to-end pipelines, drive performance optimization, and oversee governance and security with Unity Catalog while collaborating with enterprise architects and client teams.