Databrick Lead

Valuemomentum; Hyderabad, Coimbatore District; On-site; INR 2,800,000 - 5,200,000; Full time

Job summary

ValueMomentum is seeking an experienced Databrick Lead in Hyderabad to design scalable data solutions and lead a data engineering team. The role requires hands-on expertise across AWS, Databricks, Oracle, PySpark, ADF, and data quality practices.

The candidate will architect data pipelines, optimize performance, and provide technical leadership, reviews, and mentoring. Work from office with 5 days per week for a full-time engagement in a dynamic environment.

Qualifications

• 8+ years of experience in Data Engineering/Data Platforms.
• Strong hands-on experience in AWS, Databricks, Oracle, PySpark, ADF, PL/SQL, Data quality.
• Experience with advanced Databricks capabilities and real-world implementation.

Responsibilities

• Design and develop scalable data pipelines using AWS, Databricks, ADF, Oracle.
• Develop data processing and transformation solutions using PySpark and Spark SQL.
• Develop and optimize complex SQL and PL/SQL queries.
• Implement Databricks Lakehouse, Delta Lake, Unity Catalog, and Lakehouse Federation.
• Manage Databricks Views, permissions, privileges, and access controls.
• Implement Databricks Asset Bundles (DABs), Jobs, Workflows, and Triggers.
• Integrate Oracle data with AWS and Databricks platforms.
• Work with AWS services such as S3, Glue, Lambda, IAM, and CloudWatch.
• Perform data quality, validation, reconciliation, and performance optimization.
• Provide technical guidance, code reviews, and mentorship to the data engineering team.

Skills

AWS

Databricks

Oracle

PySpark

PL/SQL

Unity Catalog

Lakehouse Federation

Databricks Asset Bundles

Views & Access Management

Job description

Databrick Lead

Company: ValueMomentum
Location: Hyderabad
Work Mode: Work from Office 5 Days a Week
Experience: 6+ Years
Employment Type: Full-Time

Job Summary

We are looking for an experienced Databrick Lead with strong hands-on experience in AWS, Databricks, Oracle, PySpark, ADF, DATA Quality, PL/SQL. The candidate will be responsible for designing scalable data solutions, optimizing data pipelines, and providing technical leadership to the data engineering team.

Key Responsibilities

• Design and develop scalable data pipelines using AWS, Databricks, ADF, Oracle.
• Develop data processing and transformation solutions using PySpark and Spark SQL.
• Develop and optimize complex SQL and PL/SQL queries.
• Implement Databricks Lakehouse, Delta Lake, Unity Catalog, and Lakehouse Federation.
• Manage Databricks Views, permissions, privileges, and access controls.
• Implement Databricks Asset Bundles (DABs), Jobs, Workflows, and Triggers.
• Integrate Oracle data with AWS and Databricks platforms.
• Work with AWS services such as S3, Glue, Lambda, IAM, and CloudWatch.
• Perform data quality, validation, reconciliation, and performance optimization.
• Provide technical guidance, code reviews, and mentorship to the data engineering team.

Mandatory Skills

AWS | Databricks | Oracle | PySpark | PL/SQL | Unity Catalog | Lakehouse Federation | Databricks Asset Bundles | Views & Access Management

Candidate Profile

• 8+ years of experience in Data Engineering/Data Platforms.
• Strong hands-on experience in AWS, Databricks, Oracle, PySpark, ADF, PL/SQL, Data quality.
• Experience with advanced Databricks capabilities and real-world implementation.
• Strong technical leadership, problem-solving, and communication skills.Role & responsibilities