Assistant Manager

LatentView Analytics Ltd.; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

LatentView Analytics Ltd. in Bengaluru seeks a lead Databricks Architect to design scalable Lakehouse solutions across data engineering, analytics, and AI use cases.

You will develop and optimize data pipelines, implement Delta Lake and Unity Catalog, enforce governance and security, review code, mentor engineers, and collaborate with stakeholders to deliver high-quality projects on time and within scope.

Qualifications

• Proven experience designing scalable Databricks Lakehouse solutions.
• Experience with Spark, Delta Lake, and Databricks workflows.
• Strong data governance, security, and quality practices.
• Mentor data engineers and drive best practices.
• Collaborate with architects and business stakeholders.
• Excellent Python and SQL coding skills.

Responsibilities

• Lead the design and development of scalable Databricks Lakehouse solutions for data engineering, analytics, and AI use cases.
• Develop and optimize data pipelines using Spark, Delta Lake, Databricks Workflows, and related services.
• Ensure governance, security, and performance optimization best practices are followed.
• Conduct technical reviews and mentor engineers while upholding standards.
• Collaborate with architects, stakeholders, and cross-functional teams to deliver within scope.
• Guide solution estimation and professional growth of the data engineering team.

Skills

Python

Advanced SQL

Hive

Spark

Databricks

GCP

Data Warehousing

Data Marts

Business Intelligence

DBT

Tools

Databricks

Spark

DBT

Delta Lake

Unity Catalog

Databricks Workflows

Job description

Lead the design and development of scalable Databricks Lakehouse solutions across data engineering, analytics, and AI use cases. Drive implementation of data pipelines, Delta Lake, Unity Catalog, data quality, and governance frameworks while ensuring performance and cost optimization. Provide technical leadership to the engineering team, conduct code/solution reviews, and drive adherence to architecture and development standards. Collaborate with architects and business stakeholders to deliver high-quality solutions and mentor team members on Databricks best practices.

Responsibilities :

1. Lead the design and development of scalable Databricks Lakehouse solutions for data engineering, analytics, and AI use cases.

2. Develop and optimize data pipelines using Spark, Delta Lake, Databricks Workflows, and related services.

3. Ensure implementation of data quality, governance, security, and performance optimization best practices.

4. Conduct technical reviews, troubleshoot complex issues, and ensure adherence to architecture and coding standards.

5. Mentor and guide data engineers, drive technical capability development, and support solution estimation.

6. Collaborate with architects, business stakeholders, and cross-functional teams to deliver projects within scope, timeline, and quality expectations.

Required skills :

Python, Advance SQL, Hive, Spark, Databricks, GCP, Data Warehousing, Data Marts and Business Intelligence | DBT (Data Build Tool).

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.