Data Architect

BL Consultants; India; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A consulting firm is seeking a Databricks Architect to design and implement scalable data solutions. The ideal candidate will have over 5 years of experience with Databricks and a strong background in data engineering. Responsibilities include developing data pipelines and optimizing cluster performance. This full-time position is targeted at mid-senior level professionals looking to make a significant impact in a collaborative environment.

Qualifications

• 5+ years of experience working with Databricks.
• Strong background in data engineering.
• Proven experience leading technical teams.

Responsibilities

• Design and implement scalable Databricks solutions.
• Develop data pipelines and architecture.
• Collaborate on machine learning models.

Skills

Databricks experience

Proficiency in Python

Data engineering

Excellent communication

Tools

Databricks APIs

Spark

Delta Lake

Job description

Direct message the job poster from BL Consultants

Currently we have an open position with our client - US based Boutique Consulting Firm

Databricks Architect

About Us

It is a boutique consulting firm specializing in data and AI, with deep expertise in the Databricks ecosystem. We help clients build scalable data platforms and AI solutions that drive real business impact. Our expertise in implementation, optimization, and enablement empowers clients to harness the full potential of their data, unlocking significant competitive advantages and fostering innovation.

Key Responsibilities

• Databricks Solution Architecture: Design and implement scalable, secure, and efficient Databricks solutions that meet client requirements.
• Data Engineering: Develop data pipelines, architect data lakes, and implement data warehousing solutions using Databricks.
• Data Analytics: Collaborate with data scientists and analysts to develop and deploy machine learning models and analytics solutions on Databricks.
• Performance Optimization: Optimize Databricks cluster performance, ensuring efficient resource utilization and cost-effectiveness.
• Security and Governance: Implement Databricks security features, ensure data governance, and maintain compliance with industry regulations.
• Client Engagement: Work closely with clients to understand their business requirements, provide technical guidance, and deliver high-quality Databricks solutions.
• Thought Leadership: Stay up-to-date with the latest Databricks features, best practices, and industry trends, and share knowledge with the team.

Requirements

• Databricks Experience: 5+ years of experience working with Databricks, including platform architecture, data engineering, and data analytics.
• Technical Skills: Proficiency in languages such as Python, Scala, or Java, and experience with Databricks APIs, Spark, and Delta Lake.
• Data Engineering: Strong background in data engineering, including data warehousing, ETL, and data governance.
• Leadership: Proven experience leading technical teams, mentoring junior engineers, and driving technical initiatives.
• Communication: Excellent communication and interpersonal skills, with the ability to work effectively with clients and internal stakeholders.

Good to Have

• Certifications: Databricks Certified Professional or similar certifications.
• Cloud Experience: Experience working with cloud platforms such as AWS, Azure, or GCP.
• Machine Learning: Knowledge of machine learning concepts and experience with popular ML libraries.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology and Engineering

Industries

• IT Services and IT Consulting