DataBricks Data Architect Exp 13 Yrs To 18 Yrs

Bilvantis Technologies; Hyderabad; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Bilvantis Technologies in Hyderabad is seeking a Data Architect specializing in Databricks to design scalable data platforms and guide delivery across cloud environments.

The role emphasizes Delta Lake, Unity Catalog, structured streaming, and cross-functional collaboration with data engineers to align technical solutions with business goals. Advanced PySpark and cloud experience are required.

Qualifications

• 13+ years of IT experience, with 3+ years focused on Databricks and cloud data ecosystems.
• Advanced PySpark and SQL skills, with proficiency in Python, Scala, or Java.
• Deep knowledge of Delta Lake, MLflow, Unity Catalog, and Serverless Compute.
• Hands-on expertise in Azure Databricks, AWS, or Google Cloud Platform.
• Strong background in dimensional modeling, star/snowflake schemas, and data warehousing.

Responsibilities

• Create scalable data platform blueprints using Lakehouse and Medallion architectures.
• Manage performance tuning, cluster configurations, and cost optimization across cloud environments.
• Implement security, access control, and data lineage using Unity Catalog.
• Oversee ELT/ETL processes, automated workflows, and job scheduling via Databricks Jobs and Delta Live Tables.
• Collaborate with data engineers, data scientists, and stakeholders to align technical solutions with business goals.

Skills

Databricks

PySpark

SQL

Cloud platforms

Data modeling

CI/CD

Pre-sales

Jira/Confluence

Education

Bachelor's or Master's degree in CS/Engineering

Tools

Terraform

Delta Lake

Unity Catalog

MLflow

Delta Live Tables

Jira/Confluence

Job description

Job Description:

Job Description: DataBricks – Data Architect (Exp: 13 Yrs to 18 Yrs)

We are seeking a talented and motivated DataBricks expert to join our team as a Data Architect.

Required Skills & Qualifications

• 13+ years of IT experience, with 3+ years focused on Databricks and cloud data ecosystems.
• Advanced PySpark and SQL skills, with proficiency in Python, Scala, or Java.
• Deep knowledge of Delta Lake, MLflow, Unity Catalog, and Serverless Compute.
• Hands‑on expertise in Microsoft Azure (Azure Databricks), AWS, or Google Cloud Platform.
• Strong background in dimensional modeling, star/snowflake schemas, and data warehousing principles.
• Experience with streaming data (Structured Streaming, Kafka, Event Hubs, Pub/Sub).
• Experience with Infrastructure-as-Code (Terraform) and CI/CD for data platforms.
• Experience in pre‑sales, solution proposals, and client‑facing architecture discussions.
• Experience in agile development processes using Jira and Confluence.
• Own the data platform architecture and guide its delivery on Databricks.
• Understanding of the SDLC and Agile methodologies.
• Communication with the customer and producing the daily status report.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Databricks Certified Data Engineer Professional certification.
• Cloud architect certification (Azure Solutions Architect Expert, AWS Solutions Architect - Professional, or Google Professional Cloud Architect).
• Should have good oral and written communication.
• Should be able to present solutions to business and technical stakeholders.
• Should be proactive and adaptive.

Key Responsibilities

• Create scalable data platform blueprints using the Lakehouse and Medallion architecture (Bronze, Silver, Gold layers).
• Manage performance tuning, cluster configurations, and cost optimization across cloud environments (Azure, AWS, or GCP).
• Implement security, access control, and data lineage using Unity Catalog.
• Oversee ELT/ETL processes, automated workflows, and job scheduling via Databricks Jobs and Delta Live Tables.
• Partner with data engineers, data scientists, and stakeholders to align technical solutions with business goals.