Databricks Architect

Codeforce 360; Hyderabad; On-site; INR 3,000,000 - 5,500,000; Full time

Job summary

Codeforce 360 is seeking an experienced Databricks Architect in Hyderabad to design scalable cloud-based data solutions using Databricks and modern data engineering tools. You will lead data pipelines, work with Delta Lake/Unity Catalog, and integrate Databricks with Azure/AWS services to optimize performance.

The role requires deep expertise in Spark, PySpark, Python, and SQL, along with strong data modeling and CI/CD knowledge. Excellent communication and leadership will be essential.

Qualifications

• 7+ years of experience in Data Engineering/Architecture.
• Hands-on experience with Databricks, Apache Spark, PySpark, Python, and SQL.
• Experience with Azure/AWS, Delta Lake, Unity Catalog, and ETL/ELT.
• Strong knowledge of data modeling, cloud architecture, and CI/CD.
• Excellent communication and problem-solving skills.

Responsibilities

• Design and implement Databricks Lakehouse architecture.
• Develop scalable data pipelines using Databricks, Spark, PySpark, Python, and SQL.
• Work with Delta Lake, Unity Catalog, and data governance.
• Integrate Databricks with Azure/AWS cloud services.
• Optimize data pipelines and Spark workloads for performance.
• Lead technical design discussions and mentor data engineering teams.

Skills

Databricks

Apache Spark

PySpark

Python

SQL

Cloud (Azure/AWS)

Delta Lake

Unity Catalog

ETL/ELT

Data modeling

CI/CD

Communication

Job description

Job Description

We are looking for an experienced Databricks Architect to design and implement scalable cloud-based data solutions using Databricks and modern data engineering technologies.

Key Responsibilities

• Design and implement Databricks Lakehouse architecture.
• Develop scalable data pipelines using Databricks, Spark, PySpark, Python, and SQL.
• Work with Delta Lake, Unity Catalog, and data governance.
• Integrate Databricks with Azure/AWS cloud services.
• Optimize data pipelines and Spark workloads for performance.
• Lead technical design discussions and mentor data engineering teams.

Required Skills

• 7+ years of experience in Data Engineering/Architecture.
• Strong hands-on experience with Databricks, Apache Spark, PySpark, Python, and SQL.
• Experience with Azure/AWS, Delta Lake, Unity Catalog, and ETL/ELT.
• Strong knowledge of data modeling, cloud architecture, and CI/CD.
• Excellent communication and problem-solving skills.