Databrick Engineer

Anlage Infotech; Gurugram District, Bengaluru, Pune District; Hybrid; INR 800,000 - 1,500,000; Full time

Job summary

Anlage Infotech is looking for a Databricks Engineer with 3-7 years of experience in data engineering. The ideal candidate should have strong expertise in Databricks on Azure, Python, SQL, and PySpark. The position offers a hybrid work model with 2 days of work from office. A BE/B.Tech/M.C.A./M.Sc (CS) degree is required. The role involves building data ingestion frameworks and working with Lakehouse architecture and Apache Spark technologies.

Qualifications

• 3-7 years of experience in data engineering with Databricks expertise.
• Solid knowledge of Python, SQL, and PySpark.
• Experience with Lakehouse architecture and data quality frameworks.

Skills

Data engineering with Databricks on Azure

Python

SQL

PySpark

Lakehouse architecture knowledge

Education

BE/B.Tech/M.C.A./M.Sc (CS)

Tools

Databricks

Apache Spark

Delta Lake

Job description

Exp - 3-7 years

Level - Consultant/ Senior Consultant

Skill - DataBrick Engineer

Location - Hyderabad/ Pune/ Bangalore

Work model - Hybrid (2 days WFO)

F2F interview on 31st Jan 26 in Hyderabad

Qualifications

Must Have Skills/Project Experience/Certifications:

• 310 years of experience in data engineering with significant Databricks on Azure expertise
• Strong knowledge of Python, SQL, and PySpark (Scala optional)
• Experience building metadata-driven ingestion and data quality (DQ) frameworks using PySpark
• Solid grasp of Lakehouse architecture, Apache Spark, Delta Lake, and other key big data technologies
• Proven team collaboration abilities and excellent problem-solving and analytical skills

Good to Have Skills/Project Experience/Certifications:

• Cloud databases and storage (ADLS Gen2, Azure Key Vault, Cosmos DB, Azure Data Factory, Azure Synapse)
• Data toolsets (data warehouse, data marts, data lake, 3NF, dimensional models)
• Building pipelines using Delta Live Tables, Autoloader, Databricks Workflows, or Apache Airflow
• Databricks Unity Catalog and implementation of fine-grained access control
• Performance tuning in Databricks/Apache Spark

Education:

BE/B.Tech/M.C.A./M.Sc (CS) degree or equivalent from accredited university