Azure Databricks Data Engineer

Rarr Technologies; Bengaluru; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

Rarr Technologies in Bengaluru, Karnataka, seeks an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable data solutions. You will lead robust data pipelines, support data quality, governance, and help advance the data platform.

Collaborate with data engineers and cross‑functional teams to deliver robust integration and transformation solutions, tune Databricks workloads, implement CI/CD for pipelines, mentor juniors, and ensure compliance with security and

Responsibilities

• Design, develop, and lead the implementation of scalable, efficient data pipelines and complex data solutions using Azure Databricks.
• Collaborate with data engineers, architects, and cross-functional teams to understand requirements and deliver robust data integration and transformation solutions.
• Develop and maintain ETL/ELT processes to ensure reliable data flow.
• Optimize Databricks cluster performance, job execution, workload throughput, and costs.
• Monitor data processing workflows to maintain data quality and reliability.
• Use Databricks notebooks for data exploration, analysis, and reporting.
• Mentor and guide junior team members on Databricks best practices and development techniques.
• Ensure compliance with data governance, security, and regulatory standards.
• Participate in architectural discussions and contribute to the data platform roadmap.
• Drive automation and CI/CD processes for Databricks pipelines.
• Stay current with Azure Databricks features and industry best practices.

Job description

We are seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable data solutions. This role leads the implementation of robust data pipelines and integrations, supports data quality and governance, and helps advance the data platform.

Responsibilities

• Design, develop, and lead the implementation of scalable, efficient data pipelines and complex data solutions using Azure Databricks.
• Collaborate with data engineers, architects, and cross-functional teams to understand requirements and deliver robust data integration and transformation solutions.
• Develop and maintain ETL/ELT processes to ensure reliable data flow.
• Optimize Databricks cluster performance, job execution, workload throughput, and costs.
• Monitor data processing workflows to maintain data quality and reliability.
• Use Databricks notebooks for data exploration, analysis, and reporting.
• Mentor and guide junior team members on Databricks best practices and development techniques.
• Ensure compliance with data governance, security, and regulatory standards.
• Participate in architectural discussions and contribute to the data platform roadmap.
• Drive automation and CI/CD processes for Databricks pipelines.
• Stay current with Azure Databricks features and industry best practices.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.