Senior/Lead Data Engineer (Azure Databricks)

Beeu Tech; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

BeeU Tech is seeking a skilled Data Engineer in Bengaluru to drive end-to-end data processing solutions. You will work hands-on with Databricks, PySpark, and Python to design and implement scalable data pipelines.

Collaborate with onsite teams and utilize Azure services for storage, integration, and governance while ensuring performance and reliability. The role requires strong SQL tuning, data ingestion experience, and clear communication with stakeholders.

Qualifications

• Hands-on Databricks experience.
• Proficient PySpark and Python development.
• Experience with Azure cloud services and data storage.
• Strong data ingestion and integration capabilities.
• Expertise in SQL tuning and performance optimization.
• Ability to build scalable data pipelines.

Responsibilities

• Hands-on experience in Databricks.
• Collaborate with onsite team to understand E2E requirements.
• Develop with PySpark and Python for scalable data pipelines.
• Work with Azure services (ADF, ADLS, Blob Storage, Key Vault).
• Handle data ingestion, connectors, and integration frameworks.
• Communicate effectively with stakeholders; data architecture awareness.

Skills

Databricks

PySpark & Python

Azure Cloud Services

Data ingestion & integration

SQL & performance tuning

Data pipelines

Stakeholder management

Data architecture & DWH concepts

Job description

Role & responsibilities

• Hands-on experience in Databricks
• Ability to work with onsite team to colobrate and understand the E2E requirement
• Strong PySpark and Python development experience
• Azure Cloud Services (ADF, ADLS, Azure Blob Storage, Key Vault, etc.)
• Experience with data ingestion, connectors, and integration frameworks
• SQL and performance tuning expertise
• Experience building scalable data pipelines
• Good communication and stakeholder management skills
• Knowledge about data architect and DWH concept these are primary point