Senior Azure Databricks Engineer

Jobtailor; Kolkata District; On-site; INR 1,400,000 - 2,100,000; Full time

Job summary

Jobtailor is seeking a Data Engineer with 3–7 years of experience to lead large-scale data warehousing initiatives. You will design, develop, and deploy data solutions using Azure Synapse and Databricks, focusing on data integration, metadata extraction, and scalable analytics.

You will collaborate with business and technical teams, deliver prototypes and PoCs, and conduct training on data quality standards for partners across regions.

Qualifications

• 3–7 years of practical experience in data warehousing.
• Proven experience with large-scale data warehousing projects.
• Strong SQL and Python (PySpark) skills.
• Experience with Azure Synapse or Databricks.
• Experience in ETL, APIs, and data integration.

Responsibilities

• Lead development of prototypes and PoCs in complex data environments.
• Collaborate with business and technical teams to implement designs.
• Deliver training on data quality standards and processes.

Skills

SQL

Python (PySpark)

Data warehousing

ETL

APIs

NoSQL

Education

B.Sc. in Computer Science or equivalent

Tools

Azure Synapse

Databricks

Job description

Responsibilities

• Participate actively in a team of Engineers and Architects, leading the development of prototypes, conducting proofs of concept, and providing recommendations through the design, development, and/or operation of complex technological environments.
• Collaborate closely with both business and technical resources, meeting requirements with concrete designs and implementing these designs effectively.
• Conduct regular training sessions for our business and technology partners, focusing on enterprise data quality standards, guidelines, and processes.

Requirements

• Proven experience in managing and delivering large-scale data warehousing projects, preferably involving Azure Synapse or Databricks platform.
• Strong SQL and Python(PySpark) skill is must for the role
• Ability to handle metadata extraction and data integration across a range of resources.
• A degree in computer science or a similar field, with between 3-7 years of practical experience.
• At least 3 years of hands‑on experience as a developer/designer, specifically with Databricks PySpark and Azure Synapse.
• Strong ability to solve complex problems at scale.
• Experience in integrating systems using ETL or APIs and designing human task workflows.
• Flexible, self‑motivated approach with strong commitment to problem resolution.
• Excellent written and oral communication skills, with the ability to deliver complex information in a clear and effective manner to a range of different audiences.
• Willingness to work globally and across different cultures, and to participate in all stages of the data solution delivery lifecycle, including pre‑studies, design, development, testing, deployment, and support.
• Data modelling or NoSQL experience will be an added advantage.

Core Competencies

Demonstrates expertise in managing large-scale data warehousing projects, particularly with Azure Synapse and Databricks, while effectively communicating complex information to diverse audiences. Proficient in SQL and Python (PySpark), with a strong focus on data integration, metadata extraction, and problem‑solving at scale.