Data Engineer (Azure & Databricks)

Techila Global; Bengaluru; Hybrid; INR 400,000 - 700,000; Full time

Job summary

Techila Global in Bangalore is looking for a Data Engineer (Azure & Databricks) with 8–12 years of experience to design and build scalable data warehouses and lakehouse solutions on Microsoft Azure.

You will lead complex ETL/ELT pipelines, collaborate with architects and data scientists, migrate legacy workloads, and optimize Spark and SQL performance in a hybrid work model across India.

Qualifications

• 8–12 years of data engineering or enterprise data warehousing experience.
• Strong SQL, data modeling (Kimball/Inmon/Data Vault) knowledge.
• Hands-on with PySpark, Databricks, and Azure cloud stack.

Responsibilities

• Design and implement scalable Data Warehousing and Lakehouse on Azure Databricks.
• Build and maintain ETL/ELT pipelines from diverse sources.
• Lead PySpark data transformations and optimize Spark jobs.
• Migrate legacy EDW workloads to Azure/Databricks stack.
• Utilize Azure data services: ADF, ADLS Gen2, Key Vault, Synapse.
• Tune Spark and SQL performance for speed and cost efficiency.
• Lead data engineers, review code, enforce CI/CD practices.

Skills

Azure

Databricks

PySpark

Python

SQL

ETL/ELT

Data Warehousing

Delta Lake

Spark

CI/CD

Tools

Azure Data Factory

Azure Data Lake Storage Gen2

Azure Key Vault

Azure SQL/Synapse

Job description

Hybrid Bangalore 8–10 yrs Apply by Nov 13, 2026Data Engineer (Azure & Databricks)Join Techila's team of Salesforce experts. We build senior-led transformations that deliver measurable outcomes for clients worldwide.Experience8–10 yrsEmployment TypeFull-timeOpenings1 positionApply ByNov 13, 2026 Required SkillsAzure DatabricksJob DescriptionPlease note: candidate should be technically strong as per the given JD & communication skills should be decent.Your future duties and responsibilities Job Title: Data Engineer (Azure & Databricks) Position: LA Experience: 8 to 10 years Category: Software Development / Engineering Shift: General Shift Work Mode: Work from Office / Hybrid (as per business requirement) Primary Location: India, Karnataka, Bangalore CGI Office: Bangalore Employment Type: Full TimeRequired qualifications to be successful in this role About the Role :We are seeking a highly experienced and technically hands on Lead Data Engineer to design, build, and optimize our next generation Enterprise Data Warehouse and data Lakehouse solutions. You will be responsible for leading complex data integration initiatives, migrating legacy workloads, and building highly scalable ETL/ELT pipelines using Python, Databricks, and the Azure Cloud ecosystem. As a technical leader, you will collaborate closely with enterprise architects, business stakeholders, and data scientists to ensure our data infrastructure is robust, secure, and aligned with business objectives.Mandatory Key Responsibilities :. Architecture & Design: Design and implement modern, scalable Data Warehousing and Data Lakehouse architectures on Microsoft Azure using Databricks and Delta Lake. . ETL/ELT Development: Architect, build, and maintain highly efficient data pipelines to ingest, clean, transform, and load massive volumes of data from various sources (relational, non relational, APIs, flat files). . Databricks & PySpark Mastery: Write optimized, production grade PySpark and Python code in Azure Databricks for complex data transformations and advanced analytics. . Legacy Modernization: Lead the migration of legacy Enterprise Data Warehouse (EDW) workloads (e.g., traditional SQL stored procedures, Unix scripts, legacy ETL tools) to a modern Azure/Databricks cloud stack. . Azure Infrastructure: Utilize and orchestrate Azure native services including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Key Vault, and Azure SQL/Synapse. . Performance Tuning: Monitor, troubleshoot, and optimize Spark clusters, SQL queries, and ETL jobs for maximum speed, efficiency, and cost effectiveness. . Leadership & Mentorship: Lead a team of data engineers, conduct code reviews, enforce engineering best practices (CI/CD, automated testing), and guide the team on technical roadblocks.Required Skills & Qualifications. Experience: 10 to 12 years of core experience in Data Engineering, Business Intelligence, or Enterprise Data Warehousing. . Data Warehousing: Deep understanding of data modeling concepts (Kimball, Inmon, Data Vault), schema design (Star/Snowflake), and historical data tracking (SCD Types 1, 2, 3). . ETL/ELT: Extensive background in designing enterprise grade data integration frameworks and orchestrating complex workflows. . Python: Strong programming proficiency in Python (Pandas, core Python, OOP) for data manipulation, automation, and API integration. . Databricks & Spark: 4+ years of hands on experience with Databricks, Apache Spark (PySpark & Spark SQL), and Delta Lake architecture. . Azure Cloud: Proven expertise in the Azure Data ecosystem, specifically Azure Data Factory (ADF) and ADLS Gen2. . Advanced SQL: Expert level SQL skills, capable of writing and tuning highly complex queries, window functions, and migrating legacy stored procedures.Preferred Skills. Experience migrating legacy on premise EDW environments (SQL Server, Teradata, Oracle, Unix Shell scripting) to the cloud. . Experience with CI/CD pipelines and DevOps practices using Azure DevOps, Git, or GitHub Actions. . Understanding of Data Governance, Data Quality frameworks, and compliance standards (e.g., RBAC, Unity Catalog in Databricks).Certifications: Azure Data Engineer Associate (DP 203) or Databricks Certified Data Engineer ProfessionalAt a GlanceWork ModeHybridEmploymentFull-timeExperience8–10 yrsOpenings1LocationBangaloreDeadlineNov 13, 2026[ Hiring process ]What to expectFour stages, typically completed within 2–3 weeks. We respect your time — every stage has a clear purpose and timely feedback.STEP 0130 minScreening CallIntroductory conversation with our talent team to understand your background and motivations.STEP 0260–90 minTechnical RoundLive problem-solving with a senior architect on Salesforce design, integrations, or domain depth.STEP 0345 minCulture FitConversation with practice leadership covering working style, ownership, and how you collaborate.STEP 04Within 5 daysOfferFormal offer with full compensation breakdown, start date, and onboarding plan.