Data Engineer

IQVIA; Bengaluru; Hybrid; INR 900,000 - 1,500,000; Full time

Job summary

IQVIA in Bengaluru/Bangalore is seeking a Databricks & Snowflake Developer with strong PySpark, Delta Lake, Snowflake SQL, and Azure Data Engineering skills. You will design, develop, and optimize large-scale data pipelines across Databricks and Snowflake to support analytics and enterprise data initiatives.

The role requires collaboration with data engineers, analysts, architects, and business stakeholders to deliver scalable, cost-efficient cloud data solutions.

Qualifications

• Experience with Databricks and Snowflake development.
• Strong PySpark and Spark SQL knowledge.
• Familiarity with Delta Lake and Azure data services.

Responsibilities

• Develop, optimize, and maintain Databricks notebooks, pipelines and PySpark apps.
• Build and optimize Snowflake solutions with advanced SQL and ELT workflows.
• Design end-to-end ETL/ELT data pipelines across Databricks, Snowflake, ADF and Synapse.
• Integrate data from databases, APIs, and cloud platforms with governance and security.
• Collaborate with stakeholders to translate data needs into technical solutions.

Skills

Databricks

Python

Snowflake

SQL

Job description

Work Experience: 4 to 7 Years

Work location: Bangalore/Gurgaon

Work Mode: Hybrid

Must Have Skills: Databricks, Python, Snowflake, SQL

Job Summary

We are seeking an experienced Databricks & Snowflake Developer with strong expertise in PySpark, Delta Lake, Snowflake SQL, and Azure Data Engineering services. The ideal candidate will design, develop, and optimize large-scale data pipelines across both Databricks and Snowflake platforms to support analytics, reporting, and enterprise data initiatives. This role requires close collaboration with data engineers, analysts, architects, and business stakeholders to deliver scalable, high quality, and cost efficient cloud data solutions.

Key Responsibilities

• Develop, optimize, and maintain Databricks notebooks, workflows, jobs, and scalable PySpark applications, including Delta Lake implementation, performance tuning, and Git-based code management.
• Build and optimize Snowflake solutions using advanced SQL, data ingestion pipelines (Stages, File Formats, COPY, Snowpipe), and automated ELT workflows leveraging Streams, Tasks, and Materialized Views.
• Design, develop, and enhance end-to-end ETL/ELT data pipelines across Databricks, Snowflake, Azure Data Factory, and Synapse, ensuring scalability, performance, and cost efficiency.
• Integrate data from databases, APIs, file systems, and cloud platforms while aligning with enterprise data architecture, data modeling, governance, and security standards.
• Collaborate with business stakeholders to translate data requirements into technical solutions, support BI and analytics initiatives, and deliver high-quality, cost-effective cloud data solutions.
• Troubleshoot and resolve Databricks, Snowflake, and ADF platform issues, perform root cause analysis, maintain documentation, and implement preventive measures to ensure reliable operations.

Technical Skills and Experience

• 2+ years of experience in data engineering, big data development, and cloud-based data platforms.
• Hands-on experience with Databricks, PySpark, Delta Lake, Spark SQL, and Azure Data Engineering services.
• Strong expertise in Snowflake development, including Snowflake SQL, ELT processes, performance tuning, and warehouse optimization.
• Experience building and orchestrating data pipelines using Azure Data Factory (ADF), Synapse, ADLS, and Snowflake integration features.
• Proficiency with Snowflake automation and ingestion capabilities, including Snowpipe, Streams, Tasks, and workflow orchestration.
• Knowledge of data security and governance best practices, including RBAC, masking policies, and access control management.