Databricks Developer

VSquare Systems Pvt. Ltd.; Bengaluru; On-site; INR 1,200,000 - 2,200,000; Full time

Job summary

VSquare Systems Pvt. Ltd. in Bengaluru is seeking a Data Engineering + Data Modelling Lead to drive end-to-end data initiatives, architect scalable pipelines, and mentor delivery teams.

You will design conceptual, logical, and physical data models, lead ETL/ELT frameworks, optimize Spark workloads, and ensure data quality across enterprise platforms using Databricks, Snowflake, and cloud services. Strong leadership and hands-on expertise in PySpark, SQL, and data governance are essential to

Qualifications

• 6-8 years of experience in Data Engineering, ETL/ELT Development, and Data Modeling.
• Proven experience leading enterprise-scale data initiatives and delivery teams.
• Hands-on with Databricks, Snowflake, PySpark, Spark, and Python for large-scale data pipelines.

Responsibilities

• Lead end-to-end data engineering and data modeling initiatives including requirements gathering, solution design, development, testing, deployment and operational support.
• Develop scalable, high-performance data pipelines using PySpark and Apache Spark for ingestion, transformation, integration and loading across enterprise platforms.
• Define and implement enterprise-wide data models (conceptual, logical, physical) to support business, analytic, and operational needs.
• Design and maintain database schemas, tables, views, indexes and data structures for transactional and analytical workloads.
• Lead development of ETL/ELT frameworks and reusable components for standardized data processing.
• Implement data quality frameworks, profiling, and monitoring to ensure accuracy and reliability.
• Optimize data models, ETL pipelines, and Spark workloads for scalability and performance.
• Document data models, lineage, ETL workflows and metadata clearly.
• Provide technical leadership and mentorship to development teams.

Skills

Data Engineering

ETL/ELT Development

Data Modeling

Leadership

Mentorship

Python

Tools

Databricks

Snowflake

PySpark

Apache Spark

Spark SQL

Python

AWS

Azure

Airflow

Kafka

NiFi

Job description

Job Title: Data Engineering + Data Modelling Lead

Experience: 3-10 Years

Job Responsibilities:

• Lead end-to-end data engineering and data modeling initiatives, including requirements gathering, solution design, development, testing, deployment, andoperational support.
• Develop scalable, high-performance data pipelines using PySpark and Apache Spark for data ingestion, transformation, integration, and loading acrossenterprise platforms.
• Define and implement enterprise-wide conceptual, logical, and physical data models to support business, analytical, and operational requirements.
• Design and maintain database schemas, tables, views, indexes, and data structures that support both transactional and analytical workloads.
• Lead the development of ETL/ELT frameworks and reusable components to ensure efficient and standardized data processing.
• Implement data quality frameworks, validation rules, profiling techniques, and monitoring processes to ensure data accuracy, completeness, consistency, andreliability.
• Optimize data models, ETL pipelines, database performance, and Spark workloads to improve scalability, processing efficiency, and query performance.
• Document data models, data lineage, ETL workflows, metadata, and technical designs in a clear and comprehensive manner.
• Provide technical leadership and mentorship to development teams.

Required Experience & Skills:

• 6-8 years of experience in Data Engineering, ETL/ELT Development, and Data Modeling, with demonstrated experience leading enterprise-scale data initiatives and deliveryteams.
• Strong expertise in Databricks/Snowflake(or similar ETL tools), PySpark, Apache Spark, Spark SQL, and Python for designing, developing, and optimizing high-volume datapipelines and distributed data processing solutions.
• Proven experience in designing Conceptual, Logical, and Physical Data Models, including ER Modeling, Dimensional Modeling, Data Vault, and normalization/denormalizationtechniques.
• Hands-on experience with data lake, data warehouse, and cloud-based data platforms such as Databricks, Snowflake, AWS, or Azure.
• Strong knowledge of relational databases and performance tuning, including Oracle, SQL Server, PostgreSQL, Snowflake, schema design, indexing, and query optimization.
• Experience with data integration and orchestration technologies such as Apache Airflow, Kafka, NiFi, or equivalent enterprise data movement tools.
• Solid understanding of data governance, metadata management, data lineage, and data quality frameworks, with the ability to establish enterprise data standards and bestpractices.