Data Engineer

Lorven Technologies Inc.; Chennai District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Lorven Technologies Inc. in Chennai is seeking an experienced Azure Data Engineer with 6+ years of hands-on experience to design, build, and maintain scalable data pipelines on Azure.

Expertise in Python, Apache Spark, Azure Databricks, and Snowflake is essential to deliver robust data processing and transformations. The ideal candidate will implement ETL/ELT pipelines, optimize data workloads, and collaborate with data architects and stakeholders to ensure data quality and governance across

Qualifications

• 6+ years of experience in Data Engineering.
• Strong Python programming.
• Proficient with Spark / PySpark.
• Hands-on with Azure Databricks.
• Snowflake experience is required.
• Experience building ETL/ELT pipelines and data transformations.
• Strong SQL and data transformation skills.
• Experience with large-scale datasets and distributed processing.
• Understanding of Azure cloud data engineering concepts.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on Azure.
• Develop data processing and transformation solutions using Python and Spark.
• Build and optimize data workloads using Azure Databricks.
• Create PySpark applications for large-scale data processing.
• Design ingestion pipelines from multiple sources (structured/unstructured).
• Collaborate with stakeholders to meet data requirements and ensure data quality.

Skills

Data Engineering

Python

PySpark

Azure Databricks

Snowflake

ETL/ELT

SQL

Distributed processing

Azure cloud

Job description

Job DescriptionJob Description – Azure Data Engineer

Job Title: Azure Data Engineer

Experience: 6+ Years

Location: Chennai

Employment Type: Full-Time / FTE

Job Summary We are looking for an experienced Azure Data Engineer with 6+ years of hands‑on experience in designing, developing, and maintaining scalable data engineering solutions using Python, Apache Spark, Azure Databricks, and Snowflake . The ideal candidate should have strong expertise in data processing, ETL/ELT pipelines, data transformation, and cloud‑based data platforms.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on Azure.
• Develop data processing and transformation solutions using Python and Apache Spark .
• Build and optimize data engineering workloads using Azure Databricks .
• Develop PySpark applications for large‑scale data processing and transformation.
• Design and implement data ingestion pipelines from multiple structured and unstructured sources.
• Work with Snowflake for data loading, transformation, data modeling, and performance optimization.
• Implement data integration between Azure Databricks and Snowflake .
• Perform data cleansing, validation, transformation, and quality checks.
• Optimize Spark jobs, Databricks notebooks, SQL queries, and data pipelines for performance and scalability.
• Develop reusable frameworks and components for data processing and ingestion.
• Troubleshoot data pipeline failures, performance issues, and data quality problems.
• Collaborate with Data Architects, Analysts, Developers, and business stakeholders to understand data requirements.
• Follow best practices for data security, governance, monitoring, and operational support.
• Participate in code reviews, technical documentation, testing, and deployment activities.

Mandatory Skills

• 6+ years of experience in Data Engineering
• Python – Strong
• Apache Spark / PySpark – Strong
• Azure Databricks – Strong
• Snowflake – Strong
• Strong experience in ETL/ELT and data pipeline development
• Strong SQL and data transformation skills
• Experience working with large‑scale datasets and distributed data processing
• Good understanding of Azure cloud data engineering concepts