Senior Data Engineer

LatentView Analytics Ltd.; Pune District; On-site; INR 2,600,000 - 4,200,000; Full time

Job summary

LatentView Analytics Ltd. in Pune, India, is seeking an experienced Data Engineer to design, build, and optimize scalable data solutions using Snowflake and Microsoft Azure. You will work with large datasets on modern cloud platforms to enable analytics and BI at scale.

The role involves establishing robust ETL pipelines with Azure Data Factory, managing Snowflake data lake, and ensuring governance, security, and performance. Collaboration with analysts and data scientists is essential.

Qualifications

• 5-8 years of experience as a Data Engineer.
• Strong hands-on experience with Snowflake (data modeling, performance tuning, SnowSQL).
• Experience with Microsoft Azure (Azure Data Factory, Azure Synapse, ADLS, Databricks).
• Advanced proficiency in SQL.
• Experience with NoSQL databases (MongoDB, Cassandra, Cosmos DB).
• Strong programming skills in Python.
• Experience with Big Data tools (Spark, Hadoop, Kafka).
• Solid understanding of data warehousing concepts and cloud-native architectures.
• Familiarity with CI/CD pipelines and version control tools (Git).

Responsibilities

• Snowflake Data Lake management and optimization.
• Maintain and optimize Snowflake data lake architecture.
• Implement data governance, security, and access control policies.
• Ensure scalable storage and compute performance.
• Monitor and manage data ingestion pipelines.
• Design and develop ETL pipelines using Azure Data Factory.
• Integrate data from multiple sources (on-prem, cloud, third-party).
• Implement data transformation logic and error handling.
• Schedule and orchestrate data workflows for timely delivery.
• Data Quality & Validation and data integrity monitoring.
• Provide automated alerts for data anomalies.
• Develop and maintain data models for analytics and reporting.
• Write complex SQL queries and work with NoSQL stores.
• Collaborate with data analysts and data scientists to meet requirements.
• Ensure data security, governance, and compliance in cloud environments.
• Troubleshoot and resolve data-related issues across the data platform.

Skills

Snowflake data modeling

SQL proficiency

Python programming

Azure Data Factory

NoSQL databases

Education

5-8 years Data Engineer experience

Tools

Snowflake

Azure Synapse

Azure Data Factory

Databricks

MongoDB

Job description

Job SummaryWe are looking for an experienced Data Engineer with strong expertise in Snowflake and Microsoft Azure to design, build, and optimize scalable data solutions. The ideal candidate will have hands‑on experience working with large datasets, modern cloud data platforms, and big data tools, enabling analytics and business intelligence at scale.

About the Role

We are looking for an experienced Data Engineer with strong expertise in Snowflake and Microsoft Azure to design, build, and optimize scalable data solutions. The ideal candidate will have hands‑on experience working with large datasets, modern cloud data platforms, and big data tools, enabling analytics and business intelligence at scale.

Responsibilities

• Snowflake Data Lake Management
• Maintain and optimize existing Snowflake data lake architecture.
• Implement data governance, security, and access control policies.
• Ensure scalable storage and compute performance.
• Monitor and manage data ingestion pipelines.
• Design and develop robust ETL pipelines using Azure Data Factory.
• Integrate data from multiple sources (on-prem, cloud, third-party).
• Implement data transformation logic and error handling.
• Schedule and orchestrate data workflows for timely delivery.
• Data Quality & Validation
• Define and implement data validation rules.
• Monitor data accuracy, completeness, and consistency.
• Provide automated alerts for data anomalies.
• Develop and maintain data models to support analytics, reporting, and downstream applications
• Write complex and high-performance queries using SQL
• Work with NoSQL databases and integrate data from multiple sources
• Use Python for data transformation, automation, and orchestration
• Implement data quality checks, monitoring, and performance tuning
• Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
• Ensure best practices for data security, governance, and compliance in cloud environments
• Troubleshoot and resolve data-related issues across the data platform

Qualifications

• 5-8 years of experience as a Data Engineer

Required Skills

• Strong hands‑on experience with Snowflake (data modeling, performance tuning, SnowSQL)
• Experience working with Microsoft Azure (e.g., Azure Data Factory, Azure Synapse, ADLS, Databricks)
• Advanced proficiency in SQL
• Experience with NoSQL databases (e.g., MongoDB, Cassandra, Cosmos DB)
• Strong programming skills in Python
• Experience with Big Data tools and frameworks (e.g., Spark, Hadoop, Kafka)
• Solid understanding of data warehousing concepts and cloud-native architectures
• Familiarity with CI/CD pipelines and version control tools (e.g., Git)

Preferred Skills- 3 - 5 years experience in Azure - Snowflake to design, build, and optimize scalable data solutions

Equal Opportunity Statement- We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.