Analyst - Data Engineering

Latent View Analytics Limited; Chennai District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Latent View Analytics Limited is seeking a skilled Data Engineer to design and optimize scalable data architecture within the Investment sector. You will build end-to-end ELT pipelines, enterprise data warehousing, and advanced analytics platforms.

You will leverage a modern data stack—Azure, Snowflake, dbt, Fivetran, ADF, Python, and PySpark—to deliver high‑quality financial data and explore Gen AI solutions to improve insights and automate data workflows.

Qualifications

• 1-3 years of experience in data engineering.
• Strong SQL and data modeling fundamentals.
• Familiarity with modern data stacks.

Responsibilities

• Build and optimize ELT pipelines and data warehousing.
• Work with Azure Data Factory and ADLS for secure data movement.
• Develop Snowflake data models and dbt transformations.
• Experiment with Gen AI tools to enhance data workflows.

Skills

Data Engineering

Tools

Azure

Snowflake

dbt

Fivetran

ADF

Python

PySpark

Job description

We are seeking a highly skilled and visionary Data Engineer to build, and optimize our modern data architecture within the Investment and Wealth Management sector. In this role, you will develop an end-to-end scalable data pipelines, enterprise data warehousing, and advanced analytics platforms.

You will leverage a cutting-edge modern data stack—including Azure, Snowflake, dbt, Fivetran, ADF, Python, and PySpark—to deliver high-quality, actionable financial data. Additionally, you will play a pivotal role in pioneering the integration of Generative AI (Gen AI) solutions to enhance financial insights, automate data workflows, and support intelligent investment strategies.

Job Responsibilities

• Assist in building and maintaining ELT pipelines using tools like Fivetran for data ingestion.
• Work with Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS) to support secure data movement and storage for financial datasets.
• Monitor pipeline runs and help troubleshoot basic issues under senior guidance.

Snowflake & dbt Development

• Contribute to creating and maintaining data models in Snowflake.
• Use dbt to write SQL transformations, add documentation, and perform basic testing.
• Learn version control practices and collaborate with the team to ensure reliable data workflows.

Performance & Cost Awareness

• Support monitoring of pipeline performance and resource usage in Snowflake and Azure.
• Learn how optimization techniques (like clustering or query tuning) can improve efficiency and reduce costs.
• Escalate performance concerns to senior engineers for deeper analysis.

Coding & Framework Contribution

• Use Jinja templating in dbt to create reusable code components.
• Develop Python scripts or PySpark jobs for simpler data processing tasks, with mentorship for more complex work.

AI & Emerging Tools Exploration

• Learn how AI and large language models (LLMs) can be applied in data engineering.
• Assist in experimenting with AI driven tools that support data platform operations.
• Document findings and share with the team to encourage innovation.

Required skills

• 1 - 3 years of experience in Data Engineering

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.