Senior Data Engineer

Quest Global; Chennai District; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Quest Global is seeking a Senior Data Engineer in Chennai with 7–10 years of experience in data engineering. You will design scalable data pipelines using Python and SQL, optimize Snowflake, and work on AWS data and AI workloads. Experience with graph databases (Neo4j), vector stores (Milvus) and OpenSearch is preferred.

You will collaborate with cross‑functional teams in an Agile environment, manage code with Git and AzDO, and contribute to data governance initiatives as needed.

Qualifications

• 7–10 years of experience in data engineering or related roles.

Responsibilities

• Design and implement data pipelines and transformations using Python and SQL.
• Work with AWS data and AI workloads.
• Tune Snowflake queries and architecture for performance.
• Incorporate graph and vector databases (Neo4j, Milvus, OpenSearch).
• Collaborate with cross‑functional teams in an Agile environment.
• Maintain code with Git and standard DevOps practices.
• Engage in data governance and compliance as applicable.

Skills

Data engineering

Python

SQL

Analytical skills

Communication

Problem solving

Team collaboration

Agile

Data governance

Education

Bachelor's or Master's in CS/Engineering

Tools

Snowflake

Neo4j

Milvus

OpenSearch

Kafka

Spark Streaming

Git

Azure DevOps (AzDO)

AWS Step Functions

Job description

Role & responsibilities

• 7-10 years of experience in data engineering or related roles.
• Strong hands-on experience with AWS cloud services, including data and AI workloads.
• Deep understanding of Snowflake architecture, performance tuning, and best practices.
• Advanced proficiency in Python and SQL for data pipelines, transformations, and services.
• Hands-on experience with graph databases (e.g., Neo4j, Neptune) and vector databases (e.g., Milvus, Amazon OpenSearch).
• Experience with version control systems (e.g., Git) and Git workflows.
• Experience working with Azure DevOps (AzDO) boards for backlog management in Agile environments.
• Excellent analytical and problem-solving skills.
• Strong communication and collaboration abilities.
• Bachelors or Masters degree in Computer Science, Engineering, or a related field.

Preferred candidate profile

Experience with orchestration tools such as AWS Step Functions.

• Familiarity with data governance and compliance practices.
• Exposure to real-time data processing frameworks (e.g., Kafka, Spark Streaming).