Data Engineer_Virtusa

Team Geek Solutions; Hyderabad; On-site; INR 500,000 - 900,000; Full time

Job summary

Team Geek Solutions in Hyderabad, India seeks an experienced Data Engineer to design and optimize scalable ETL/ELT pipelines, supporting batch and real-time ingestion. You will work on data lake/warehouse architectures across Snowflake, BigQuery, and Redshift, collaborating with analytics teams to meet data needs.

The role requires 8+ years in data engineering, strong SQL and Python, and hands-on experience with Airflow, dbt, and cloud platforms (AWS/GCP/Azure).

Qualifications

• 8+ years of experience in data engineering or software with a data focus.
• GCP is mandatory; cloud data platforms experience required.
• Strong SQL and Python proficiency; data modeling abilities.
• Experience with data warehousing tools Snowflake, Redshift, BigQuery.
• Hands-on with orchestration tools such as Airflow and dbt; containerization with Docker/Kubernetes.
• Experience in DevOps or DataOps environments; version control with Git.
• Familiarity with data governance, lineage, and cataloging tools.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines for batch and real-time ingestion.
• Develop and optimize data lake and data warehouse architectures (Snowflake, BigQuery, Redshift).
• Collaborate with analytics and product teams to understand data needs and deliver solutions.
• Ensure data quality, reliability, security, and compliance across all data systems.
• Mentor junior data engineers and contribute to best practices and code reviews.
• Monitor and troubleshoot data pipeline performance and resolve data-related issues.
• Automate data validation, monitoring, and alerting processes.

Skills

ELT

SQL

Python

GCP

Airflow

dbt

Docker

Kubernetes

Git

Data governance

Tools

Snowflake

BigQuery

Redshift

Kafka

Spark Streaming

Flink

Collibra

Alation

Job description

• Design, build, and maintain scalable ETL/ELT pipelines for batch and real-time data ingestion and transformation.
• Develop and optimize data lake and data warehouse architectures (e.g., Snowflake, BigQuery, Redshift).
• Work with cloud platforms GCP, Azure to manage data infrastructure.
• GCP as mandatory skills
• Collaborate with analytics and product teams to understand data needs and deliver solutions.
• Ensure data quality, reliability, security, and compliance across all data systems.
• Mentor junior data engineers and contribute to best practices and code reviews.
• Monitor and troubleshoot data pipeline performance and resolve data-related issues.
• Automate data validation, monitoring, and alerting processes.
• 8+ years of experience in data engineering or software engineering with a data focus.
• Proficient in SQL and at least one programming language (e.g., Python, Scala, Java).
• Experience with modern data warehousing tools (e.g., Snowflake, Redshift, BigQuery).
• Strong understanding of data modeling, data lakes, and ETL/ELT design.
• Hands-on experience with orchestration tools like Airflow, dbt, or similar.
• Solid experience with cloud data platforms (AWS/GCP/Azure).
• Familiarity with CI/CD pipelines, containerization (Docker/Kubernetes), and version control (Git).
• Experience working in a DevOps or DataOps environment.
• Knowledge of data governance, lineage, and cataloging tools (e.g., Collibra, Alation).
• Familiarity with streaming technologies (Kafka, Spark Streaming, Flink).
• Experience supporting machine learning workflows and data science initiatives.

Skills:- ELT, Google BigQuery, Python, Snow flake schema, SQL, Google Cloud Platform (GCP) and Snowflake