DATA ENGINEER

Covaicareers.com; Chennai District; Hybrid; INR 2,500,000 - 4,000,000; Full time

Job summary

Covaicareers.com seeks a senior Data Engineer with 8+ years of experience in Google Cloud Platform to design and optimize enterprise-scale data pipelines using Dataflow and BigQuery. The role requires Java development and strong SQL skills in a hybrid setup across Chennai/Bangalore/Pune/Coimbatore.

You will build robust ingestion, validation, and monitoring frameworks while collaborating with analytics and architecture teams to deliver scalable data solutions.

Qualifications

• 8+ years of data engineering experience with cloud platforms.
• Hands-on GCP expertise focusing on Dataflow and BigQuery.
• Strong SQL skills and experience with ETL/ELT pipelines.
• Experience in Java and building scalable data processing applications.
• Familiarity with CI/CD, data governance, and performance tuning.

Responsibilities

• Design and develop scalable batch and real-time data pipelines on GCP.
• Build ETL/ELT workflows using Dataflow and BigQuery.
• Develop data processing apps using Java.
• Implement ingestion, transformation, validation, and monitoring frameworks.
• Collaborate with stakeholders to translate data needs into solutions.
• Ensure performance, security, and reliability of data platforms.
• Optimize BigQuery performance and cost efficiency.
• Participate in code reviews and production support in Agile teams.

Skills

GCP expertise

ETL/ELT processing

SQL

CI/CD

Java

Data pipelines

Analytical thinking

Communication

Tools

Dataflow

BigQuery

Job description

Data Engineer – GCP (8+ Years Experience)

Location: Chennai / Bangalore / Pune / Coimbatore (Hybrid)

Employment Type: Hybrid

About The Role

We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) to design, develop, and optimize scalable data solutions. The ideal candidate should have hands-on experience building enterprise-grade data pipelines using Dataflow, BigQuery, and Java, along with a solid understanding of cloud-based data architectures.

Key Responsibilities

• Design and develop scalable batch and real-time data pipelines on GCP.
• Build and optimize ETL/ELT workflows using Dataflow and BigQuery.
• Develop robust data processing applications using Java.
• Implement data ingestion, transformation, validation, and monitoring frameworks.
• Collaborate with business stakeholders, architects, and analytics teams to understand data requirements.
• Ensure high performance, scalability, security, and reliability of data platforms.
• Optimize BigQuery performance and cost efficiency.
• Participate in code reviews, debugging, troubleshooting, and production support activities.
• Work closely with cross-functional teams in Agile development environments.

Required Skills

• 8+ years of experience in Data Engineering.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Expertise in: Dataflow, BigQuery and Java
• Strong knowledge of ETL/ELT processes and distributed data processing.
• Experience handling large-scale structured and unstructured datasets.
• Knowledge of cloud-native architecture and data warehousing concepts.
• Strong SQL and performance tuning skills.
• Experience with CI/CD pipelines and version control systems.
• Excellent analytical, problem-solving, and communication skills.

Good to Have

• Experience with Pub/Sub, Cloud Composer, or Dataproc.
• Exposure to real-time streaming pipelines.
• Knowledge of DevOps and Infrastructure as Code (IaC).
• Experience in Healthcare or BFSI domains.