Gcp Data Engineer | Walkin Interview

SP Staffing; Hyderabad, Pune District, Chennai District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

SP Staffing is seeking a data engineer to design and maintain scalable data pipelines. You will work with Python and SQL to build ETL workflows, leveraging Apache Beam on Dataflow and GCP services like BigQuery, Cloud Composer, Cloud Spanner and GCS.

Ideal candidates have strong data engineering experience, solid DevOps exposure with Jenkins and Terraform, and familiarity with Kafka for batch and streaming data processing.

Qualifications

• Experience in data engineering using Python and SQL.
• 5+ years in data engineering or related fields.
• Proficiency with GCP data tools and services.

Responsibilities

• Develop data pipelines using Python and SQL.
• Build data processing workflows with Apache Beam on Dataflow.
• Manage data assets via BigQuery, Cloud Spanner and GCS.
• Implement ETL processes and data quality checks.
• Collaborate with DevOps using Jenkins and Terraform; monitor Kafka streams.

Skills

Python

Java

SQL

Tools

Apache Beam

Dataflow

BigQuery

Cloud Composer

Cloud Spanner

GCS

DBT

Jenkins

GitHub

Terraform

Kafka

Job description

Experience:5-10yrs

Work Location : Pune/Hyderabad/Chennai

Job Description:

• - Proficiency in programming languages: Python, Java
• - Expertise in data processing frameworks: Apache Beam (Data Flow)
• - Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT etc.,
• - Data Engineering skillset using Python, SQL
• - Experience in ETL (Extract, Transform, Load) processes
• - Knowledge of DevOps tools like Jenkins, GitHub, Terraform is desirable. Should have good knowledge on Kafka (Batch/ streaming)