Data Engineer

Coforge; Pune District, Hyderabad; Hybrid; INR 800,000 - 1,200,000; Full time

Job summary

Coforge is looking for a Data Engineer in Pune or Hyderabad. The successful candidate will have expertise in Google Cloud Platform, specifically in Big Query Scripting and ETL tools.

The role requires a strong background in Python, SQL, and data engineering principles, including experience with RDBMS and cloud components. GCP certifications will be advantageous.

Qualifications

• GCP Data Engineer certifications is an added advantage.
• Hadoop knowledge, NiFi/Kafka experience.
• Experience with RDBMS.

Responsibilities

• Perform Big Query Scripting or Cloud SQL.
• Utilize ETL tools for data processing.
• Write SQL PL/SQL scripts.
• Work with Linux/Unix systems.
• Lead efforts in Python and Data Flow projects.

Skills

Google Cloud Big Query Scripting

ETL Tools (Talend, Datastage, Informatica, Data Fusion)

SQL PL/SQL Scripting

Linux/Unix Skills

Python

GCP components (GCS, BigQuery, Cloud SQL, PubSub, Dataflow)

Agile lifecycle knowledge

Job description

We have a Data Engineer position open at the Coforge Pune & Hyderabad location.

Role

GCP Data Engineer

Location

Pune / Hyderabad

Responsibilities

1. Mandatory Google Cloud Big Query Scripting or Cloud SQL.
2. Mandatory to have knowledge on any ETL Tool ONLY amongst (Talend, Datastage, Informatica ISS (Cloud version), Data Fusion, Data Flow, Data Proc)
3. Mandatory SQL PL/SQL Scripting Experience
4. Mandatory Linux/Unix Skills.
5. Expert in Python, Data Flow, PubSub, Big Query, CICD
6. Must have good Experience/knowledge on GCP components like GCS, BigQuery, Cloud SQL, PubSub/Kafka, Dataflow and Google Cloud SDK
7. Should have experience on any of the RDBMS.
8. GCP Data Engineer certifications is an added advantage.
9. Hadoop knowledge, NiFi/Kafka experience
10. Strong Scheduler knowledge - Preferable Control M or 1 mandatory compulsory (UC4 Atomic, Airflow Composer, Control M)
11. Must be aware of Agile life cycle.
12. Changes, Incident and Problem Management

Lead Role Responsibilities

• Experts in Python, Data Flow, PubSub, Big Query
• Hadoop knowledge, NiFi/Kafka experience
• Must have good Experience/knowledge on GCP components like GCS, BigQuery, Airflow, Cloud SQL, PubSub/Kafka, Dataflow and Google Cloud SDK
• Understanding of Terraform script, Shell script
• Should have experience on any of the RDBMS

Qualifications

GCP Data Engineer certifications is an added advantage.