pyspark

Tekskills Inc.; Telangana; Vor Ort; INR 1.200.000 - 1.800.000; Vollzeit

Zusammenfassung

Tekskills Inc. in Hyderabad/Pune invites a data engineering expert with 4+ years of PySpark and GCP experience to build scalable data pipelines and enable analytics at scale.

You will design ETL workflows, write advanced SQL, and work across databases (SQL Server, Oracle, Hive) using Python, PySpark and related tools. Ability to operate independently and deliver under pressure is essential. ETL tooling experience (Prophecy, Datastage, Pentaho) is a plus.

Qualifikationen

• At least 4+ years of experience in PySpark with GCP (Airflow, Dataproc, BigQuery)
• Strong experience writing complex SQL queries for data analysis
• Proficient in SQL, Python, PySpark, Hive, ETL, Unix, Control-M or similar scheduling tools
• Ability to work independently on specialized assignments within project deliverables

Aufgaben

• Design, configure and optimize data pipelines using PySpark and GCP services
• Write and optimize complex SQL queries for analytics across SQL Server, Oracle, Hive
• Develop ETL processes and data workflows with Airflow, Dataproc and related tools
• Contribute to end-to-end data pipeline design, ensuring reliability and scalability
• Communicate progress and issues clearly with global stakeholders under tight deadlines

Kenntnisse

PySpark

GCP

SQL

Python

ETL

Airflow

Dataproc

BigQuery

Hive

Unix

Control-M

Tools

Airflow

Dataproc

BigQuery

Hive

Unix

Control-M

Jobbeschreibung

JOB DISCRIPTION

Experience: 4+Years

Location: Hyderabad/pune

Must have skill - Pyspark + GCP - The must-have skills are deep ETL tool experience, PySpark with GCP pipeline expertise, advanced SQL, Python.

Description:

• At least 3-5 years of experience in Pyspark with GCP (Airflow, Dataproc, Big query) capable of configuring data pipelines.
• Strong Experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc.
• Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools)
• Ability to work independently on specialized assignments within the context of project deliverables
• Take ownership of providing solutions and tools that iteratively increase engineering efficiencies.
• Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of Data Pipelines
• Proven problem solving and analytical abilities including the ability to critically evaluate information gathered from multiple sources, reconcile conflicts, decompose high-level information into details and apply sound business and technical domain knowledge
• Communicate openly and honestly. Advanced oral, written and visual communication and presentation skills - the ability to communicate efficiently at a global level is paramount.
• Ability to deliver materials of the highest quality to management against tight deadlines.
• Ability to work effectively under pressure with competing and rapidly changing priorities
• Good to have: experience in any of the ETL tools Prophecy, Datastage 11.5/11.7, Pentaho.. etc.