pyspark

Tekskills Inc.; Bengaluru; Hybrid; INR 900,000 - 1,200,000; Full time

Job summary

Tekskills Inc. is hiring for a data engineering role in Hyderabad/Pune, India. The candidate will work on PySpark with GCP-based pipelines, writing advanced SQL and Python scripts to build and maintain end-to-end data workflows.

Required are 3-5 years of PySpark with GCP experience, strong SQL and ETL knowledge, and familiarity with scheduling tools. The role demands independent work, problem-solving, and clear communication within a global team.

Qualifications

• At least 3-5 years of experience in PySpark with GCP (Airflow, Dataproc, BigQuery) capable of configuring data pipelines.
• Strong experience in writing complex SQL queries to perform data analysis on databases such as SQL Server, Oracle, Hive.
• Proficient in SQL, Python, PySpark, Hive, ETL, Unix, and Control-M (or similar scheduling tools).
• Ability to work independently on specialized assignments within project deliverables.
• Desirable knowledge of ETL tools Prophecy, Datastage 11.5/11.7, Pentaho.

Responsibilities

• Design and implement end-to-end data pipelines using PySpark and GCP services.
• Develop and optimize complex SQL queries for data extraction and analytics.
• Collaborate with teams to ensure reliable scheduling and orchestration of ETL jobs.
• Deliver high-quality data assets and tooling to improve engineering efficiency.
• Adhere to standard processes and operational models for BAU data pipeline execution.

Skills

PySpark

GCP

SQL

Python

ETL

Hive

Unix

Control-M

Tools

Airflow

Dataproc

BigQuery

Datastage

Prophecy

Pentaho

Job description

JOB DISCRIPTION

Experience: 4+Years

Location: Hyderabad/pune

Must have skill - Pyspark + GCP - The must-have skills are deep ETL tool experience, PySpark with GCP pipeline expertise, advanced SQL, Python.

Description:

• At least 3-5 years of experience in Pyspark with GCP (Airflow, Dataproc, Big query) capable of configuring data pipelines.
• Strong Experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc.
• Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools)
• Ability to work independently on specialized assignments within the context of project deliverables
• Take ownership of providing solutions and tools that iteratively increase engineering efficiencies.
• Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of Data Pipelines
• Proven problem solving and analytical abilities including the ability to critically evaluate information gathered from multiple sources, reconcile conflicts, decompose high-level information into details and apply sound business and technical domain knowledge
• Communicate openly and honestly. Advanced oral, written and visual communication and presentation skills - the ability to communicate efficiently at a global level is paramount.
• Ability to deliver materials of the highest quality to management against tight deadlines.
• Ability to work effectively under pressure with competing and rapidly changing priorities
• Good to have: experience in any of the ETL tools Prophecy, Datastage 11.5/11.7, Pentaho.. etc.