pyspark

Tekskills Inc.; Dadri; Hybrid; INR 1,400,000 - 2,300,000; Full time

Job summary

Tekskills Inc. is seeking a senior data engineer with 4+ years of PySpark and GCP experience to build scalable data pipelines in Hyderabad or Pune. You will own end-to-end data flow, leverage Airflow, Dataproc, and BigQuery, and write advanced SQL to support analytics. Strong communication and ability to deliver under pressure are essential.

The role requires deep ETL tool experience, independent work, and a focus on engineering efficiencies across the BAU execution of data pipelines.

Qualifications

• 3–5+ years of PySpark with GCP, configuring data pipelines (Airflow, Dataproc, BigQuery).
• Strong SQL skills for analytics against SQL Server, Oracle, Hive, etc.
• Proficient in Python, ETL tooling, Unix scripting, and scheduling tools.

Responsibilities

• Design and implement end-to-end data pipelines using PySpark in GCP.
• Develop and optimize SQL queries for large datasets across databases.
• Build reusable ETL components and ensure data quality and SLA adherence.
• Collaborate with global teams; communicate findings clearly and timely.

Skills

PySpark

GCP

SQL

Python

ETL

Unix

Hive

Data Pipelines

Tools

Airflow

Dataproc

BigQuery

Hive

Control-M

Job description

JOB DISCRIPTION

Experience: 4+Years

Location: Hyderabad/pune

Must have skill - Pyspark + GCP - The must-have skills are deep ETL tool experience, PySpark with GCP pipeline expertise, advanced SQL, Python.

Description:

• At least 3-5 years of experience in Pyspark with GCP (Airflow, Dataproc, Big query) capable of configuring data pipelines.
• Strong Experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc.
• Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools)
• Ability to work independently on specialized assignments within the context of project deliverables
• Take ownership of providing solutions and tools that iteratively increase engineering efficiencies.
• Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of Data Pipelines
• Proven problem solving and analytical abilities including the ability to critically evaluate information gathered from multiple sources, reconcile conflicts, decompose high-level information into details and apply sound business and technical domain knowledge
• Communicate openly and honestly. Advanced oral, written and visual communication and presentation skills - the ability to communicate efficiently at a global level is paramount.
• Ability to deliver materials of the highest quality to management against tight deadlines.
• Ability to work effectively under pressure with competing and rapidly changing priorities
• Good to have: experience in any of the ETL tools Prophecy, Datastage 11.5/11.7, Pentaho.. etc.