Big Data Engineer

Teksystems; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Benefits offered by this job

On-site Hyderabad

Job summary

Teksystems in Hyderabad is seeking a data engineering lead to oversee delivery of data pipelines, review Spark jobs, and mentor engineers. The role requires strong PySpark, Python, and SQL skills with experience in ETL/ELT and data governance. On-site work with immediate start and face-to-face interviews.

The candidate will supervise data quality, safeguard data lineage, and ensure production-ready solutions while collaborating with stakeholders in a fast-paced environment.

Qualifications

• Hands-on delivery oversight: review pipelines, SQL, ETL/ELT logic, Spark jobs, reporting outputs.
• Mentor junior data engineers, analysts and data quality analysts through daily guidance.
• Define validation, reconciliation, anomaly checks, data lineage and issue triage for finance/reporting data.
• Enforce coding standards, documentation and maintainable data solutions.
• Communicate risks, blockers, dependencies to stakeholders clearly.
• Advanced SQL: joins, window functions, validation and troubleshooting.
• Python scripting, data processing, automation and pipeline support.
• ETL/ELT ingestion, transformation, monitoring and error handling.
• Spark: Spark SQL, DataFrames, batch and streaming, tuning basics.
• Scala / PySpark: understanding or developing Spark transformations; Scala preferred when workloads are Scala-based.
• Data modelling, governance, and traceable reporting outputs.

Responsibilities

• Hands-on delivery oversight: review pipelines and Spark jobs and outputs.
• Mentor junior data engineers, analysts and data quality analysts.
• Define data quality controls and lineage for finance/reporting data.
• Enforce coding standards and maintainable data solutions.
• Communicate risks and blockers to stakeholders.

Skills

Pyspark

Python

SQL

Scala

Mentored teammates

Tools

Apache Spark

Job description

Role & responsibilities

Primary Skills : Pyspark, python, SQL, scala, should have led or mentored team mates

CORE RESPONSIBILITIES

• Hands-on delivery oversight: review pipelines, SQL, ETL/ELT logic, Spark jobs, reporting outputs and technical deliverables.
• Mentor junior talent: coach data engineers, data analysts and data quality analysts through daily guidance, reviews and troubleshooting.
• Data quality and controls: define validation, reconciliation, anomaly checks, lineage awareness and issue triage for finance/reporting data.
• Engineering governance: enforce coding standards, documentation, reusable patterns, production-readiness and maintainable data solutions.
• Stakeholder communication: clearly communicate risks, blockers, dependencies and corrective actions to delivery and programme stakeholders.
• SQL: advanced joins, window functions, query tuning, data validation and troubleshooting.
• Python: scripting, data processing, API invocation, automation and pipeline support.
• ETL/ELT: ingestion, transformation, scheduling, monitoring, error handling and operational support.
• Apache Spark: Spark SQL, DataFrames/Datasets, batch pipelines, structured-streaming concepts, partitioning and performance tuning basics.
• Scala / PySpark: ability to understand or develop Spark transformations using Scala or PySpark; Scala hands-on preferred where Spark workloads are Scala-based.
• Data modelling and governance: warehousing basics, quality checks, reconciliation, auditability and traceable reporting outputs.

WFO all 5days

Hyderabad

F2F interview

6+yrs

Immediate only

[e-mail]