Sr. Python Data Engineer – Offline Evaluation & PySpark | 7+ Years | Bangalore | Immediate Joiner

UST; Bengaluru; On-site; INR 1,000,000 - 1,800,000; Full time

Job summary

UST is looking for experienced professionals in Python Development and Data Engineering. Candidates with over 7 years of experience in these areas, especially in Offline Evaluation Metrics and scalable ETL data pipelines are encouraged to apply.

The ideal candidate will have strong skills in PySpark, SQL, and data transformation, along with a solid understanding of ML workflows. Immediate joiners are preferred.

Qualifications

• 7+ years of experience in Python Development & Data Engineering.
• Strong hands-on experience in Offline Evaluation Metrics (nDCG, MRR, MAP@K).
• Expertise in PySpark and distributed data processing.
• Experience in building scalable ETL/data pipelines.
• Strong SQL and data transformation skills.

Skills

Python Development

Data Engineering

Offline Evaluation Metrics

PySpark

SQL

Pipeline Automation

Git

Problem-Solving

Tools

AWS

Docker

Kubernetes

Databricks

Job description

Candidates ready to join immediately can share their details via email for quick processing.

[e-mail]

Must-Have Skills

• 7+ years of experience in Python Development & Data Engineering
• Strong hands‑on experience in Offline Evaluation Metrics (nDCG, MRR, MAP@K)
• Expertise in PySpark and distributed data processing
• Experience in building scalable ETL/data pipelines
• Pipeline automation and workflow orchestration experience
• Strong SQL and data transformation skills
• Experience with large‑scale datasets and performance tuning
• Understanding of ML/Recommender System evaluation workflows
• Experience with Git, CI/CD, and production‑grade deployments
• Good problem‑solving and debugging skills

Good‑to‑Have Skills

• Experience with Airflow, Luigi, or Prefect
• Exposure to AWS/GCP/Azure data services
• Knowledge of ML Ops / model evaluation frameworks
• Experience with Databricks or Hadoop ecosystem
• Familiarity with Docker/Kubernetes
• Exposure to recommendation systems or search ranking platforms