Data Engineer Python & PySpark - Remote

Teamplus Staffing Solution; Indore District, Pune District, Delhi; A distancia; INR 3.000.000 - 3.600.000; Jornada completa

Descripción de la vacante

Teamplus Staffing Solution invites applications for a Data Engineer (Python & PySpark) in a fully remote role. The candidate will work on real-time streaming data using PySpark on Azure Databricks within a UK-hours schedule, collaborating with trading and risk teams.

The ideal candidate has 6+ years in data engineering, strong Python and PySpark expertise, and experience with streaming data, data governance, and scalable architectures. Flexible, remote work with global clients is offered.

Formación

• Bachelor's or Master's degree in CS, Engineering, IT or related field.
• 6+ years of experience in data engineering or data platform development.
• Strong PySpark and Python development skills.

Responsabilidades

• Deliver PySpark-based development against defined requirements.
• Work within an existing Fabric-based architecture and extend pipelines.
• Support optimisation, fixes, and enhancements to data flows.
• Collaborate with trading/ops teams to enable data-driven decisions.
• Contribute to data transformation logic for multiple data flows.
• Ensure security and governance considerations are applied throughout pipelines.

Conocimientos

PySpark

Python

Real-time streaming

Azure Databricks

Educación

Bachelors/Masters

Descripción del empleo

Hi,
We are having opening for Data Engineer Python & PySpark - Remote
Working Hours - Working full-time in UK hours
Skills: Pyspark , azure databricks , real time streaming data

About Company

Were a UK-based talent partner for small to medium sized businesses. We work with clients in the UK, the United States, South Africa, Australia and across Europe, helping them access and enjoy the benefits of global talent.

Role Overview

We would ideally like someone is very tech savvy, has PySpark experience, real time streaming and ideally experience with trading data/ teams.

Position / DesignationData Engineer Python & PySpark - Remote

Qualification

Bachelors or Masters degree in Computer Science, Engineering, Information Technology or a related field, or equivalent practical experience.

Years of Experience

6+ years experience in data engineering/data platform development

Office / Remote / Hybrid

Remote

Gender

Male/Female

Number of post

1

Industry Background

IT

Annual CTC / Salary

Upto 30 to 36 L.p.a

Selection Process

2 Technical round Skills We would ideally like someone is very tech savvy, has PySpark experience, real time streaming and ideally experience with trading data/ teams. The job profile:

Streaming Data Expertise

• Proven experience designing, building, and maintaining real-time data streaming solutions using modern event-driven architectures.
• Strong understanding of low-latency data processing for energy trading, market data feeds, telemetry, and operational systems.

Python & PySpark Proficiency

• Advanced hands-on experience with Python and PySpark for large-scale data engineering, transformation, and analytics workloads.
• Ability to optimize distributed processing pipelines and develop robust, production-grade data solutions.

Business Engagement & Solution Design

• Strong communication and stakeholder management skills with the ability to translate complex business requirements into scalable technical solutions.
• Experience working directly with trading, risk, operations, and business teams to deliver measurable business value.

Data Governance & Medallion Architecture

• Deep understanding of data governance principles, including data quality, lineage, cataloging, security, and compliance.
• Proven experience implementing and managing Medallion Architecture (Bronze, Silver, Gold) to support trusted and scalable analytics platforms.

Security-First Engineering Mindset

• Designs and implements data platforms based on rigorous security principles, including least-privilege access, data protection, auditing, and regulatory compliance.
• Ensures security is embedded throughout the data lifecycle and solution architecture.

Independent Delivery & Ownership

• Self-motivated and capable of working independently with minimal supervision.
• Demonstrates strong ownership, problem-solving ability, and the capacity to drive initiatives from design through implementation and operational support

Scope of Work

• Deliver PySpark-based development against defined requirements
• Work within an existing Fabric-based architecture
• Amend and extend existing pipelines (not building from scratch)
• Support optimisation, fixes, and enhancements
• Contribute to data transformation logic for multiple data flows
• Support export of data to downstream systems

Notice Period immediate to 15 days