Data Engineer (PySpark):

The Hiring Club; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A recruitment firm is looking for a Data Analytics professional with over 5 years of experience. Candidates should be highly skilled in SQL and Python, with strong experience in data cleaning and machine learning model development. Familiarity with tools like Hadoop and GCP is essential, alongside adaptability in fast-paced environments. This role is ideal for individuals with a background in banking and financial services data.

Qualifications

• 5+ years of experience in Data Analytics with 2+ years of development experience in PySpark.
• Expertise in SQL and Python for data processing.
• Experience in Data Cleaning, Feature Engineering, ML models.

Skills

Data Analytics

SQL

Python

Data Cleaning

Feature Engineering

Machine Learning Models

Unix

Shell Scripting

Tools

Hadoop

Hive

GitHub

GCP

Job description

5+ years of experience in Data Analytics role with at least 2 years of development experience in PySpark

Very strong in SQL

Expertise in programming with Python with experience in Data Cleaning, Feature Engineering, Transformation and building statistical/ML models.

Experience working on Unix based platforms with basic knowledge of shell scripting, writing Cron jobs etc.

Knowledge of big data ecosystem with knowledge of Hadoop, Hive & GitHub version management

Knowledge of Cloud Computing (GCP), Data Modelling, exposure to Data Quality assessment and control.

Exposure to working on data pertaining to banking and financial services domain

Highly adaptable in quickly changing technical environments with strong organizational and analytical skills