Senior Data Engineer

WAISL Limited; Delhi; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

WAISL Limited in Delhi is seeking a Data Engineer to design and maintain scalable data pipelines feeding clean, reliable data to data scientists and ML models. You will build data lakes/warehouses and ETL/ELT processes.

The ideal candidate has a CS degree and 3+ years’ experience with SQL, Spark/Hadoop/Kafka, Python/Scala/Java, and cloud services (AWS, Azure, GCP). Proficiency in data modeling completes the profile.

Qualifications

• Bachelor’s or Master’s in Computer Science or related field.
• 3+ years of experience in a Data Engineer role.
• Expert-level proficiency in SQL and experience with Spark, Hadoop, and Kafka.
• Strong programming skills in Python, Scala, or Java.

Responsibilities

• Design, construct, install, and maintain large-scale data processing systems and data lakes/warehouses.
• Build scalable ETL/ELT pipelines to ingest data from diverse sources.
• Ensure data quality and governance standards.
• Collaborate with Data Scientists to understand data requirements for modeling.
• Optimize data systems for performance and cost.
• Work with data architecture on data modeling and schema design.

Skills

SQL

Spark

Hadoop

Kafka

Python

Scala

Java

Education

Bachelor’s or Master’s in Computer Science

Job description

The Data Engineer is the foundation of the AI CoE. You build and maintain the robust, scalable, and efficient data pipelines that feed clean, reliable data to the data scientists and ML models. You ensure that data is accessible, organized, and of high quality.

Key Responsibilities:

• Design, construct, install, and maintain large-scale data processing systems and data lakes/warehouses.
• Build scalable and reliable ETL/ELT pipelines to ingest data from diverse sources.
• Ensure data quality and implement data governance and security standards.
• Collaborate with Data Scientists to understand data requirements for modeling.
• Optimize data systems for performance and cost.
• Work with data architecture on data modeling and schema design.

Qualifications:

• Bachelor’s or Master’s in Computer Science or a related field.
• 3+ years of experience in a Data Engineer role.
• Expert-level proficiency in SQL and experience with big data technologies (e.g., Spark, Hadoop, Kafka).
• Strong programming skills in Python, Scala, or Java.
• Experience with cloud data services (e.g., AWS Redshift/S3, Azure Synapse/Data Lake, GCP BigQuery).
• Knowledge of data modeling and data warehousing concepts.