Data Engineer

Waisl Ltd; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Waisl Ltd in Bengaluru, Karnataka, is seeking a Data Engineer to design, build, and maintain scalable data pipelines that feed clean, reliable data to data scientists and ML models.

You will work with large-scale data lakes/warehouses, ETL/ELT processes, and data governance to ensure quality, performance, and cost efficiency. Collaboration with data architects and developers is essential.

Qualifications

• Bachelor’s or Master’s in Computer Science or a related field.
• 3+ years of experience in a Data Engineer role.
• Expert-level proficiency in SQL and experience with big data technologies (e.g., Spark, Hadoop, Kafka).
• Strong programming skills in Python, Scala, or Java.
• Experience with cloud data services (e.g., AWS Redshift/S3, Azure Synapse/Data Lake, GCP BigQuery).
• Knowledge of data modeling and data warehousing concepts.

Responsibilities

• Design, construct, install, and maintain large-scale data processing systems and data lakes/warehouses.
• Build scalable and reliable ETL/ELT pipelines to ingest data from diverse sources.
• Ensure data quality and implement data governance and security standards.
• Collaborate with Data Scientists to understand data requirements for modeling.
• Optimize data systems for performance and cost.
• Work with data architecture on data modeling and schema design.

Skills

SQL

Spark

Hadoop

Kafka

Python

Scala/Java

Cloud data services

Data modeling

Data warehousing

Education

Bachelor or Master in Computer Science

Tools

AWS Redshift/S3

Azure Synapse/Data Lake

GCP BigQuery

Job description

Data Engineer

Role Summary:

The Data Engineer is the foundation of the AI CoE. You build and maintain the robust, scalable, and efficient data pipelines that feed clean, reliable data to the data scientists and ML models. You ensure that data is accessible, organized, and of high quality.

Key Responsibilities:

• Design, construct, install, and maintain large-scale data processing systems and data lakes/warehouses.
• Build scalable and reliable ETL/ELT pipelines to ingest data from diverse sources.
• Ensure data quality and implement data governance and security standards.
• Collaborate with Data Scientists to understand data requirements for modeling.
• Optimize data systems for performance and cost.
• Work with data architecture on data modeling and schema design.

Qualifications:

• Bachelor’s or Master’s in Computer Science or a related field.
• 3+ years of experience in a Data Engineer role.
• Expert-level proficiency in SQL and experience with big data technologies (e.g., Spark, Hadoop, Kafka).
• Strong programming skills in Python, Scala, or Java.
• Experience with cloud data services (e.g., AWS Redshift/S3, Azure Synapse/Data Lake, GCP BigQuery).
• Knowledge of data modeling and data warehousing concepts.