Data Engineer

ValueLabs; Hyderabad; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

ValueLabs in Hyderabad is seeking a seasoned Data Engineer with 7+ years of experience to design and build scalable data pipelines and warehousing solutions. You will model data, develop ETL processes and contribute to robust, distributed data systems handling large datasets.

The role requires proficiency in at least one programming language (Python/Java/Scala/NodeJS) and hands-on experience with data engineering best practices, including data quality, monitoring and operational excellence.

Qualifications

• 7+ years of data engineering experience.
• Experience with data modelling, warehousing and ETL pipelines.
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS.
• Experience as a Data Engineer or in a similar role.

Skills

Data engineering

ETL pipelines

Data modelling

Distributed systems

SQL

Programming languages

Tools

AWS Redshift

AWS S3

AWS Glue

EMR

Kinesis

Firehose

Lambda

IAM roles

Airflow

Step Functions

Job description

• 7+ years of data engineering experience
• Experience with data modelling, warehousing and building ETL pipelines
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
• Experience as a Data Engineer or in a similar role

Preferred Qualifications

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
• Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
• 3+ years of SQL experience
• Experience with Airflow, Step functions, any other orchestration frameworks.