Data Engineer

Covasant Technologies; Hyderabad; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Covasant Technologies is seeking a Data Engineer in Hyderabad (On-site) with 2-3 years of hands-on experience to design and maintain robust data pipelines, ETL/ELT processes, and analytics-ready datasets. You will work with Python, SQL, data warehousing concepts, and tools like Apache Airflow, Spark, and cloud data stores to deliver high-quality data for business insights.

Collaborate with analysts and data scientists, document best practices, and optimize pipeline performance while ensuring

Qualifications

• Proficient in building data pipelines and ETL/ELT processes.
• Strong SQL skills including window functions.
• Experience with data warehouses and data lakes.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and SQL.
• Build and manage ETL/ELT workflows from multiple sources.
• Write optimized SQL for data extraction and analytics.
• Develop data integration from databases, APIs, files, and more.
• Perform data cleaning, validation, and quality checks.
• Monitor pipelines, troubleshoot failures, and resolve data issues.
• Optimize pipeline performance and query efficiency.
• Collaborate with analysts/scientists/business teams on data needs.
• Maintain technical documentation and best practices.

Skills

Python

SQL

Data warehousing

ETL/ELT

Data quality

Git

Tools

Apache Airflow

Spark / PySpark

Snowflake

Redshift

BigQuery

Docker

Job description

Role: Data Engineer

Experience: 2-3 Years

Location: Hyderabad(On-site_5-Days)

About the Role:

We are looking for a skilled Data Engineer with 23 years of hands-on experience in developing, building, and maintaining data pipelines and ETL/ELT processes. The ideal candidate should have strong knowledge of Python, SQL, data warehousing, and data processing technologies, with the ability to transform raw data into reliable, high-quality datasets for analytics and reporting.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and SQL.
• Build and manage ETL/ELT workflows to extract, transform, and load data from multiple sources.
• Write optimized SQL queries for data extraction, transformation, and analysis.
• Develop data integration solutions from databases, APIs, files, and other sources.
• Perform data cleaning, validation, transformation, and quality checks.
• Monitor data pipelines, troubleshoot failures, and resolve data-related issues.
• Optimize pipeline performance and database query efficiency.
• Work with data warehouses and data lakes to support reporting and analytics.
• Collaborate with data analysts, data scientists, and business teams to understand data requirements.
• Maintain technical documentation and follow data engineering best practices.

Required Skills

• 23 years of experience in Data Engineering or a related role.
• Strong programming skills in Python.
• Good knowledge of SQL, including joins, subqueries, CTEs, and window functions.
• Hands-on experience with ETL/ELT pipelines and data transformation.
• Understanding of relational databases such as MySQL or PostgreSQL.
• Familiarity with data warehousing concepts, dimensional modeling, and database design.
• Experience with data formats such as CSV, JSON, and Parquet.
• Knowledge of data quality, data validation, and error handling.
• Familiarity with Git and version control.
• Good analytical, problem-solving, and communication skills.

Preferred Skills

• Exposure to cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
• Familiarity with Apache Spark or PySpark.
• Knowledge of orchestration tools such as Apache Airflow.
• Exposure to cloud data warehouses such as Snowflake, Amazon Redshift, or Google BigQuery.
• Basic understanding of Docker and CI/CD pipelines.
• Familiarity with Agile/Scrum methodologies.