Data Engineer

Yuga Forge Tech; India; Presencial; INR 900.000 - 1.300.000; Jornada completa

Descripción de la vacante

Yuga Forge Tech is seeking a Data Engineer to design, build, and maintain reliable data pipelines across multiple sources. You will partner with software engineers and analysts to deliver scalable data solutions that power analytics and business applications.

Responsibilities include optimizing SQL queries, implementing data quality checks, and ensuring secure data handling. The role emphasizes collaboration, documentation, and continuous improvement of data platforms.

Formación

• Proficient in SQL with advanced joins and window functions.
• Experience in Python for data extraction, transformation, and automation.
• Hands-on experience building and maintaining production data pipelines.
• Knowledge of relational databases, data warehousing, and dimensional modelling.

Responsabilidades

• Design, develop, and maintain ETL/ELT pipelines across databases, APIs, files, and external systems.
• Build data models and transformation workflows for downstream applications.
• Implement data validation, quality checks, monitoring, and error handling.

Conocimientos

SQL

Python

ETL/ELT pipelines

Data modeling

REST APIs

Git & deployment

Problem-solving

Herramientas

Snowflake

BigQuery

Airflow

dbt

Spark

Descripción del empleo

We’re looking for a Data Engineer to build and maintain reliable data pipelines, integrate data from multiple systems, and develop datasets that support analytics, reporting, and business applications.

You’ll work closely with software engineers, analysts, and business stakeholders to understand data requirements and deliver solutions that are accurate, scalable, and maintainable.

Key responsibilities

• Design, develop, and maintain ETL/ELT pipelines across databases, APIs, files, and external systems.
• Build and manage data models, transformation workflows, and datasets for downstream applications.
• Implement data validation, quality checks, monitoring, and error handling.
• Optimize SQL queries, pipeline performance, and storage costs.
• Investigate data discrepancies, troubleshoot failures, and maintain reliable processing.
• Follow security and access-control requirements when handling data.
• Document data sources, schemas, transformations, and operational procedures.

Required skills

• Strong SQL skills, including joins, window functions, and query optimization.
• Proficiency in Python for data extraction, transformation, and automation.
• Practical experience building and supporting production data pipelines.
• Working knowledge of relational databases, data warehousing, and dimensional modelling.
• Experience integrating REST APIs and processing structured and semi-structured data, including JSON and CSV.
• Familiarity with Git, testing, logging, and deployment workflows.
• Strong problem-solving skills and the ability to communicate technical concepts clearly.

Good to have

• Experience with AWS, Azure, or Google Cloud.
• Exposure to platforms such as Snowflake, BigQuery, Redshift, or Databricks.
• Familiarity with Airflow, dbt, Spark, or equivalent tools.
• Experience with streaming data, Kafka, or change data capture.
• Exposure to IoT, telemetry, or enterprise system integrations.