Data Engineer

Sutherland; Chennai; Remoto; INR 600.000 - 1.200.000; Tempo pieno

Descrizione del lavoro

Sutherland is seeking a Data Engineer to build, optimize, and maintain core data pipelines. You will use Python and SQL to implement ETL/ELT workflows, perform data cleansing, and integrate diverse data sources.

Collaboration with senior engineers and analytics teams is essential to keep data reliable and production-ready. We value strong PostgreSQL skills, experience with Airflow or dbt, and a focus on data quality and documentation.

Competenze

• 2 to 4 years of experience in data engineering or related field.
• Strong proficiency in Python (pandas, SQLAlchemy, requests) and SQL.
• Hands-on experience with PostgreSQL (schema design, indexing, query optimization).
• Experience with ETL/ELT architecture, data staging, and data integration patterns.
• Familiarity with data workflow tools (e.g., Apache Airflow) and transformation frameworks (dbt).
• Version control with Git for code management and collaboration.

Mansioni

• ETL/ELT pipeline development using Python and SQL to move and transform data.
• Database management and SQL optimization in PostgreSQL environments.
• System integration and API ingestion using Python from REST APIs and other sources.
• Data cleansing and transformation with automated Python scripts and SQL.
• Data quality monitoring to detect pipeline failures and schema changes.
• Collaborate with senior engineers and analysts and document pipelines and data models.

Conoscenze

Python

SQL

PostgreSQL

ETL/ELT

REST APIs

Airflow

dbt

Git

Strumenti

PostgreSQL

Docker

Git

Descrizione del lavoro

Job Title: Data Engineer

Shift details - 12.30PM to 09.30PM IST

Work mode - Temporary Remote

Job Summary

We are looking for a Data Engineer with 2 to 4 years of experience to help build, optimize, and maintain our core data pipelines and integrations. In this role, you will leverage Python and SQL / PostgreSQL to build efficient ETL/ELT workflows, perform data cleansing and transformation, and integrate disparate data sources. You will collaborate closely with senior engineers and analytics teams to ensure our data ecosystem remains reliable, structured, and production-ready.

Key Responsibilities

• ETL/ELT Pipeline Development: Design, build, and maintain automated ETL/ELT pipelines using Python and SQL to move and transform data across systems.


• Database Management & SQL Optimization: Write, debug, and optimize complex SQL queries, stored procedures, and views within PostgreSQL environments.


• System Integration & API Ingestion: Use Python to ingest data from REST APIs, third-party applications, operational databases, and flat files.


• Data Cleansing & Transformation: Write automated Python scripts and SQL transformations for data validation, cleansing, parsing, and deduplication.


• Data Quality & Monitoring: Implement data testing and basic monitoring to identify pipeline failures, schema changes, and data quality issues early.


• Collaboration & Documentation: Partner with senior engineers and analysts to deliver clean dataset structures and maintain clear technical documentation for pipelines and data models.

Required Qualifications

• Experience: 24 years of experience in data engineering, data integration, or software engineering focused on data pipelines.


• Core Languages: Strong proficiency in both Python (pandas, SQLAlchemy, request libraries) and SQL.


• Primary Database: Hands-on experience working with PostgreSQL (schema design, indexing, query optimization, window functions).


• Pipeline Concepts: Practical experience with ETL/ELT architecture, data staging, and data integration patterns.


• Data Processing Tools: Experience or familiarity with workflow orchestration tools (e.g., Apache Airflow) or transformation frameworks (e.g., dbt).


• Version Control: Standard use of Git for code management and collaboration.

Preferred / Nice-to-Have Skills

• Exposure to cloud data platforms (AWS, GCP, or Azure).


• Experience with containerization using Docker.


• Experience writing unit tests for Python data pipelines (e.g., pytest).

Soft Skills & Candidate Profile

• High attention to detail with a strong focus on data accuracy and consistency.


• Solid problem-solving ability and eagerness to continuously learn and expand technical skills.


• Effective communication skills to collaborate with technical and non-technical team members.