Data Engineer

Edstem Technologies LLC; Thiruvananthapuram; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Edstem Technologies LLC is hiring a Data Engineer based in Trivandrum, Kerala (Work from Office). The role requires 3–7 years of experience in designing, building, and optimizing data pipelines and data infrastructure to power BI and analytics.

Collaboration with software engineering, product, and analytics teams is essential to transform raw data into scalable data assets. Responsibilities include designing ETL/ELT pipelines, data modeling, performance optimization, data quality and governance,

Qualifications

• 3–7 years of hands-on data engineering experience with ETL/ELT pipelines.

Responsibilities

• Pipeline Engineering: Design, build, and maintain robust ETL/ELT pipelines from diverse sources.

Skills

Python

SQL

PySpark

Apache Spark

Data modeling

Data warehousing

Airflow

Prefect

Tools

Snowflake

AWS Redshift

Google BigQuery

Databricks

PostgreSQL

MySQL

NoSQL

AWS

GCP

Azure

Terraform

Docker

Kubernetes

Airflow

Prefect

Job description

Location: Trivandrum, Kerala (Work from Office)

Experience: 3 – 7 Years

Notice Period: Immediate Joiners Preferred

About the Role

We are seeking an experienced and results-driven Data Engineer with 3 to 7 years of expertise in designing, building, and optimizing data pipelines and data infrastructure. Based in Trivandrum, you will work closely with cross-functional software engineering, product, and analytics teams to transform raw data into scalable, high-performance data assets that power business intelligence and advanced analytics.

Location: Trivandrum, Kerala (Work from Office)

Experience: 3 – 7 Years

Notice Period: Immediate Joiners Preferred

About the Role

We are seeking an experienced and results-driven Data Engineer with 3 to 7 years of expertise in designing, building, and optimizing data pipelines and data infrastructure. Based in Trivandrum, you will work closely with cross-functional software engineering, product, and analytics teams to transform raw data into scalable, high-performance data assets that power business intelligence and advanced analytics.

Key Responsibilities

• Pipeline Engineering: Design, construct, and maintain robust, scalable ETL/ELT data pipelines from a wide variety of batch and streaming data sources.
• Architecture & Data Modeling: Create and optimize relational and non-relational data models (Data Warehousing, Data Lakes, Data Marts) tailored for reporting and analytical performance.
• System Optimization: Identify, debug, and resolve pipeline bottlenecks to maximize processing efficiency, query speed, and system reliability.
• Data Quality & Governance: Implement automated data validation, quality monitoring, and tracking mechanisms to ensure end-to-end data integrity and security compliance.
• Agile Collaboration: Participate in sprint planning, technical refinements, and architecture discussions within a cross-functional engineering team.
• Stakeholder Support: Partner with data analysts, data scientists, and business stakeholders to understand data requirements and deliver performant data products.

Requirements & Qualifications

• Experience: 3 to 7 years of hands-on experience in Data Engineering, Data Platform Development, or ETL/ELT pipeline design.
• Core Technical Stack: Advanced proficiency in Python, SQL, and data processing frameworks (e.g., PySpark, Apache Spark).
• Data Warehousing: Solid experience working with modern cloud data platforms (e.g., Snowflake, AWS Redshift, Google BigQuery, or Databricks).
• Database & Cloud Expertise: Strong knowledge of relational (PostgreSQL, MySQL) and NoSQL database systems, along with exposure to cloud infrastructure (AWS, GCP, or Azure).
• Orchestration & Tools: Hands-on experience with workflow orchestration tools such as Apache Airflow or Prefect.
• Location & On-Site Presence: Based in or relocating to Trivandrum.
• Language Proficiency: Excellent command of English and fluency in native Malayalam for seamless internal communication.
• Availability: Immediate joiners or candidates with a short notice period (up to 15 days) preferred.

Nice to Have

• Familiarity with real-time stream processing tools (Apache Kafka, AWS Kinesis).
• Experience with Infrastructure as Code (Terraform) and containerization (Docker, Kubernetes).
• Knowledge of CI/CD practices for data pipelines (Git, automated testing for data).