Data Engineer

EIDIKO Systems Integrators Private Limited; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Eidiko Systems Integrators, headquartered in Hyderabad, India, is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support analytics, AI/ML, and enterprise data solutions.

You will design ETL/ELT pipelines, build Data Lakes and Data Warehouses, integrate data from multiple sources, and enable real-time processing with Spark/Hadoop. Strong SQL and Python/Scala are essential, along with familiarity with cloud data tools.

Qualifications

• Strong SQL and Python/Scala experience for data pipelines.
• Hands-on in design, development, and optimization of ETL/ELT processes.
• Experience building/maintaining Data Lakes, Data Warehouses and data architectures.
• Familiarity with distributed processing frameworks like Spark/Hadoop and data governance practices.

Responsibilities

• Design and develop ETL/ELT pipelines for structured and unstructured data.
• Build and maintain Data Lakes, Data Warehouses, and data architectures.
• Integrate data from multiple internal and external sources.
• Perform data transformation, cleansing, enrichment, and quality checks.
• Develop batch and real-time data processing pipelines.
• Work with Spark/Hadoop and distributed processing tools.
• Support AI/ML pipelines and analytics workloads.
• Implement data governance, security, privacy, and data quality controls.
• Monitor pipelines, troubleshoot failures, and optimize performance.
• Maintain data lineage, metadata, and monitoring.
• Collaborate with DevOps on CI/CD and deployment automation.

Skills

ETL/ELT pipelines

SQL

Python/Scala

Spark/Hadoop

Data Modeling

Data Warehousing

Tools

Azure Data Factory

AWS Glue

Google Dataflow

Databricks

Snowflake

BigQuery

PostgreSQL

MySQL

SQL Server

Airflow

Git

Azure DevOps

Jenkins

Prometheus

Grafana

Job description

Eidiko Systems Integrators, an IBM Premier Business Partner, HeadQuartered in Hyderabad, India with Delivery Centers in UAE, the US and the UK is a preferred implementation partner in Middleware, Content Management, BPM, Mobile, Collaboration and Social Business spaces. Eidiko Systems Integrators have extensive operations in the Middle East, Africa, the US and India, mostly delivering business solutions leveraging IBM technologies.

Url : https://www.eidiko.com/

Notice Period: Immediate or up to 15 days

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and data platforms supporting analytics, AI/ML, and enterprise data solutions.

• Design and develop ETL/ELT pipelines for structured and unstructured data
• Build and maintain Data Lakes, Data Warehouses, and data architectures
• Integrate data from multiple internal and external sources
• Perform data transformation, cleansing, enrichment, and quality checks
• Develop batch and real-time data processing pipelines
• Work with distributed processing frameworks such as Spark/Hadoop
• Support AI/ML pipelines, feature engineering, and analytics workloads
• Implement data governance, security, privacy, and data quality controls
• Monitor pipelines, troubleshoot failures, and optimize performance
• Maintain data lineage, metadata, documentation, and monitoring
• Collaborate with DevOps teams on CI/CD and deployment automation
• Strong SQL and Python/Scala
• Apache Spark / Hadoop
• Data Modeling & Data Warehousing
• Azure Data Factory | AWS Glue | Google Dataflow | Databricks | Snowflake | BigQuery | PostgreSQL | MySQL | SQL Server | Airflow | Git | Azure DevOps | Jenkins | Prometheus | Grafana

Experience in banking/financial services or other regulated industries is an advantage.