Data Engineer

Eidiko Systems Integrators; Hyderabad; On-site; INR 2,500,000 - 3,500,000; Full time

Job summary

Eidiko Systems Integrators is seeking a seasoned Data Engineer to design, build, and maintain scalable data pipelines and platforms that power analytics, AI/ML, and enterprise data solutions. You will work on ETL/ELT pipelines, data lakes, warehouses, and integrate data across multiple sources.

The role requires 8+ years of experience, strong SQL and Python/Scala skills, and hands-on experience with Spark/Hadoop and cloud data platforms.

Qualifications

• 8+ years of experience in data engineering or a related field.
• Strong SQL and Python/Scala programming.
• Experience with Spark/Hadoop, data lakes and data warehouses, and cloud data platforms.

Responsibilities

• Design and implement ETL/ELT pipelines for structured and unstructured data.
• Develop and maintain Data Lakes, Data Warehouses, and data architectures.
• Integrate data from multiple internal and external sources.
• Perform data cleansing, transformation, and quality checks.
• Build batch and real-time data processing pipelines.
• Work with Spark/Hadoop and distributed processing frameworks.
• Support AI/ML pipelines, feature engineering, and analytics workloads.
• Implement data governance, security, privacy, and data quality controls.
• Monitor pipelines, troubleshoot failures, and optimize performance.
• Maintain data lineage, metadata, and documentation.
• Collaborate with DevOps on CI/CD and deployment automation.

Skills

Data Engineering

ETL/ELT

SQL

Python/Scala

Apache Spark/Hadoop

Data Modeling

Data Warehousing

Cloud Platforms

Kafka

Data Governance

Data Quality

Tools

Azure Data Factory

AWS Glue

Databricks

Snowflake

BigQuery

PostgreSQL

MySQL

SQL Server

Airflow

Git

Azure DevOps

Jenkins

Prometheus

Grafana

Job description

Hiring: Data Engineer | AI & Data Engineering

Location: Hyderabad

Experience: 8+ years

Work Mode: WFO

Notice Period: Immediate or up to 15 days

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and data platforms supporting analytics, AI/ML, and enterprise data solutions.

Key Responsibilities:

• Design and develop ETL/ELT pipelines for structured and unstructured data
• Build and maintain Data Lakes, Data Warehouses, and data architectures
• Integrate data from multiple internal and external sources
• Perform data transformation, cleansing, enrichment, and quality checks
• Develop batch and real-time data processing pipelines
• Work with distributed processing frameworks such as Spark/Hadoop
• Support AI/ML pipelines, feature engineering, and analytics workloads
• Implement data governance, security, privacy, and data quality controls
• Monitor pipelines, troubleshoot failures, and optimize performance
• Maintain data lineage, metadata, documentation, and monitoring
• Collaborate with DevOps teams on CI/CD and deployment automation

Required Skills:

• Data Engineering & ETL/ELT
• Strong SQL and Python/Scala
• Apache Spark / Hadoop
• Data Modeling & Data Warehousing
• Data Lakes
• Cloud Data Platforms Azure / AWS / GCP
• Kafka / Azure Event Hubs
• Relational & NoSQL databases
• Data Governance & Data Quality
• Performance Optimization & Troubleshooting

Preferred Tools:

Azure Data Factory | AWS Glue | Google Dataflow | Databricks | Snowflake | BigQuery | PostgreSQL | MySQL | SQL Server | Airflow | Git | Azure DevOps | Jenkins | Prometheus | Grafana

Experience in banking/financial services or other regulated industries is an advantage.

Preferred Certifications:

Azure Data Engineer Associate | AWS Data Analytics | Google Professional Data Engineer | Databricks Certification