Data Lake Engineer

Codians

Dadri

Hybrid

INR 1,200,000 - 2,200,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Codians is seeking experienced Data Lake Engineers to join a project with a Middle East-based client. You will develop and maintain data pipelines, integrate SAP S/4HANA data, and ensure data quality across the lake.

The role emphasizes troubleshooting, performance tuning, and collaboration with solution architects and business stakeholders to deliver scalable data solutions. This position requires hands-on development, problem solving, and adherence to data security and governance practices.

Qualifications

  • Approximately 5 years of relevant experience in data engineering or data lake development.
  • Hands-on data lake development, support, and enhancement.
  • Experience integrating data from SAP S/4HANA as source system.
  • Strong knowledge of ETL/ELT, data ingestion, and data transformation.
  • Experience building, maintaining, and troubleshooting data pipelines.
  • Understanding of data quality management and validation.
  • Experience resolving production issues and supporting data integration.
  • Knowledge of performance tuning and data processing optimization.
  • Analytical mindset with problem-solving skills.
  • Ability to collaborate with technical teams and stakeholders.

Responsibilities

  • Develop, maintain, and enhance data lake solutions to support business and analytical needs.
  • Integrate and ingest data from SAP S/4HANA into the data lake environment.
  • Develop and maintain data pipelines for extraction, transformation, loading, and processing.
  • Perform data cleansing, transformation, validation, and quality checks.
  • Provide production support and resolve technical issues.
  • Monitor pipelines, troubleshoot failures, and address data inconsistencies.
  • Optimize processing workflows for performance, reliability, and scalability.
  • Collaborate with architects, data engineers, and stakeholders to meet requirements.
  • Implement enhancements based on changing business needs.
  • Maintain documentation for pipelines and data integration processes.
  • Follow data security, quality, and governance best practices.
  • Participate in testing, deployment, and post-deployment support.

Skills

Data Lake development
ETL/ELT
SAP S/4HANA
Data pipelines
Data quality
Data modelling
Production support
Performance tuning
Analytical skills
Collaboration
SQL
Cloud platforms

Tools

SQL
Cloud platforms

Job description

SAP S/4HANA data extraction, transformation, loading, and processing data cleansing, transformation, validation, and quality checks ETL/ELT processes MySQL data quality management problem solving

Codians is looking for skilled Data Lake Engineers to join our team for a project with a Middle East-based client. The ideal candidates should have hands-on experience in data lake development, support, and enhancement, along with experience integrating data from SAP S/4HANA as the source system.

The selected candidates will be responsible for developing and maintaining data pipelines, supporting existing data lake solutions, troubleshooting technical issues, and implementing enhancements to meet business requirements.

Key Responsibilities
  • Develop, maintain, and enhance data lake solutions to support business and analytical requirements.
  • Integrate and ingest data from SAP S/4HANA into the data lake environment.
  • Develop and maintain data pipelines for data extraction, transformation, loading, and processing.
  • Perform data cleansing, transformation, validation, and quality checks.
  • Provide production support for existing data lake solutions and resolve technical issues.
  • Monitor data pipelines and troubleshoot failures, data inconsistencies, and performance bottlenecks.
  • Optimize data processing workflows to improve performance, reliability, and scalability.
  • Collaborate with solution architects, data engineers, and business stakeholders to understand technical requirements.
  • Implement enhancements to existing data lake platforms based on changing business needs.
  • Maintain technical documentation for data pipelines, data integration processes, and support activities.
  • Follow best practices for data security, data quality, and data governance.
  • Participate in testing, deployment, and post-deployment support activities.
Required Skills and Qualifications
  • Approximately 5 years of relevant experience in data engineering or data lake development.
  • Strong hands-on experience in Data Lake development, support, and enhancement.
  • Experience working with SAP S/4HANA as a source system.
  • Good understanding of data ingestion, ETL/ELT processes, and data transformation.
  • Experience developing, maintaining, and troubleshooting data pipelines.
  • Knowledge of data modelling, data validation, and data quality management.
  • Experience resolving production issues and supporting existing data integration solutions.
  • Understanding of data processing optimization and performance tuning.
  • Strong analytical and problem-solving skills.
  • Ability to work collaboratively with technical teams and business stakeholders.
Preferred Skills
  • Experience with cloud-based data lake platforms and data engineering technologies.
  • Familiarity with SAP S/4HANA data extraction and integration mechanisms.
  • Knowledge of SQL and data processing techniques.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

CCS Technologies (P) Ltd. • Ernakulam

On-site
INR 1,500,000 - 2,300,000
Data Lake Solution Architect
Data Lake Solution Architect

Codians • Dadri

On-site
INR 800,000 - 1,100,000
Senior Data Engineer
Senior Data Engineer

R Systems • India

On-site
INR 800,000 - 1,200,000
Lead Data Engineer
Lead Data Engineer

R Systems • India

On-site
INR 1,500,000 - 2,000,000
Senior Data Engineer
Senior Data Engineer

Diggibyte Technologies Private Limited • Bengaluru, Ahmedabad District

On-site
INR 1,000,000 - 1,500,000
Data Engineer - Freelancer
Data Engineer - Freelancer

VVV Infotech Pvt. Ltd. • India

On-site
INR 700,000 - 1,200,000
Sr Developer, ETL Data Development
Sr Developer, ETL Data Development

AGCO Corporation • Bengaluru

On-site
INR 1,500,000 - 2,000,000
Health care and wellness plans
Flexible and virtual work options
Data Engineer - BODS
Data Engineer - BODS

Weekday AI • Pune District

On-site
INR 2,800,000 - 4,200,000
Data Engineer
Data Engineer

Scaletrix.AI • Gurugram District

On-site
INR 1,200,000 - 1,800,000
Sr Data Engineer
Sr Data Engineer

The Versatile Club • India

Remote
INR 1,500,000 - 2,500,000