SAP S/4HANA data extraction, transformation, loading, and processing data cleansing, transformation, validation, and quality checks ETL/ELT processes MySQL data quality management problem solving
Codians is looking for skilled Data Lake Engineers to join our team for a project with a Middle East-based client. The ideal candidates should have hands-on experience in data lake development, support, and enhancement, along with experience integrating data from SAP S/4HANA as the source system.
The selected candidates will be responsible for developing and maintaining data pipelines, supporting existing data lake solutions, troubleshooting technical issues, and implementing enhancements to meet business requirements.
Key Responsibilities
- Develop, maintain, and enhance data lake solutions to support business and analytical requirements.
- Integrate and ingest data from SAP S/4HANA into the data lake environment.
- Develop and maintain data pipelines for data extraction, transformation, loading, and processing.
- Perform data cleansing, transformation, validation, and quality checks.
- Provide production support for existing data lake solutions and resolve technical issues.
- Monitor data pipelines and troubleshoot failures, data inconsistencies, and performance bottlenecks.
- Optimize data processing workflows to improve performance, reliability, and scalability.
- Collaborate with solution architects, data engineers, and business stakeholders to understand technical requirements.
- Implement enhancements to existing data lake platforms based on changing business needs.
- Maintain technical documentation for data pipelines, data integration processes, and support activities.
- Follow best practices for data security, data quality, and data governance.
- Participate in testing, deployment, and post-deployment support activities.
Required Skills and Qualifications
- Approximately 5 years of relevant experience in data engineering or data lake development.
- Strong hands-on experience in Data Lake development, support, and enhancement.
- Experience working with SAP S/4HANA as a source system.
- Good understanding of data ingestion, ETL/ELT processes, and data transformation.
- Experience developing, maintaining, and troubleshooting data pipelines.
- Knowledge of data modelling, data validation, and data quality management.
- Experience resolving production issues and supporting existing data integration solutions.
- Understanding of data processing optimization and performance tuning.
- Strong analytical and problem-solving skills.
- Ability to work collaboratively with technical teams and business stakeholders.
Preferred Skills
- Experience with cloud-based data lake platforms and data engineering technologies.
- Familiarity with SAP S/4HANA data extraction and integration mechanisms.
- Knowledge of SQL and data processing techniques.