ETL Pentaho Developer, AS

DWS Investment; Pune City; On-site; INR 6,00,000 - 10,00,000; Full time

Job summary

An established industry player is seeking an ETL Developer to manage and optimize data integration processes. In this role, you will leverage your expertise in Pentaho Data Integration to design, develop, and implement ETL processes that ensure data quality and consistency across various systems. Collaborating with cross-functional teams, you will lead projects, troubleshoot issues, and document processes to maintain compliance with data governance policies. This position offers a supportive environment with opportunities for training and development, ensuring you can excel in your career while contributing to impactful data solutions.

Benefits

Training and development

Coaching from experts

Culture of continuous learning

Flexible benefits

Qualifications

• Proficiency in Pentaho Data Integration for ETL processes.
• Strong SQL knowledge for data manipulation and querying.

Responsibilities

• Manage and optimize ETL processes using Pentaho tools.
• Ensure data quality and consistency from multiple sources.

Skills

Pentaho Data Integration (PDI)

SQL

Data Warehousing Concepts

ETL Tools (Informatica, Talend, SSIS)

Java

Python

VBA

Data Profiling

Data Analysis

Data Quality Assurance

Tools

Pentaho Tools

ETL Tools

Job description

Responsibilities:

1. Managing and optimizing the ETL (Extract, Transform, Load) processes using Pentaho tools.
2. Development Implementation of ETL processes using Pentaho Data Integration (PDI). This includes creating data pipelines to extract data from various sources, transform it into the required format, and load it into target systems.
3. Ensure seamless integration of data from multiple sources, maintaining data quality and consistency. This involves working with different data formats and structures.
4. Optimize ETL processes for performance and scalability. This includes tuning data transformations and load processes to handle large volumes of data efficiently.
5. Work closely with business analysts, data architects, and other stakeholders to understand data requirements and deliver solutions that meet business requirements.
6. Document ETL processes, data flows, and system architecture. Maintain clear and comprehensive documentation for future reference and troubleshooting.
7. Provide support for ETL processes, including troubleshooting issues and implementing fixes. Ensure data accuracy and integrity throughout the ETL lifecycle.
8. Lead ETL projects, including planning, scheduling, and coordinating tasks. Ensure projects are delivered on time and within scope.
9. Ensure that ETL processes comply with data governance and security policies. Implement measures to protect sensitive data and maintain compliance with relevant regulations.

Your skills and experience:

Technical Skills:

1. Pentaho Data Integration (PDI) proficiency in using Pentaho tools for designing, developing, and managing ETL processes.
2. Strong knowledge of SQL for querying databases and performing data manipulation.
3. Understanding of data warehousing concepts, including data modeling, schema design, and data marts.
4. Experience with other ETL tools like Informatica, Talend, or SSIS can be beneficial.
5. Familiarity with programming languages such as Java, Python, or VBA for scripting and automation.
6. Knowledge of database design, RESTful APIs, and working with various database systems.
7. Skills in data profiling, data analysis, and ensuring data quality.

Experience:

1. Experience in implementing complex ETL projects.
2. Hands-on experience in integrating data from multiple sources and ensuring data consistency and quality.
3. Experience in optimizing ETL processes for performance and scalability.
4. Proven ability to troubleshoot and resolve issues in ETL processes.
5. Experience working with cross-functional teams, including business analysts, data scientists, and other stakeholders.

Soft Skills:

1. Excellent analytical and problem-solving skills to address complex data challenges.
2. Ability to lead and mentor a team of ETL developers, providing guidance and support.
3. Meticulous attention to detail to ensure data accuracy and integrity.
4. Appropriate communication skills to effectively convey technical information to non-technical stakeholders.

How we'll support you:

1. Training and development to help you excel in your career.
2. Coaching and support from experts in your team.
3. A culture of continuous learning to aid progression.
4. A range of flexible benefits that you can tailor to suit your needs.