Ab Initio Developer (Big Data & Hadoop)

Capgemini; Mississauga; Hybrid; CAD 120,000 - 165,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off

Parental leave

Job summary

Capgemini is seeking an Ab Initio Developer (Big Data & Hadoop) to join the team in Toronto on a hybrid/onsite basis from day one. The candidate should bring 8+ years of IT experience with 5+ years in Big Data and data integration, plus deep Ab Initio expertise and strong programming skills in Python/Java/Scala.

You will design, develop, and support ETL and data pipelines, collaborate with cross-functional teams, and contribute to enterprise data lake initiatives while ensuring performance and

Qualifications

• Bachelor's degree in Computer Science, Engineering, Statistics, Econometrics, Information Systems, or a related quantitative field.
• 10+ years of overall IT experience with at least 5+ years of hands-on experience in Big Data and Data Integration solutions.
• Expert knowledge of Ab Initio technologies, including GDE, Co-Operating System, Control Center, Metadata Hub, EME, EME Portal, Acquire>It, Express>It, Conduct>It, Data Quality Environment, and Query>It.
• Strong experience in designing, developing, and supporting complex ETL and enterprise data integration solutions.
• Hands-on experience with shell scripting, complex SQL development, Hadoop commands, and Git version control.
• Strong programming skills in at least two of Python, Java, and Scala.
• Proven experience developing reusable, scalable, and maintainable code components.
• Experience working with Hadoop ecosystem technologies such as Hive, Spark, Kafka, HBase, and Sqoop.
• Strong understanding of Big Data architectures, Data Lake technologies, and large-scale data processing frameworks.
• Experience in performance tuning, optimization, and troubleshooting of ETL and Big Data applications.
• Familiarity with Hortonworks, ZooKeeper, Oozie, and NoSQL technologies is preferred.
• Ability to quickly learn new technologies and adapt to changing business and technical requirements.
• Excellent analytical, problem-solving, communication, and collaboration skills with the ability to work effectively in a fast-paced Agile environment.

Responsibilities

• Participate in Agile/Scrum ceremonies, sprint planning, design discussions, and development activities.
• Analyze business requirements and translate them into functional and technical specifications.
• Design, develop, test, and support scalable data integration and ETL solutions using Ab Initio.
• Build and maintain enterprise data pipelines supporting the organization's Data Lake and analytics platforms.
• Ensure application quality, performance, scalability, and adherence to development standards.
• Collaborate with architects, data engineers, business analysts, and stakeholders to deliver data-driven solutions.
• Create project estimates and contribute to project planning and delivery discussions.
• Participate in code reviews and promote development best practices.
• Develop reusable and modular components to improve development efficiency and maintainability.
• Troubleshoot production issues and perform performance tuning of ETL and Big Data applications.
• Mentor junior developers and provide technical guidance to team members.
• Support continuous improvement initiatives and adoption of emerging technologies.

Skills

Python/Java/Scala

Agile/Scrum

Analytical & communication

Education

Bachelor's degree in Computer Science or related field

Tools

Ab Initio tools (GDE, Co-Operating System, Control Center, Metadata Hub, EME, EME Portal, Acquire>It, Express>It, Conduct>It, Data Quality Environment, Query>It)

Shell scripting

SQL development

Git version control

Hadoop ecosystem: Hive, Spark, Kafka, HBase, Sqoop

Job description

Position Title : Ab Initio Developer (Big Data & Hadoop)

Location : Toronto, CA (Onsite/Hybrid from Day 1)

Experience : 8+ Years

Employee Type : Full Time with Benefits

Job Description

We are seeking a highly skilled Ab Initio Developer to join our Agile Scrum team and support the development of enterprise-scale Big Data and Data Lake solutions. This role will be responsible for designing, developing, and supporting data integration applications leveraging Ab Initio, Hadoop, and modern Big Data technologies. The ideal candidate will combine strong technical expertise with the ability to collaborate across business and technology teams to deliver high-quality data solutions.

Key Responsibilities

• Participate in Agile/Scrum ceremonies, sprint planning, design discussions, and development activities.
• Analyze business requirements and translate them into functional and technical specifications.
• Design, develop, test, and support scalable data integration and ETL solutions using Ab Initio.
• Build and maintain enterprise data pipelines supporting the organization's Data Lake and analytics platforms.
• Ensure application quality, performance, scalability, and adherence to development standards.
• Collaborate with architects, data engineers, business analysts, and stakeholders to deliver data-driven solutions.
• Create project estimates and contribute to project planning and delivery discussions.
• Participate in code reviews and promote development best practices.
• Develop reusable and modular components to improve development efficiency and maintainability.
• Troubleshoot production issues and perform performance tuning of ETL and Big Data applications.
• Mentor junior developers and provide technical guidance to team members.
• Support continuous improvement initiatives and adoption of emerging technologies.

Mandatory Skills

• Bachelor's degree in Computer Science, Engineering, Statistics, Econometrics, Information Systems, or a related quantitative field.
• 10+ years of overall IT experience with at least 5+ years of hands-on experience in Big Data and Data Integration solutions.
• Expert knowledge of Ab Initio technologies, including Graphical Development Environment (GDE), Co-Operating System, Control Center, Metadata Hub, Enterprise Meta Environment (EME), EME Portal, Acquire>It, Express>It, Conduct>It, Data Quality Environment, and Query>It.
• Strong experience in designing, developing, and supporting complex ETL and enterprise data integration solutions.
• Hands-on experience with shell scripting, complex SQL development, Hadoop commands, and Git version control.
• Strong programming skills in at least two of the following languages: Python, Java, and Scala.
• Proven experience developing reusable, scalable, and maintainable code components.
• Experience working with Hadoop ecosystem technologies such as Hive, Spark, Kafka, HBase, and Sqoop.
• Strong understanding of Big Data architectures, Data Lake technologies, and large-scale data processing frameworks.
• Experience in performance tuning, optimization, and troubleshooting of ETL and Big Data applications.
• Familiarity with Hortonworks, ZooKeeper, Oozie, and NoSQL technologies is preferred.
• Ability to quickly learn new technologies and adapt to changing business and technical requirements.
• Excellent analytical, problem-solving, communication, and collaboration skills with the ability to work effectively in a fast-paced Agile environment.

Good to Have

• Hands-on experience with Big Data technologies including:
• Hadoop, Hive, Spark, Kafka, HBase and Sqoop etc
• Experience working with Data Lake architectures and large-scale analytics platforms.
• Knowledge of Hortonworks, ZooKeeper, Oozie, and NoSQL databases.
• Experience with data modeling, data quality, and performance optimization.
• Familiarity with cloud-based data platforms and modern data engineering practices.
• Understanding of CI/CD processes and DevOps methodologies.

Life At Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.