Ab Initio Developer (Big Data & Hadoop)

United States Digital Space LLC; Toronto; On-site; CAD 88,786 - 95,298; Full time

Benefits offered by this job

Paid time off

Health insurance

RRSP/401(k)

Job summary

United States Digital Space LLC seeks an experienced Ab Initio Developer (Big Data & Hadoop) to design, develop, and support enterprise-scale data integration solutions. The role requires expertise with Ab Initio technologies, Hadoop ecosystem, and large-scale ETL architectures.

Based in Toronto, this onsite/hybrid role collaborates with cross-functional teams to deliver data-driven solutions and drive continuous improvement across data platforms.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Statistics, Econometrics, Information Systems, or related field.
• 10+ years IT experience with 5+ years in Big Data and data integration.
• Expert Ab Initio knowledge: GDE, Co-Operating System, Control Center, EME, Acquire>It, Query>It.
• Experience designing and supporting complex ETL and data integration solutions.
• Hands-on with shell scripting, SQL, Hadoop commands, and Git.
• Programming in Python, Java, or Scala.
• Experience with Hadoop ecosystem: Hive, Spark, Kafka, HBase, Sqoop.
• Strong understanding of Big Data architectures and Data Lake tech.
• Performance tuning and troubleshooting ETL/Big Data apps.
• Familiarity with Hortonworks, ZooKeeper, Oozie, and NoSQL preferred.

Responsibilities

• Participate in Agile/Scrum ceremonies, sprint planning, design discussions, and development.
• Analyze business requirements and translate into specs.
• Design, develop, test, and support scalable ETL and data integration using Ab Initio.
• Build and maintain data pipelines for Data Lake and analytics.
• Ensure quality, performance, and adherence to standards.
• Collaborate with architects, data engineers, and stakeholders to deliver data-driven solutions.
• Create project estimates and assist in planning.
• Mentor junior developers and promote best practices.
• Troubleshoot production issues and perform performance tuning.
• Support continuous improvement and adoption of new technologies.

Skills

Ab Initio

Big Data

ETL

Shell scripting

SQL

Hadoop

Python

Java

Scala

Data Lake

Hive

Spark

Kafka

HBase

NoSQL

Sqoop

Oozie

ZooKeeper

GDE

Acquire>It

Express>It

Data Quality Environment

Education

Bachelor's degree in CS or related

Tools

Ab Initio GDE

Co-Operating System

Control Center

Metadata Hub

EME

Acquire>It

Express>It

Conduct>It

Data Quality Environment

Query>It

Hadoop

Hive

Spark

Kafka

HBase

Sqoop

Oozie

ZooKeeper

NoSQL

Job description

Choosing the company means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Job Location

Toronto, CA (Onsite/Hybrid from Day 1)

Job Description

We are seeking a highly skilled Ab Initio Developer (Big Data & Hadoop) to join our Agile Scrum team and support the development of enterprise‑scale Big Data and Data Lake solutions. This role will be responsible for designing, developing, and supporting data integration applications leveraging Ab Initio, Hadoop, and modern Big Data technologies. The ideal candidate will combine strong technical expertise with the ability to collaborate across business and technology teams to deliver high‑quality data solutions.

Key Responsibilities

• Participate in Agile/Scrum ceremonies, sprint planning, design discussions, and development activities.
• Analyze business requirements and translate them into functional and technical specifications.
• Design, develop, test, and support scalable data integration and ETL solutions using Ab Initio.
• Build and maintain enterprise data pipelines supporting the organization's Data Lake and analytics platforms.
• Ensure application quality, performance scalability, and adherence to development standards.
• Collaborate with architects, data engineers, business analysts, and stakeholders to deliver data‑driven solutions.
• Create project estimates and contribute to project planning and delivery discussions.
• Participate in code reviews and promote development best practices.
• Develop reusable and modular components to improve development efficiency and maintainability.
• Troubleshoot production issues and perform performance tuning of ETL and Big Data applications.
• Mentor junior developers and provide technical guidance to team members.
• Support continuous improvement initiatives and adoption of emerging technologies.

Mandatory Skills

• Bachelor’s degree in Computer Science, Engineering, Statistics, Econometrics, Information Systems, or a related quantitative field.
• 10+ years of overall IT experience with at least 5+ years of hands‑on experience in Big Data and Data Integration solutions.
• Expert knowledge of Ab Initio technologies, including Graphical Development Environment (GDE), Co‑Operating System, Control Center, Metadata Hub, Enterprise Meta Environment (EME), EME Portal, Acquire>It, Express>It, Conduct>It, Data Quality Environment, and Query>It.
• Strong experience in designing, developing, and supporting complex ETL and enterprise data integration solutions.
• Hands‑on experience with shell scripting, complex SQL development, Hadoop commands, and Git version control.
• Strong programming skills in at least two of the following languages: Python, Java, and Scala.
• Proven experience developing reusable, scalable, and maintainable code components.
• Experience working with Hadoop ecosystem technologies such as Hive, Spark, Kafka, HBase, and Sqoop.
• Strong understanding of Big Data architectures, Data Lake technologies, and large‑scale data processing frameworks.
• Experience in performance tuning, optimization, and troubleshooting of ETL and Big Data applications.
• Familiarity with Hortonworks, ZooKeeper, Oozie, and NoSQL technologies is preferred.

Good to Have

• Hands‑on experience with Big Data technologies including: Hadoop, Hive, Spark, Kafka, HBase and Sqoop etc.
• Experience working with Data Lake architectures and large‑scale analytics platforms.
• Knowledge of Hortonworks, ZooKeeper, Oozie, and NoSQL databases.
• Experience with data modeling, data quality, and performance optimization.
• Familiarity with cloud‑based data platforms and modern data engineering practices.
• Understanding of CI/CD processes and DevOps methodologies.

Compensation Range

The base compensation range for this role in the posted location is: 88786 – 95298.

Benefits

The company offers a comprehensive, non‑negotiable benefits package to all regular, full‑time employees. In the U.S. and Canada, available benefits are determined by local policy and eligibility and may include:

• Paid time off based on employee grade (A‑F), defined by policy: Vacation 12‑25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs
• Other benefits as provided by local policy and eligibility

Important Notice

Compensation (including bonuses, commissions, or other forms of incentive pay) is not considered earned, vested, or payable until it becomes due under the terms of applicable plans or agreements and is subject to the company’s discretion, consistent with applicable laws. The Company reserves the right to amend or withdraw compensation programs at any time, within the limits of applicable legislation.

Disclaimers

The company is an Equal Opportunity Employer encouraging inclusion in the workplace. The company also participates in the Partnership Accreditation in Indigenous Relations (PAIR) program which supports meaningful engagement with Indigenous communities across Canada by promoting fairness, accessibility, inclusion and respect. We value the rich cultural heritage and contributions of Indigenous Peoples and actively work to create a welcoming and respectful environment. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

Accommodation and Accessibility

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, the company will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodation does not pose an undue hardship. The company is committed to providing reasonable accommodation during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Contact and Privacy

Please be aware that the company may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.

Additional Resources

Click the following link for more information on your rights as an Applicant in the United States. http://www.the company.com/resources/equal-employment-opportunity-is-the-law

Company Overview

The company is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55‑year heritage, the company is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end‑to‑end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market‑leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.