Senior PySpark Developer

Maplesoft Group; Canada; Remote; CAD 90,000 - 120,000; Full time

Job summary

A tech consulting company in Canada is seeking a Senior PySpark Developer to enhance their pharmaceutical data management system. The role involves developing efficient data pipelines and automating testing processes. Candidates should possess extensive experience in PySpark, Python, and SQL, along with strong problem-solving skills. The company values a diverse workforce and provides an inclusive work environment.

Qualifications

• Extensive experience developing PySpark data pipelines.
• Strong expertise in Python and SQL development.
• Proven experience with automated testing and DevOps practices.
• Ability to manage workload and prioritize tasks.
• Strong analytical skills to translate business requirements.

Responsibilities

• Develop and maintain information systems as part of the technical team.
• Work closely with business partners to support solutions using Python and PySpark.
• Create and execute automated test plans for coverage improvement.
• Document product design and ETL mappings as directed by the IT team.

Skills

PySpark data pipelines

Python

SQL development

Automated testing

DevOps practices

Troubleshooting

Problem-solving skills

Strong communication skills

Job description

Maplesoft implements TimeLive for Electronic time tracking.

Please view the demo below on how to enter and approve time.

Do you want to work in a dynamic environment where your contributions count?

At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our strategic vision. In turn, Maplesoft contributes to the communities where we live and operate. We think globally, but act in our own backyards.

Build your future with Maplesoft’s exciting technologies, deep partnerships, personal approach to consulting services, professional development opportunities and exciting company culture.

Please check to provide consent to receive updates and relevant opportunities on SMS.

If you are interested in any of following job openings, please apply directly to [e-mail] , citing the position titleandjob id in the email subject line.

Senior PySpark Developer – Client

Tasks and Responsibilities include, but are not limited to the following:

Background

• Our client is developing a modernized pharmaceutical data management system designed to efficiently handle large volumes of data ingestion and transformation. The initiative leverages a modern technology stack, updated standards, and improved processes, all within an Agile Scrum delivery framework.

Services

• This Senior Consultant/Developer will work as part of the technical team to develop and maintain information systems. Responsibilities may include the full range of activities from requirements gathering and feasibility analysis to design, coding, testing, quality assurance, implementation, documentation, and ongoing support.

In summary, the main deliverables include:

• Understanding systems and business processes related to assigned products.
• Working closely with business partners to develop, maintain, and support solutions using Python, PySpark, and related tools.
• Providing support and guidance for writing high-quality, clean, and maintainable code while actively participating in peer code reviews.
• Developing, modifying, and executing automated test plans to improve coverage and reduce manual effort.
• Ensuring proper testing and sign-off procedures in accordance with the client's quality assurance framework.
• Promoting and implementing applications in accordance with departmental change management processes.
• Creating or updating documentation related to product design, ETL mappings, and other technical components as directed by the client's IT team.
• Preparing relevant documentation, reports, and presentations related to assigned projects and activities.

The successful candidate must have:

• Extensive experience developing PySpark data pipelines.
• Strong expertise in Python and SQL development.
• Proven experience with automated testing and DevOps practices.
• Ability to manage a heavy workload and effectively coordinate and prioritize multiple tasks.
• Strong analytical skills and the ability to translate business requirements into technical solutions.
• Willingness to perform various tasks as required including development, operations, and support.
• Excellent troubleshooting and problem-solving skills; demonstrating initiative and a positive, team-oriented attitude.
• Strong oral and written communication skills in English.

Recruitment & Diversity

Maplesoft Group is committed to having a diverse, representative workforce and continuing to build an inclusive environment. We encourage applications from all qualified individuals. Maplesoft Group is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants irrespective of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veterans’ status, Aboriginal peoples or any other legally protected factors.

All employment decisions are made based on business needs, job requirements, and individual qualifications. We are committed to developing inclusive, barrier-free recruitment and selection processes, and a work environment that supports our diverse workforce. Please let us know if you require accommodations at any stage of the recruitment process.

Ready to Excel?

Think you’re a great fit for our team? Explore our Job Opportunities page.