Senior Developer - Python / PySpark

United States Digital Space LLC; Toronto; On-site; CAD 80,000 - 130,000; Full time

Benefits offered by this job

Hybrid work options

Job summary

United States Digital Space LLC in Toronto is seeking aSenior Developer with Python, PySpark, and enterprise data engineering to design, develop, and optimize scalable data platforms for Capital Markets.

You will collaborate with stakeholders and engineers to build cloud-native solutions on Azure Databricks, implement data quality and governance, and contribute to CI/CD and DevOps practices.

Qualifications

• Bachelor's degree in CS/Engineering/IT or related field.
• 6+ years of software development and data engineering experience.
• 4+ years of hands-on experience with Python and PySpark.
• Experience building large-scale distributed data processing solutions.
• Experience with cloud-based data platforms and modern data architectures.
• Strong analytical, problem-solving, and communication skills.

Responsibilities

• Design, develop, and maintain scalable data engineering solutions using Python and PySpark.
• Build and optimize enterprise ETL/ELT pipelines for processing large volumes of data.
• Develop high-performance data processing solutions using Spark and Azure Databricks.
• Design and implement reliable data ingestion frameworks for internal and external data sources.
• Develop reusable data transformation, validation, and reconciliation frameworks.
• Collaborate with stakeholders and engineering teams to deliverCapital Markets initiatives.

Skills

Python

PySpark

Apache Spark

SQL

OOP

Data Modeling

Data Warehousing

ETL/ELT development

Batch and real-time processing

Education

Bachelor's degree in Computer Science/Engineering/IT

Tools

Azure Databricks

Azure DevOps

Git

CI/CD pipelines

Unit Testing

Agile/Scrum

Code review

Job description

This role is hybrid and requires you to work from our downtown Toronto office and/or the client office a minimum of four (4) days per week. This requirement is subject to change based on business and client needs.

the company is seeking a highly skilled Senior Developer with expertise in Python, PySpark, and enterprise data engineering to join our Capital Markets technology team.

In this role, you will design, develop, and optimize scalable data engineering solutions that support critical business functions across trading, risk, finance, and regulatory reporting. You will collaborate with business stakeholders, solution architects, and engineering teams to deliver cloud-native data platforms using modern Azure technologies.

If you enjoy solving complex data challenges, building high-performance data pipelines, and working in a fast-paced financial services environment, we'd like to hear from you.

Your future duties and responsibilities

• Design, develop, and maintain scalable data engineering solutions using Python and PySpark.
• Build and optimize enterprise ETL/ELT pipelines for processing large volumes of market, trade, risk, and reference data.
• Develop high-performance data processing solutions using Apache Spark and Azure Databricks.
• Design and implement reliable data ingestion frameworks for internal and external data sources.
• Develop reusable data transformation, validation, and reconciliation frameworks.
• Optimize Spark applications for scalability, reliability, and performance.
• Implement data quality controls, monitoring, and governance best practices.
• Troubleshoot production issues and perform root cause analysis for data pipelines.
• Participate in architecture discussions, solution design, and code reviews.
• Contribute to CI/CD automation, DevOps practices, and release management.
• Collaborate closely with business stakeholders, data architects, analysts, and development teams to deliver strategic Capital Markets initiatives.
• Ensure all solutions comply with enterprise security, governance, and regulatory standards.

Required qualifications to be successful in this role

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline.
• 6+ years of software development and data engineering experience.
• 4+ years of hands-on experience developing applications using Python and PySpark.
• Experience building large-scale distributed data processing solutions.
• Experience working with cloud-based data platforms and modern data architectures.
• Strong analytical, problem-solving, and communication skills.

Technical Skills

Programming & Data Engineering

• Python
• PySpark
• Apache Spark / Spark SQL
• Advanced SQL
• Object-Oriented Programming (OOP)
• Data Structures & Algorithms
• ETL/ELT development
• Data Modeling
• Data Warehousing concepts
• Performance tuning and optimization
• Batch and real-time data processing

Databases

• SQL Server
• Oracle
• PostgreSQL
• Snowflake

Cloud & DevOps

• Azure Databricks
• Azure DevOps
• Git
• CI/CD pipelines
• Unit Testing
• Agile/Scrum methodologies
• Code review best practices

Nice to Have

• Experience working in Capital Markets or Financial Services.
• Experience supporting Trading, Risk, Finance, or Regulatory Reporting platforms.
• Experience with enterprise data governance and data quality frameworks.
• Knowledge of Azure cloud-native services and modern data architecture patterns.

"the company is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $80,000-$130,000. This role is an existing vacancy."

#LI-GS!Together, as owners, let’s turn meaningful insights into action.

Life at the company is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves the company Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At the company, we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all the company partners to thrive. As an equal-opportunity employer, being able to perform your best during the recruitment process is important to us. If you require an accommodation, please inform your recruiter.

That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

To learn more about accessibility at the company, contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our team—one of the largest IT and business consulting services firms in the world.