Software Engineer II (Python and Data pipelines) - (Remote - US or Canada)

Jobgether; Canada; Remote; USD 80,000 - 120,000; Full time

Job summary

An innovative talent matching platform is seeking a Software Engineer II to design and optimize data pipelines for large-scale applications. In this pivotal role, you will collaborate with machine learning teams and product managers to ensure efficient and reliable data processing. With opportunities to work with cutting-edge technologies like Python, Ruby on Rails, and AWS, this position offers a chance to make a significant impact on the core functionality of products that serve millions of users. If you're passionate about building scalable systems and want to be part of a dynamic team, this role is perfect for you.

Benefits

Healthcare coverage (Medical, Dental, and Vision)

12 weeks of paid parental leave

401k/RSP matching

Home office stipend

Tuition reimbursement

Quarterly wellness stipends

Mental health support

Generous vacation and paid holidays

Flexible sick time

Inclusive company culture

Qualifications

• 4+ years in backend engineering with data pipeline experience.
• Proficient in Ruby or Python and cloud services like AWS.

Responsibilities

• Design and develop data pipelines for metadata processing.
• Collaborate with teams to create scalable metadata solutions.

Skills

Ruby

Python

Data Pipeline Development

Testing and Optimization

Collaboration with Cross-Functional Teams

Education

Bachelor's degree in Computer Science

Tools

AWS

Databricks

ECS

EKS

AWS Lambdas

SQS

Kafka

Kinesis

Job description

Software Engineer II (Python and Data pipelines) - (Remote - US or Canada)

About Jobgether
Jobgether is a Talent Matching Platform that partners with companies worldwide to efficiently connect top talent with the right opportunities through AI-driven job matching.

One of our companies is currently looking for a Software Engineer II (Ruby on Rails and Data Pipelines) in United States or Canada.

As a Software Engineer II, you will play a pivotal role in designing, building, and optimizing data pipelines to process and enrich metadata for large-scale applications. Working closely with machine learning teams, engineers, and product managers, you'll ensure that our systems are efficient, scalable, and reliable. Your contributions will directly impact the way we process and deliver data, supporting the core functionality of our products. You will also have the opportunity to work with cutting-edge technologies such as Python, Ruby on Rails, AWS, and Databricks, while collaborating with cross-functional teams to innovate and improve the systems that support millions of users.

Accountabilities:

• Design and develop data pipelines to extract, enrich, and process vast amounts of metadata from diverse content types.
• Collaborate with machine learning engineers, product managers, and other teams to create efficient and scalable metadata solutions.
• Optimize and refactor existing systems for improved performance, scalability, and reliability.
• Ensure data quality and accuracy by implementing automated validation and monitoring processes.
• Participate in code reviews and maintain high standards for quality and best practices.
• Manage and maintain the infrastructure for data pipelines, ensuring security and operational efficiency.

Requirements:

• 4+ years of experience in backend software engineering, with hands-on experience in developing data pipelines.
• Proficient in one or more programming languages such as Ruby, Python, or similar.
• Experience working with public cloud providers (AWS, Azure, or Google Cloud).
• Hands-on experience with AWS services such as ECS, EKS, or AWS Lambdas.
• Familiarity with queueing and streaming technologies like SQS, Kafka, or Kinesis.
• Experience with large-scale systems, external APIs, and data transformations.
• Strong skills in testing, optimizing, and scaling systems for performance and reliability.
• Bachelor's degree in Computer Science or equivalent professional experience.
• Bonus: Experience working with Machine Learning systems is a plus.

Benefits:

• Competitive salary based on experience and location.
• Healthcare coverage (Medical, Dental, and Vision) fully paid for employees.
• 12 weeks of paid parental leave.
• Short-term and long-term disability plans.
• 401k/RSP matching.
• Home office stipend for peripherals and accessories.
• Tuition reimbursement and Learning & Development programs.
• Quarterly stipends for wellness, connectivity, and comfort.
• Mental health support and resources.
• Free subscription to Scribd + gift memberships for friends and family.
• Referral bonuses and book benefits.
• Sabbatical opportunities.
• Company-wide events and team engagement budgets.
• Generous vacation, personal days, and paid holidays (including winter break).
• Flexible sick time and volunteer day.
• Inclusive company culture with employee resource groups.

Jobgether hiring process disclaimer
This job is posted on behalf of one of our partner companies. If you choose to apply, your application will go through our AI-powered 3-step screening process, where we automatically select the 5 best candidates. Our AI thoroughly analyzes every line of your CV and LinkedIn profile to assess your fit for the role, evaluating each experience in detail. When needed, our team may also conduct a manual review to ensure only the most relevant candidates are considered. Our process is fair, unbiased, and based solely on qualifications and relevance to the job. Only the best-matching candidates will be selected for the next round. If you are among the top 5 candidates, you will be notified within 7 days. If you do not receive feedback after 7 days, it means you were not selected. However, if you wish, we may consider your profile for other similar opportunities that better match your experience. Thank you for your interest!

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology
• Industries: Non-profit Organizations and Primary and Secondary Education

Referrals increase your chances of interviewing at Jobgether by 2x.