Senior Software Engineer - Open Data Platform (ODP)

The Consensus; Kitchener; On-site; CAD 139,000 - 194,000; Full time

Benefits offered by this job

PTO with unlimited negative balance

RRSP plan

Employer-paid health, dental, vision

Job summary

Acceldata is seeking a Senior Software Engineer with 7+ years in distributed systems or data platform development to design, build, and scale components of the Open Data Platform (ODP). You will work across Hadoop, Spark, Hive, Trino, Kafka, NiFi, MLFlow, Pinot, and related technologies to enable scalable analytics and data operations.

You will mentor engineers, lead code reviews, and collaborate with leadership to drive the platform's strategic direction while contributing to open-source

Qualifications

• Linux proficiency for automation and troubleshooting.
• Familiarity with Kubernetes, Docker, and cloud environments.
• Ability to manage threads and debug deadlocks/memory leaks.
• Garbage collection tuning and management experience.
• Proficient with Java, Scala, or Python and build tools (Maven, Gradle, SBT).
• Experience with GitHub & Nexus and their use cases.
• Strong software engineering, database concepts, virtualization, and architectural patterns.
• Proven track record mentoring junior engineers on critical issues.
• Experience with Big Data stack and relevant frameworks.
• Fluent English communication and collaboration with leadership.

Responsibilities

• Lead design, development, and implementation of complex features for the Open Source Data Platform.
• Architect scalable, high-performance, reliable solutions.
• Mentor junior engineers and foster a culture of learning.
• Drive technology selection and best practices.

Skills

Linux proficiency

Kubernetes

Docker

Java/Scala/Python

GitHub

Nexus

Big data concepts

English fluent

Leadership/mentoring

Collaboration

Open source contribution

Tools

Hadoop

Spark

Hive

Trino

Kafka

NiFi

MLFlow

Pinot

Job description

ABOUT US

Acceldata is the market leader in Enterprise Data Observability. Founded in 2018 and backed by top investors including Insight Partners, March Capital, Lightspeed, Sorenson Ventures, Industry Ventures, and Emergent Ventures, we are a Series-C funded company headquartered in Silicon Valley.

Our Enterprise Data Observability Platform—the first of its kind—helps enterprises build and operate world‑class data products by ensuring data is reliable, trusted, and ready to power today’s most critical technologies, including AI, LLMs, Analytics, and DataOps.

Delivered as a SaaS solution, Acceldata is trusted by leading global organizations such as HPE, HSBC, Visa, Freddie Mac, Manulife, Workday, Oracle, PubMatic, PhonePe (Walmart), Hershey’s, Dun & Bradstreet, and many more.

ABOUT THE ROLE

We are seeking a Senior Software Engineer with at least 7 years of experience in distributed systems or data platform development. In this role, you will design, build, and scale components of the Acceldata Open Data Platform (ODP), contributing to open-source technologies and solving real-world challenges in large-scale data infrastructure.

The Acceldata Open Data Platform (ODP) brings together the best of the modern data ecosystem, including technologies such as Hadoop, Spark, Hive, Trino, Kafka, NiFi, MLFlow, Pinot, and more, to help organizations run complex analytical workloads at scale while maintaining flexibility and avoiding vendor lock‑in.

Product Link: https://www.acceldata.io/open-data-platform

RESPONSIBILITIES

• Lead the design, development, and implementation of complex features for the Open Source Data Platform.
• Architect scalable and robust solutions, ensuring high performance and reliability.
• Mentor and guide junior software engineers, fostering a culture of continuous learning and growth.
• Drive technical discussions and provide expertise in technology selection and best practices.
• Contribute to the strategic direction of the Open Source Data Platform project.
• Perform thorough code reviews, ensuring code quality, maintainability, and adherence to standards.
• Work across diverse environments: Bare Metals, VM, and Kubernetes.

REQUIREMENTS

• Mandatory Linux proficiency for automation and efficient use of Linux shortcuts for troubleshooting.
• Familiarity with Kubernetes, Docker, and cloud environments.
• Ability to manage threads and debug issues related to deadlocks or memory leaks.
• Strong comprehension of garbage collection tuning and management challenges.
• Extensive hands‑on experience with advanced Java, Scala, or Python, developed and prepared project build models associated with Maven, Gradle, or SBT.
• Experienced in Github & Nexus management and its use cases.
• Profound understanding of software engineering, database concepts, virtualisation and architectural patterns.
• Comprehensive knowledge and a history of significant contributions to past projects.
• Past experience of mentoring junior engineers in handling critical issues or tasks.
• Proven capability in fixing bugs and developing new features within complex software systems.
• Experience working with Big data stack or its ecosystem components, utilizing appropriate frameworks for application development.
• Demonstrated fluency in English communication.
• Ability to communicate effectively with senior leadership, presenting technical accomplishments and strategic insights.
• Strong capacity for collaboration with internal teams, external contributors, and the broader open‑source community.

PREFERRED SKILLS

• Demonstrated history of contributions or a committer role in Apache projects (e.g., bug fixes, feature development, documentation).
• Proficiency in identifying performance bottlenecks within big data applications and frameworks.
• Experience with the migration of applications, Hadoop-based distributions, or data streaming platforms.
• Familiarity with distributed systems and architectural patterns optimised for scalable data processing.

$100,000 - $140,000 a year

The hiring pay range provides a guide for what we would reasonably pay for the position. Pay is determined by various factors including market demand, applicable skills, work experience and education, location, company budget, and in‑demand skill sets.

WHY JOIN US

At Acceldata, you won’t just be writing code; you’ll be shaping the foundation of modern data platforms used by some of the world’s largest enterprises. You’ll work alongside seasoned engineers and open‑source contributors who are passionate about solving complex distributed systems challenges at scale. Every project you take on will directly impact how a data platform is managed, observed, and optimized across hybrid and cloud ecosystems.

This is your chance to build technology that truly matters, software that drives mission‑critical pipelines, scales to petabytes, and influences the open‑source community at large. We move fast, value creativity, and reward innovation. If you’re looking for a place where your ideas can become real systems and your work can be seen, used, and respected across the data ecosystem - Acceldata is where you belong.

At Acceldata, we are committed to providing equal employment opportunities regardless of job history, disability, gender identity, religion, race, color, caste, marital/parental status, veteran status, or any other special status. We stand against the discrimination of employees and individuals and are proud to be an equitable workplace that welcomes individuals from all walks of life if they fit the designated roles and responsibilities.

#LifeAtAcceldata is all about working with some of the best minds in the industry and experiencing a culture that values an ‘out‑of‑the‑box’ mindset. If you want to push boundaries, learn continuously, and grow to be the best version of yourself, Acceldata is the place to be!

We also believe in providing our employees with the right tools and resources to help them excel at their jobs. We offer:

• - PTO Plan with unlimited negative balance
• - RRSP Plan
• - Up to 100% employer‑paid benefit options for health, dental, and vision coverage
• - Supplemental Benefits- Apple Air Mac Equipment
• - Office gym access (includes workout equipment, basketball court, and showers)
• - Becoming part of the team that coined the term “Data Observability”!