Senior Data Engineer

SecurityScorecard; Toronto; On-site; USD 120,000 - 145,000; Full time

Job summary

Join SecurityScorecard as a Senior Data Engineer in Toronto. You will be pivotal in designing scalable backend systems and enhancing data processing pipelines while collaborating with cross-functional teams. This role offers a dynamic environment to innovate and lead projects from initial concept through to successful implementation.

Benefits

Competitive salary

Stock options

Health benefits

Unlimited PTO

Parental leave

Tuition reimbursements

Qualifications

• Experience with large-scale data systems and ETL processes.
• Proficiency in functional programming with Scala and using Spark for data processing.
• Experience working in agile environments and collaborating with cross-functional teams.

Responsibilities

• Design complex backend systems that are scalable and maintainable.
• Own end-to-end projects and ensure quality through code reviews.
• Mentor junior engineers and foster knowledge sharing.

Skills

Data Engineering

Scala

AWS

Apache Spark

Kafka

Data Processing

NoSQL

Education

8 years of experience in the Data Engineering space

Tools

Docker

Terraform

Jenkins

Job description

SecurityScorecard is the global leader in cybersecurity ratings with over 12 million companies continuously rated operating in 64 countries. Founded in 2013 by security and risk experts Dr. Alex Yampolskiy and Sam Kassoumeh and funded by worldclass investors SecurityScorecards patented rating technology is used by over 25000 organizations for selfmonitoring thirdparty risk management board reporting and cyber insurance underwriting; making all organizations more resilient by allowing them to easily find and fix cybersecurity risks across their digital footprint.

Headquartered in New York City our culture has been recognized by Inc Magazine as a Best Workplace by Crains NY as a Best Places to Work in NYC and as one of the 10 hottest SaaS startups in New York for two years in a row. Most recently SecurityScorecard was named to Fast Companys annual list of the Worlds Most Innovative Companies for 2023 and to the Achievers 50 Most Engaged Workplaces in 2023 award recognizing forwardthinking employers for their unwavering commitment to employee engagement. SecurityScorecard is proud to be funded by worldclass investors including Silver Lake Waterman Moodys Sequoia Capital GV and Riverwood Capital.

About the Team :

Join our dynamic Technology team as part of one of our most critical squads. Our team emphasis is collaboration and shared responsibilities you will be handson involved in the entire Software Development Life Cycle. Our team is growing and so will you!

Check out our tech blog below and let us know if you are our next star.

You Will Do :

We are looking for a Senior Data Engineer Staff Backend Engineer who thrives on building commercial products and plays a key role in delivering reliable scalable and maintainable applications. You will lead projects from inception to delivery collaborating with Product Managers and UX Designers to define requirements implement solutions and ensure ongoing success postdeployment. You will focus on contributing technical insights to enhance the systems performance stability and user experience.

• You will be working in the Data Engineering space and with building and maintaining scalable and highperformance backend systems and big data pipelines
• You will design build and maintain RESTful APIs and integrate with external services.
• Participate in all stages of the software development life cycle from design and development to deployment and maintenance.
• Follow clean code principles using best practices to write secure testable and welldocumented software.
• Work closely with global teams including engineers product managers and UX designers to build a stable highperformance platform.
• Implement comprehensive testing and performance tuning to ensure system stability and uptime.

Responsibilities :

• Design complex backend systems that are scalable reliable and maintainable.
• Own endtoend projects across teams understanding and contributing to all aspects (infrastructure application tiers and data tiers).
• Write clean maintainable code that adheres to best practices in readability design patterns reusability and testing. Review code ensure quality and maintainability.
• Define and uphold engineering best practices and coding standards through setting technical direction documentation and maintaining standards across projects.
• Continuously monitor performance metrics and recommend improvements or refactors.
• Mentor senior and midlevel engineers. Share knowledge through documentation talks and pairing.
• Scala Apache Spark Airflow Python
• Clickhouse PostgreSQL ScyllaDB Hive Redis Kafka
• AWS Docker Jenkins Terraform

Required Technologies :

• Programming & Functional Data Processing : Scala (with Cats) Apache Spark (or equivalent distributed processing framework)
• Cloud Platforms : AWS (Amazon Web Services)
• Containerization & Deployment : Docker
• CI / CD Tools : Jenkins
• Infrastructure as Code : Terraform

Technical Skills :

• 8 years of experience in the Data Engineering space.
• Strong proficiency with working in agile environments (ideally Scrum) collaborating with crossfunctional teams (engineering design product).
• Strong proficiency in functional programming with Scala(with cats) Spark Airflow Hive Redis for building batch data processing pipelines and with Kafka for realtime data pipelines and eventdriven architectures.
• Expertise with analytical databases (ClickHouse preferred) relational databases (PostgreSQL) and largescale data systems with ETL processes (Apache Spark); experience with NoSQL distributed databases (Cassandra / ScyllaDB).
• Expertise with Jenkins for CI / CD Terraform and using Docker for containerization. Experience with AWS services (EC2 S3 Lambda RDS SQS / SNS etc.) for cloudbased application deployment and management.
• Experience with a variety of data (structured / unstructured) data formats (flat files XML JSON relational parquet).
• Strong focus on ensuring code quality and reliability through unit and integration tests and continuous improvement of the codebase.
• Proficiency with version control tools particularly Git for collaborative development and code management.
• Excellent written and verbal communication skills with the ability to articulate technical challenges and solutions clearly.

Benefits :

Specific to each country we offer a competitive salary stock options Health benefits and unlimited PTO parental leave tuition reimbursements and much more!

The estimated total compensation range for this position in USD is $120000 $145000 (base plus bonus). Actual compensation for the position is based on a variety of factors including but not limited to affordability skills qualifications and experience and may vary from the range. In addition to base salary employees may also be eligible for annual performancebased incentive compensation awards and equity among other company benefits.

SecurityScorecard is committed to Equal Employment Opportunity and embraces diversity. We believe that our team is strengthened through hiring and retaining employees with diverse backgrounds skill sets ideas and perspectives. We make hiring decisions based on merit and do not discriminate based on race color religion national origin sex or gender (including pregnancy) gender identity or expression (including transgender status) sexual orientation age marital veteran disability status or any other protected category in accordance with applicable law.

We also consider qualified applicants regardless of criminal histories in accordance with applicable law. We are committed to providing reasonable accommodations for qualified individuals with disabilities in our job application procedures. If you need assistance or accommodation due to a disability please contact

Any information you submit to SecurityScorecard as part of your application will be processed in accordance with the Companys privacy policy and applicable law.

SecurityScorecard does not accept unsolicited resumes from employment agencies. Please note that we do not provide immigration sponsorship for this position. #LIDNI

Required Experience :

Senior IC

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1

Create a job alert for this search

Senior Data Engineer • Toronto, Ontario, Canada