Sr. Data Engineer (Ruby, Spark, AWS, Python) (Remote, Eastern and Central Canada)

VTRAC Consulting Corporation (WBE); Canada; Remote; CAD 120,000 - 150,000; Full time

Job summary

A leading consulting firm is seeking a skilled Sr. Data Engineer to design and maintain large-scale data infrastructures. The role involves collaborating with various teams and ensuring the data systems meet business needs. Candidates should have significant experience with tools like Ruby, Spark, and AWS, along with strong collaboration and communication skills.

Qualifications

• 8+ years of experience in data engineering or related field.
• Strong experience with data warehousing and data lakes.
• Experience with data engineering tools such as AWS Glue, Apache Spark.

Responsibilities

• Design, build, and maintain large-scale data systems including data pipelines.
• Collaborate with data scientists to develop machine learning models.
• Ensure data quality and integrity by implementing validation processes.

Skills

Data Validation

Data Cleansing

Collaboration

Communication

Education

Bachelor's degree in Computer Science

Tools

Apache Beam

Apache Spark

AWS Glue

Amazon Redshift

Google BigQuery

Snowflake

Ruby

Python

Java

Scala

Job description

Sr. Data Engineer (Ruby, Spark, AWS, Python) (Remote, Eastern and Central Canada)

Sr. Data Engineer (Ruby, Spark, AWS, Python) (Remote, Eastern and Central Canada)

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from VTRAC Consulting Corporation (WBE)

Senior Consultant, Business Solutions @ VTRAC | Certified Diversity Co.

VTRAC Consulting Corporation

Thank you for applying to VTRAC opportunities. Please e-mail your resume as an MS-WORD document in confidence Subject: Sr. Data Engineer (Ruby, Spark, AWS, Python), Attention: [e-mail] or call: [phone]

Position #: 251172

Position Type: Contract

No. of Positions: 1

Location: Remote

Description:

An exciting opportunity for a skilled Data Engineer to join our team and help us build and maintain our data infrastructure. As a Sr. Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes. You will work closely with data architects, data scientists, and other stakeholders to ensure that our data systems meet the needs of our business.

Key Responsibilities:

• Design, build, and maintain large-scale data systems, including data pipelines, data warehouses, and data lakes
• Develop and maintain data integration pipelines and backend services using Ruby (v3.4+) and Ruby on Rails (v7.2+), ensuring best practices and version compatibility for robust data workflows
• Work with data architects to design and implement data models and data architectures
• Collaborate with data scientists to develop and deploy machine learning models and data products
• Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue
• Design and implement data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake
• Develop and maintain data lakes using tools such as Apache Hadoop, Apache Spark, and Amazon S3
• Ensure data quality and integrity by developing and implementing data validation and data cleansing processes
• Collaborate with other teams to ensure that data systems meet the needs of the business
• Stay up-to-date with new technologies and trends in data engineering and make recommendations for adoption

Qualifications:

• 8+ years of experience in data engineering or a related field
• 8+ years of experience with programming languages such as Python, Java, and Scala
• 5+ years of experience with Ruby, Selenium
• 4+ years of experience with data modeling and data architecture
• 4+ years of experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake
• Strong experience with data warehousing and data lakes
• Strong experience with data validation and data cleansing
• Strong collaboration and communication skills
• Bachelor's degree in Computer Science, Engineering, or a related field

Nice to Have:

• Experience with machine learning and data science
• Experience with cloud-based data platforms such as AWS, GCP, or Azure
• Experience with containerization using Docker and Kubernetes
• Experience with agile development methodologies such as Scrum or Kanban
• Experience with data governance and data security

We thank all candidates in advance. Only selected candidates for interviews will be contacted. For other exciting opportunities, please visit us at www.vtrac.com . VTRAC is an equal-opportunity employer.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Industries

  IT System Data Services and IT Services and IT Consulting

Referrals increase your chances of interviewing at VTRAC Consulting Corporation (WBE) by 2x

Sign in to set job alerts for “Data Engineer” roles.

Canada CA$120,000.00-CA$150,000.00 1 hour ago

Senior Software Engineer - Data Platform

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.