URGENT - Data Engineer (AWS / Python / Apache Spark)

VTRAC Consulting Corporation (WBE); Halifax; Remote; CAD 80,000 - 120,000; Full time

Job summary

A leading consulting company is seeking a Data Engineer to enhance their data infrastructure. The successful candidate will design, build, and maintain data systems while collaborating closely with data architects and scientists. This is a fully remote role based in Nova Scotia, with the potential for permanence.

Qualifications

• 5+ years of experience in data engineering or a related field.
• Strong experience with data warehousing and data lakes.
• Proficient in Ruby on Rails framework.

Responsibilities

• Design, build, and maintain large-scale data systems.
• Develop and maintain data pipelines using tools such as Apache Beam.
• Collaborate with data scientists to develop and deploy machine learning models.

Skills

Data Engineering

Python

Java

Scala

Collaboration

Data Validation

Education

Bachelor's degree in Computer Science, Engineering

Tools

Apache Spark

AWS Glue

Amazon Redshift

Google BigQuery

Snowflake

Job description

Direct message the job poster from VTRAC Consulting Corporation (WBE)

Senior Consultant, Business Solutions @ VTRAC | Certified Diversity Co.

VTRAC Consulting Corporation

Thank you for applying to VTRAC opportunities. Please e-mail your resume as an MS-WORD document in confidence Subject: URGENT - Data Engineer (AWS, Python, Apache Spark), Attention: [e-mail] or call: [phone]

Position #: 251179

Position Type: Contract

No. of Positions: 1

Location: Remote (Nova Scotia)

Description:

An exciting opportunity for a Data Engineer to join a collaborative environment and help build and maintain the data infrastructure. The successful candidate will be responsible for designing, building, and maintaining data systems, including data pipelines, data warehouses, and data lakes. You will work closely with data architects, data scientists, and other stakeholders to ensure that the entire data systems meet the needs of our business. This is a fully remote opportunity with the potential to become a permanent position.

Key Responsibilities:

• Design, build, and maintain large-scale data systems.
• Design and implement data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake.
• Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
• Develop and maintain data lakes using tools such as Apache Hadoop, Apache Spark, and Amazon S3.
• Work with data architects to design and implement data models and data architectures.
• Collaborate with data scientists to develop and deploy machine learning models and data products.
• Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
• Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
• Collaborate with other teams to ensure that data systems meet the business's needs.
• Stay up-to-date with new technologies and trends in data engineering and make recommendations for adoption.

Qualifications:

• 5+ years of experience in data engineering or a related field
• 5+ years of experience with programming languages such as Python, Java, and Scala
• 3+ years of experience with data modeling and data architecture
• 3+ years of experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake
• Proficient in Ruby on Rails framework.
• Strong experience with data warehousing and data lakes
• Strong experience with data validation and data cleansing
• Strong collaboration and communication skills
• Bachelor's degree in Computer Science, Engineering, or a related field

Nice to Have:

• Experience with machine learning and data science
• Experience with cloud-based data platforms such as AWS, GCP, or Azure
• Experience with containerization using Docker and Kubernetes
• Experience with agile development methodologies such as Scrum or Kanban
• Experience with data governance and data security

We thank all candidates in advance. Only selected candidates for interviews will be contacted. For other exciting opportunities, please visit us at www.vtrac.com . VTRAC is an equal-opportunity employer.

Seniority level

• Seniority level

  Associate

Employment type

• Employment type

  Contract

Job function

• Job function

  Design and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at VTRAC Consulting Corporation (WBE) by 2x

Get notified about new Data Engineer jobs in Halifax, Nova Scotia, Canada.

Software Development Engineer in Test- Remote

Halifax, Nova Scotia, Canada 2 months ago

Software Engineer I (Merchant Data Platform)

Software Engineer I (Consumer Servicing)

Software Engineer II (Capacity Engineering)

Software Engineer II, Backend (Merchant Risk Intelligence & Platform)

Software Engineer II (Merchant Risk Intelligence & Platform)

Software Engineer II (Consumer Servicing)

Senior Software Engineer (Identity Decisioning)

Senior Software Engineer (Online Storage)

Senior Software Engineer, Backend (Merchant Risk Intelligence & Platform)

Dartmouth, Nova Scotia, Canada 2 weeks ago

Senior Software Engineer (Capacity and Cloud Economics Engineering)

Principal Software Engineer, Infrastructure Platform Engineering

Principal Software Engineer, Traffic Management

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.