Data Engineers

VirtueTech inc; Canada; On-site; CAD 80,000 - 100,000; Full time

Job summary

An innovative data engineering firm is on the lookout for a Big Data Engineer to join their dynamic team. In this pivotal role, you will be responsible for developing robust data pipelines and engineering solutions that drive key business initiatives. Your expertise in big data tools and AWS services will be crucial as you work on projects that enhance scalability and performance. This role offers a unique opportunity to take ownership of projects, explore new technologies, and contribute to the company's mission of becoming an industry leader. If you are passionate about data and eager to make a significant impact, this position is for you.

Qualifications

• 7+ years of experience in Data Engineering with strong communication skills.
• Experience with big data tools and AWS cloud services.

Responsibilities

• Develop data pipelines and engineering components for business processes.
• Create data tools for analytics and optimize systems.

Skills

Data Engineering

Communication Skills

Big Data Tools (Hadoop, Spark, Kafka)

Relational SQL and NoSQL Databases

Data Pipeline Tools (Airflow)

AWS Cloud Services

Stream-Processing Systems

Object-Oriented Programming (Python, Java, C++, Scala)

Education

Bachelor in Engineering

Master in Computer Science

Tools

Hadoop

Spark

Kafka

Flink

Hive

Sqoop

Airflow

AWS EC2

AWS S3

AWS EMR

AWS RDS

AWS Redshift

AWS BigQuery

Job description

Virtue Tech, an AWS Data Engineering company, is seeking an exceptional Big Data Engineer to join the team. This person will play a key role in providing end-to-end data engineering solutions to support key business initiatives. The Data Engineer is responsible for developing data pipelines and data engineering components to support strategic initiatives and ongoing business processes for customers. This role includes migration to AWS using various AWS components.

Responsibilities

• Focus on scalability, performance, service robustness, and cost trade-offs.
• Continuous drive to explore, improve, enhance, automate, and optimize systems and tools to best meet evolving business and market needs.
• Attention to detail, coupled with the ability to think abstractly.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Create prototypes and proof-of-concepts for iterative development.
• Keen to learn new technologies and apply the knowledge in production systems.
• Take complete ownership of projects and their development cycle.

Qualifications

• Bachelors/Masters in Engineering or Computer Science.
• 7+ years of experience in Data Engineering.
• Strong communication skills.
• Experience with big data tools like Hadoop, Spark, Kafka, Flink, Hive, Sqoop, etc.
• Experience with relational SQL and NoSQL databases like MySQL, Postgres, MongoDB, and Cassandra.
• Experience with data pipeline tools like Airflow.
• Experience with AWS cloud services like EC2, S3, EMR, RDS, Redshift, BigQuery.
• Experience with stream-processing systems like Storm, Spark-Streaming, Flink, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.