Hybrid Big Data Engineer - Spark, Snowflake & AWS Expert

Cogency; Toronto; Hybrid; CAD 120,000 - 150,000; Full time

Job summary

Cogency Inc. is hiring a Big Data Developer / Data Engineer to design, develop, and optimize scalable data pipelines using Spark, Snowflake, AWS, and Airflow. You will work in an Agile environment across analytics, reporting, and BI initiatives, delivering robust data solutions.

Key responsibilities include building ETL workflows, optimizing data models, and integrating Snowflake with enterprise sources. Requires 5+ years in data engineering and strong SQL, with Scala/Java skills a plus.

Qualifications

• 5+ years in Data Engineering, Big Data, or ETL development.
• Hands-on with Hadoop, Hive, Snowflake.
• Strong SQL and data modeling skills.
• Programming in Scala or Java.
• Experience with ETL tools such as Informatica, Talend, or Apache Airflow.
• Cloud experience, preferably AWS.
• Understanding CI/CD, DevSecOps, and IaC.
• Experience in Agile delivery.
• Excellent communication and collaboration.

Responsibilities

• Design and maintain scalable data ingestion pipelines and ETL workflows.
• Build and optimize data pipelines and processing workflows.
• Develop Spark applications for large-scale data processing.
• Work with Hadoop, Spark, and Hive in Big Data environments.
• Design Snowflake data models and SQL workloads.
• Develop complex SQL queries and data models.
• Integrate Snowflake with enterprise data sources and BI.
• Develop ETL workflows using Informatica, Talend, or Airflow.
• Build and manage workflow orchestration with Airflow.
• Develop data solutions on AWS (S3, Glue, Lambda).
• Monitor and troubleshoot data pipelines and performance.
• Implement data quality, governance controls.
• Develop APIs using Scala or Java.
• Implement CI/CD and IaC practices.
• Maintain documentation for pipelines and models.
• Collaborate with architects, DevOps, analysts.
• Participate in Agile ceremonies, testing, production support.
• Leverage GenAI tools to improve productivity.

Skills

Big Data

ETL development

Data pipelines

SQL modeling

Scala/Java

AWS

Data governance

Agile

Problem solving

Communication

Education

Bachelors or Masters in CS/IT

Snowflake

AWS Cloud

ETL/ELT Development

SQL & Data Modeling

Scala/Java

API Integration

DevSecOps & CI/CD

Data Quality & Governance

Agile Delivery

Tools

Hadoop

Hive

Snowflake

Informatica

Talend

Apache Airflow

AWS

GitHub Actions

Docker

Kubernetes

Terraform

OpenShift

Job description

Cogency Inc. is hiring a Big Data Developer / Data Engineer to design, develop, and optimize scalable data pipelines using Spark, Snowflake, AWS, and Airflow. You will work in an Agile environment across analytics, reporting, and BI initiatives, delivering robust data solutions.

Key responsibilities include building ETL workflows, optimizing data models, and integrating Snowflake with enterprise sources. Requires 5+ years in data engineering and strong SQL, with Scala/Java skills a plus.