Sr. Data Engineer

HAN; Mississauga; On-site; CAD 80,000 - 110,000; Full time

Job summary

A data engineering company in Mississauga is looking for a data engineer with proficiency in cloud data lakehouse platforms, relational and NOSQL data stores. The ideal candidate should have strong organizational and problem-solving skills, as well as experience with CI/CD tools and Agile methodologies. This role offers opportunities to work with cutting-edge technologies in a collaborative environment.

Qualifications

• Proficiency in at least one cloud data lakehouse platform.
• Experience with relational and NOSQL data stores.
• Strong critical thinking and problem-solving skills.

Skills

Cloud data lakehouse platforms (AWS, Databricks)

Relational data stores (Postgres, Oracle)

NOSQL data stores (Cassandra, DynamoDB, MongoDB)

Scheduling/orchestration tools (Airflow)

Data structures, serialization formats

Big-data storage formats (Parquet, Iceberg)

Data processing methodologies

Agile methodology

CI/CD tools (Jenkins, Git)

Strong organizational skills

Tools

AWS Bedrock APIs

Terraform

Job description

Job Description

• Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres, Oracle or similar) and atleast one NOSQL data stores (Cassandra, Dynamo, MongoDB or similar)
• Proficiency in atleast one scheduling / orchestration tools (preferably Airflow, alternatively AWS Step Functions or similar)
• Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data processing methodologies (batch, micro-batching, and stream), one or more data modelling techniques (Dimensional, Data Vault, Kimball, Inmon, etc.), Agile methodology (develop PI plans and roadmaps), TDD (or BDD) and CI / CD tools (Jenkins, Git,)
• Strong organizational, problem-solving and critical thinking skills; Strong documentation skills

Preferred skills

• Experience using AWS Bedrock APIs
• Knowledge of Generative AI concepts (such as RAG, Vector embeddings, Model fine tuning, Agentic AI)
• Experience in IaC (preferably Terraform, alternatively AWS cloud formation)