10,000+
Jobs in Ottawa, United States
SRE with Data Engineering Expertise-TI270825
emergiTEL Inc.
Canada
Remote
CAD 90,000 - 120,000
30+ days ago
I want to receive the latest job alerts for jobs in Ottawa
High-Ticket Outbound Setter – Warm Buyer Leads (REMOTE)
Triton Growth
Vancouver
Remote
CAD 60,000 - 80,000
30+ days ago
General Practitioner / Family Medicine Specialist with OBGYN expertise, Opportunity in the Grea[...]
Head Medical
Toronto
Remote
CAD 250,000 +
30+ days ago
Connect with headhunters to apply for similar jobsContaminated Sites Professional
Ecora Engineering & Resource Group Ltd.
British Columbia
Remote
CAD 80,000 - 100,000
30+ days ago
Responsable du service aux clients et marchands (Temps partiel) / Customer and Merchant Service[...]
FoodHero
Montreal
Remote
CAD 30,000 - 60,000
30+ days ago
Outsource Art Producer - Devoted Fusion (Platform)
Devoted Studios
Canada
Remote
CAD 60,000 - 75,000
30+ days ago
Gestionnaire en marketing produit - Product Marketing Manager
Valsoft Corporation
Montreal
Remote
CAD 70,000 - 90,000
30+ days ago
Director of Outreach (Canada CyberSTEAM Challenge)
Volunteer Centre of Calgary
Canada
Remote
CAD 100,000 - 125,000
30+ days ago
Senior Solution Consultant , Workday Financials
BENTLEY SYSTEMS, INC.
Canada
Remote
CAD 90,000 - 120,000
30+ days ago
SRE with Data Engineering Expertise-TI270825
emergiTEL Inc.
Canada
Remote
CAD 90,000 - 120,000
Full time
30+ days ago
Job summary
A technology staffing company in Canada is looking for a Data Engineer to manage and optimize cloud-based data pipelines. The role requires expertise in data engineering support, programming skills in Python and SQL, and experience with cloud platforms. This position offers the chance to work in a dynamic environment and improve pipeline performance for various projects.
Qualifications
- 5+ years of industry experience in Data Engineering support and enhancement.
- Proficiency in GCP, Azure, or AWS.
- Strong understanding of data pipeline architectures and ETL processes.
Responsibilities
- Manage, monitor, and troubleshoot cloud-based data pipelines.
- Optimize data pipelines for performance, cost-efficiency, and reliability.
- Automate tasks in data processing and management.
Skills
Data Engineering support and enhancement
Cloud platforms: GCP, Azure, or AWS
Data pipeline architectures and ETL processes
Python (Pandas, PyArrow, Ibis)
SQL for data analysis
Apache PySpark and/or Apache Flink
Docker & Kubernetes
Git, CI/CD pipelines
Troubleshooting and problem-solving skills
Documentation and communication skills
Education
Bachelor’s degree in Computer Science
Cloud Professional Data Engineer certification
Tools
Google Looker
Tableau
Power BI
Apache Iceberg
Job description
Key Responsibilities
- Manage, monitor, and troubleshootcloud-based data pipelines.
- Optimize data pipelines to enhanceperformance, cost-efficiency, and reliability.
- Automate repetitive tasks indata processing and management.
- PerformSLA-oriented monitoringof critical pipelines and ensure adherence.
- Analyze, troubleshoot, and resolvecomplex pipeline issuesand conductpost-incident reviews.
- Maintaininfrastructure reliabilityfor data pipelines and MDM jobs.
- Implement and improvemonitoring, alerting, and testing mechanismsfor pipeline reliability.
- Develop and maintaintechnical documentationfor data pipeline systems and processes.
- Collaborate with stakeholders, ensuring effectivecommunication and reporting.
- Open to working in a24x7 shift environment.
Required Skills & Experience
- 5+ yearsof industry experience inData Engineering support and enhancement.
- Proficiency incloud platforms: GCP, Azure, or AWS (experience with BigQuery, Cloud Storage, GKE, Glue, DMS, Athena, Lake Formation preferred).
- Strong understanding ofdata pipeline architectures and ETL processes.
- Excellent programming skills inPython (Pandas, PyArrow, Ibis)for data processing and automation.
- Proficiency inSQLfor data analysis with relational databases.
- Hands-on experience withApache PySparkand/orApache Flink(or Kafka Streams, Apache Storm).
- Practical knowledge ofDocker & Kubernetes (containerization and orchestration).
- Experience withGit, CI/CD pipelines, and automated testing.
- Strongtroubleshooting and problem-solving skills.
- Proven ability toanalyze, optimize, and maintain high-reliability pipelines.
- Strongdocumentation and communication skills.
Qualifications
- Bachelor’s degree inComputer Scienceor a related technical field (or equivalent practical experience).
- Cloud Professional Data Engineer certificationis an advantage.
- Excellentverbal and written communicationskills.
Nice to Have (Preferred Skills)
- Knowledge ofFHIR R4 standardsandhealthcare data interoperability.
- Experience withdata visualization tools(Google Looker, Tableau, Power BI).
- Hands-on withPyFlink(Python API for Apache Flink) andFlink SQL.
- Familiarity withPixi environment managementand modernPython dependency management.
- Experience withApache Icebergor other modern data lake storage formats.
- Understanding ofreal-time vs. batch processing trade-offs, particularly in healthcare data systems.
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.
Land a better
job faster
job faster
Follow us
