DataOps cloud Data Engineer 9118-0812

Foilcon; Toronto; Hybrid; CAD 80,000 - 110,000; Full time

Job summary

Join a forward-thinking company as a Mid-Senior level Information Technology professional in a hybrid contract role. This position offers the opportunity to work with cutting-edge Microsoft Azure technologies, focusing on cloud data management and database administration. You'll design and optimize CI/CD pipelines, manage data replication, and ensure the performance of various database systems. This innovative firm values expertise in data operations and provides a collaborative environment where your skills will directly impact the success of critical projects. If you're ready to take your career to the next level, this role is an exciting opportunity to make a difference.

Qualifications

• Proven expertise in Microsoft Azure technologies and database management.
• Experience with cloud data platforms and data exchange tools.

Responsibilities

• Design, develop, and optimize data/database CI/CD pipelines.
• Manage performance of Oracle and Microsoft Azure SQL databases.

Skills

Microsoft Azure technologies

CI/CD

DataOPS principles

Oracle PL/SQL

SQL Server stored procedures

Data pipeline development

Tools

Sybase Power Designer

Azure DevOps

Oracle

Microsoft Azure SQL

Data Lake

Data Lakehouse

Job description

3 weeks ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

HM Note: This hybrid contract role requires three (3) days in office. Candidates must include their first and last names in their resumes.

Description

The scope of services and deliverables includes:

• Review project, work request, and maintenance release artifacts such as Use Cases, System Requirement Specifications, etc.
• Deliver detailed system design documents and supporting documentation conforming to Ministry standards.
• Design, develop, and optimize data/database CI/CD pipelines.
• Create logical and physical data models using Sybase Power Designer.
• Prepare database changes in DACPAC and develop Azure CI/CD release pipelines to promote DACPAC.
• Promote database changes through various environments: Development, Integration Testing, QA, UAT, and Production.
• Provision data in cloud environments as required.
• Design and develop data loading, data conversion, and data migration programs.
• Implement data conversations for Very Large Data (VLD) in OLAP and OLTP environments to Cloud SaaS, PaaS, and IaaS environments.
• Design, develop, and implement fact/dimension models, data mapping, data warehouses, data lakes, and data lakehouses.
• Manage and tune performance of Oracle, Microsoft Azure SQL databases, and Synapse databases.
• Support cloud-based heterogeneous data replication solutions.
• Develop complex Oracle PL/SQL programs and SQL Server stored procedures to meet project requirements.
• Optimize performance of PL/SQL programs and stored procedures.
• Monitor, analyze incidents, and provide timely resolutions.
• Administer reference data as needed.
• Build and test database backup/recovery and automation scripts.
• Perform database administration tasks including patching, upgrades, monitoring, performance tuning, partitioning, capacity planning, and OEM upgrades.
• Document and resolve database problems/issues.
• Provide knowledge transfer to Ministry staff throughout the project.

Skills and Experience Requirements

The evaluation focuses on:

Cloud DataOPS (40%)

• Expertise with Microsoft Azure technologies (Azure pipeline, DACPAC, storage, disk, file share, key vault, portal, VMs, DevOps, Data Lake, Data Lakehouse, monitoring tools).
• Experience with cloud data platforms, data management, and data exchange tools.
• Proficiency in data pipeline development, orchestration, deployment, and automation.
• Knowledge of DataOPS principles, best practices, Agile development, and deployment.
• Experience with CI/CD and data provisioning automation.
• Understanding of digital products, data analysis, exchange, security, and handling structured, semi-structured, and unstructured data.
• Experience in DataOPS performance monitoring and tuning.

Database Management (40%)

• Expertise in database administration for Microsoft Azure SQL, Synapse, Oracle, IMS, DB2, etc.
• Extensive experience with SQL Server stored procedures, Oracle PL/SQL, and performance tuning.

Data Replication Pipelines (20%)

• Experience with Azure SQL, Oracle, IMS/DB2 data replication.

Must Have

Proven expertise with Microsoft Azure technologies including Azure pipeline, DACPAC, storage, key vault, portal, VMs, DevOps, Data Lake, Data Lakehouse, and monitoring tools.

Additional Details

• Seniority level: Mid-Senior level
• Employment type: Contract
• Job function: Information Technology
• Industries: IT Services and IT Consulting