RQ08895 - DataOps/Cloud Data Engineer - Senior

Rubicon Path; Toronto; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A data solutions company in Toronto is seeking a Senior DataOps/Cloud Data Engineer. The candidate will be responsible for designing and optimizing CI/CD pipelines, managing databases in Azure, and ensuring effective data management and provisioning. Required skills include extensive experience with Microsoft Azure technologies and database administration, along with knowledge of data pipeline development. Competitive compensation and hybrid work options may be offered.

Qualifications

• Expert experience with Microsoft Azure technologies.
• Extensive experience with SQL Server Stored Procedure and Oracle PL/SQL.
• Experience in DataOPS performance monitoring and tuning.

Responsibilities

• Participate in project review and create documentation.
• Develop and optimize data/database CI/CD pipelines.
• Support cloud-based heterogeneous data replication solution.

Skills

Expert experience with Microsoft Azure technologies

Experience with Cloud data platforms

Data pipeline and workflow development

DataOPS principles and Agile project development

Continuous Integration/Continuous Development/Deployment

Digital product and data analysis

Expert data/database administration

Tools

Azure DevOps

Microsoft Azure SQL database

Oracle PL/SQL

SQL Server

Job description

About the job RQ08895 - DataOps/Cloud Data Engineer - Senior

Scope of Services and Deliverables - The Services and Deliverables to be provided by the Vendor will include the following:

• Participate in the review of project, work request and maintenance release artifacts - Use Case, System Requirement Specification, etc.
• Deliver detailed system design documents and any other supporting documentation conforming to Ministry standards.
• Design, develop and optimize data/database CI/CD pipelines.
• Design logical and physical data models using Sybase Power Designer.
• Prepare database change in DACPAC and develop Azure CI/CD release pipeline to promote DACPAC.
• Promote database changes through Development, Integration Testing, QA, UAT, Production environments.
• Provision data in cloud environment according to requirements.
• Design, develop and implement data conversation of VLD (Very large Data) of Online analytical processing (OLAP) and online transaction processing (OLTP) environments to Cloud Software-as-a-service (SaaS), Platform-as-a-service (PaaS) and Infrastructure-as-a-service (IaaS) environments.
• Design, develop and implement fact/dimension model, data mapping, data warehouse, data lake and data lakehouse.
• Plan, configure, maintain, administrate, tune performance of Oracle, Microsoft Azure SQL database and Synapse database.
• Support cloud-based heterogeneous data replication solution.
• Develop complex Oracle PL/SQL program, SQL server stored procedure to fulfill project, work request, maintenance requirements.
• Optimize performance of PL/SQL program, SQL server stored procedure.
• Monitor and analyze incident, provide timely resolution.
• Perform reference data administration as required.
• Build and test database backup/recovery scripts.
• Build and test database automation scripts.
• Perform database administration, including patching/upgrade, monitoring, performance tuning, partitioning, capacity planning, OEM upgrade/enhancement, achieving, etc
• Document and resolve any database problems/issues.
• Provide effective knowledge transfer to Ministry staff at all stages of this assignment.

SkillsExperience and Skill Set Requirements

Evaluation Table

• Expert experience with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machine, Azure DevOps, Data Lake, Data Lakehouse, Azure monitoring tools.
• Experience with Cloud data platforms, data management and data exchange tools and technologies.
• Experience with Data pipeline and workflow development, orchestration, deployment, and automation.
• Experience in DataOPS principle, best practice, and implementation and Agile project development and deployment.
• Experience in Continuous Integration/Continuous Development/Deployment (CI/CD) and Data provisioning Automation.
• Experience with digital product, data analysis, data exchange, data provisioning, and data security.
• Experience with structured, semi-structured, unstructured data collection, ingestion, provisioning and exchange technological development.
• Experience with DataOPS performance monitoring and tuning.

Database Management 40%

• Expert data/database administration experience, e.g., Microsoft Azure SQL database and Synapse database, Oracle, IMS, DB2, etc.
• Extensive experience with SQL Server Stored Procedure, Oracle PL/SQL, PL/1 development and performance tuning.
• Experience with Azure SQL, Oracle, IMS/DB2 data replication.

Must haves:

• Expert experience with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machine, Azure DevOps, Data Lake, Data Lakehouse, Azure monitoring tools.