DataOps cloud Data Engineer 9118-0812

Dheya; Toronto; Hybrid; CAD 80,000 - 110,000; Full time

Job summary

An innovative company is seeking a skilled data engineer to design and optimize data pipelines and CI/CD processes. This hybrid role emphasizes collaboration, requiring in-office presence three days a week. You will be responsible for managing and tuning databases, ensuring data integrity, and implementing best practices in cloud environments. Join a forward-thinking team that values your expertise in Azure technologies and data management, where your contributions will directly impact the efficiency and performance of critical data systems. If you're passionate about data and cloud technologies, this opportunity is perfect for you.

Qualifications

• Expertise in Azure technologies and data pipeline development.
• Extensive experience with database administration across various platforms.

Responsibilities

• Design and implement data/database CI/CD pipelines.
• Manage and tune performance of databases in cloud environments.
• Document and resolve database issues while transferring knowledge.

Skills

DACPAC

Oracle

PLSQL

SQL Server

Stored Procedure

DB2

IMS

Oracle DB

Microsoft Azure SQL database

Synapse database

PL1 development

Azure Key Vault

DevOps

Data Lake

Data Lakehouse

Data Pipeline Development

Scripting Languages: Python

Scripting Languages: SQL

ETL Processes

Cloud Platform Expertise

Data Warehousing Solutions

Containerization (Docker, Kubernetes)

Version Control Systems (Git)

Job description

Skills Required :

• DACPAC, Oracle, PLSQL, SQL Server, Stored Procedure, DB2, IMS, Oracle DB, Microsoft Azure SQL database, Synapse database
• PL1 development, Azure Key Vault, Portal, VM, DevOps, Data Lake, Data Lakehouse, Data Pipeline Development
• Scripting Languages: Python, SQL
• DevOps Practices, ETL Processes, Cloud Platform Expertise, Data Warehousing Solutions, Containerization (Docker, Kubernetes), Version Control Systems (Git)

HM Note: This hybrid contract role requires three (3) days in office. Candidates must include their first and last name in their resume.

Description

Scope of Services and Deliverables include:

1. Review project, work request, and maintenance release artefacts (Use Case, System Requirement Specification, etc.).
2. Deliver detailed system design documents and supporting documentation per Ministry standards.
3. Design, develop, and optimize data/database CI/CD pipelines.
4. Design logical and physical data models using Sybase Power Designer.
5. Prepare database changes in DACPAC and develop Azure CI/CD release pipelines.
6. Promote database changes through various environments (Dev, Test, QA, UAT, Production).
7. Provision data in cloud environments as required.
8. Design, develop, and implement data conversion for Very Large Data (VLD) in OLAP and OLTP environments to Cloud SaaS, PaaS, and IaaS environments.
9. Design, develop, and implement fact/dimension models, data mapping, data warehouse, data lake, and data lakehouse.
10. Manage and tune performance of Oracle, Azure SQL, and Synapse databases.
11. Develop and optimize complex Oracle PL/SQL programs and SQL Server stored procedures.
12. Monitor incidents and provide timely resolutions.
13. Administer reference data, build/test backup and automation scripts, perform database administration tasks.
14. Document and resolve database issues, and transfer knowledge to staff.

Skills and Experience Requirements

• Expertise with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage, disk, file share, key vault, portal, VM, DevOps, Data Lake, Data Lakehouse, monitoring tools.
• Experience with cloud data platforms, data management, and data exchange tools.
• Proficiency in data pipeline development, orchestration, deployment, automation, and DataOPS principles.
• Experience with CI/CD, data provisioning automation, digital products, data analysis, and security.
• Handling structured, semi-structured, and unstructured data collection, ingestion, and exchange development.
• Performance monitoring and tuning of DataOPS.

Database Management (40%)

• Extensive experience with database administration, including Azure SQL, Synapse, Oracle, IMS, DB2.
• Proficiency in SQL Server Stored Procedures, Oracle PL/SQL, PL/1 development, and performance tuning.
• Experience with data replication across Azure SQL, Oracle, IMS/DB2.

Must Have:

• Expertise in Microsoft Azure technologies as listed above.

Didn't find the role you were looking for? Upload your resume now to be considered for future opportunities at Foilcon.