Data Engineer: Databricks, Azure & Oracle (Onsite)

SFE; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

SFE in Toronto, ON is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines using Databricks, Python, and SQL. You will work with Azure database technologies and Oracle to enable reporting, analytics, and data integration.

Ideal candidates have hands-on experience with Databricks, Azure databases, Oracle, Python, and ETL/ELT processes, and possess strong analytic and collaboration skills to partner with analysts and engineers.

Qualifications

• 5-7 years of experience in data engineering or data development.
• Strong hands-on experience with Databricks.
• Experience with Azure database technologies.
• Strong experience with Oracle Database and SQL.
• Proficiency in Python for data processing.
• Experience with ETL/ELT processes and data integration.
• Strong analytical, troubleshooting, and problem-solving skills.
• Good communication and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and integration.
• Work with Databricks for data processing, transformation, and analytics.
• Develop and maintain data workflows using Python and SQL.
• Integrate data from multiple sources, including Azure databases and Oracle databases.
• Write optimized queries and implement efficient data transformation logic.
• Perform data cleansing, validation, and quality checks.
• Troubleshoot data pipeline failures and resolve performance issues.
• Collaborate with analysts, data architects, and engineering teams to understand data requirements.
• Follow best practices for data security, governance, and documentation.
• Support data solutions involving AI or machine learning where applicable.

Skills

Strong analytical skills

Troubleshooting

Communication & collaboration

Experience in data engineering

Tools

Databricks

Azure databases

Oracle Database

Python

SQL

ETL/ELT

Delta Lake

Spark/PySpark

Job description

SFE in Toronto, ON is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines using Databricks, Python, and SQL. You will work with Azure database technologies and Oracle to enable reporting, analytics, and data integration.

Ideal candidates have hands-on experience with Databricks, Azure databases, Oracle, Python, and ETL/ELT processes, and possess strong analytic and collaboration skills to partner with analysts and engineers.