Data Engineer

Staffingine LLC; Toronto; On-site; CAD 90,000 - 120,000; Part time

Job summary

Staffingine LLC in Toronto, ON is seeking a hands-on Data Engineer to design and maintain scalable data pipelines, with extensive Databricks experience and strong SQL/Python skills. You will integrate Azure and Oracle data sources, optimize ETL/ELT processes, and ensure data quality across pipelines.

The role involves collaborating with analysts, architects, and other engineers, following best practices for data security and governance, and supporting AI/ML initiatives where applicable.

Qualifications

• 5-7 years of experience in data engineering or data development.
• Strong hands-on experience with Databricks.
• Experience working with Azure database technologies.
• Strong experience with Oracle Database and SQL.
• Proficiency in Python programming for data processing and automation.
• Experience with ETL/ELT processes, data integration, and data transformation.
• Strong analytical, troubleshooting, and problem-solving skills.
• Good communication and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and integration.
• Work extensively with Databricks for data processing, transformation, and analytics.
• Develop and maintain data workflows using Python and SQL.
• Integrate data from multiple sources, including Azure databases and Oracle databases.
• Write optimized queries and implement efficient data transformation logic.
• Perform data cleansing, validation, and quality checks to ensure accuracy and consistency.
• Troubleshoot data pipeline failures and resolve performance and data processing issues.
• Collaborate with business analysts, data architects, and other engineering teams to understand data requirements.
• Follow best practices for data security, governance, performance optimization, and documentation.
• Support data solutions involving AI or machine learning where applicable.

Skills

Databricks

Azure databases

Python

Oracle DB

SQL

ETL/ELT

Data pipelines

Troubleshooting

Collaboration

Data quality

Job description

Job Title: Data Engineer
Job Location: Toronto, ON
Job Type: Contract

Job Description:

• Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and integration.
• Work extensively with Databricks for data processing, transformation, and analytics.
• Develop and maintain data workflows using Python and SQL.
• Integrate data from multiple sources, including Azure databases and Oracle databases.
• Write optimized queries and implement efficient data transformation logic.
• Perform data cleansing, validation, and quality checks to ensure accuracy and consistency.
• Troubleshoot data pipeline failures and resolve performance and data processing issues.
• Collaborate with business analysts, data architects, and other engineering teams to understand data requirements.
• Follow best practices for data security, governance, performance optimization, and documentation.
• Support data solutions involving AI or machine learning where applicable.

Required Skills and Qualifications:

• 5 7 years of experience in data engineering or data development.
• Strong hands-on experience with Databricks.
• Experience working with Azure database technologies.
• Strong experience with Oracle Database and SQL.
• Proficiency in Python programming for data processing and automation.
• Experience with ETL/ELT processes, data integration, and data transformation.
• Strong analytical, troubleshooting, and problem-solving skills.
• Good communication and collaboration skills.

Preferred Skills:

• Exposure to AI, machine learning, or AI-enabled data solutions.
• Experience with Spark, PySpark, Delta Lake, or Azure data services.
• Experience optimizing data pipelines and processing large datasets.

Ideal Candidate Profile: A hands-on Data Engineer with strong Databricks, Python, Azure database, and Oracle experience. AI experience will be an added advantage.