Azure data Engineer/Architect

Diverse Lynx; Toronto; Hybrid; CAD 100,000 - 130,000; Full time

Job summary

A leading company in data solutions seeks an Azure Data Engineer/Architect to design and implement effective data architectures. The ideal candidate will have 7 to 9 years of experience, specializing in PySpark and Azure Databricks, to drive innovation and optimize data workflows in a hybrid work environment.

Qualifications

• 7 to 9 years of experience in data architecture and engineering.
• Strong understanding and experience with PySpark and Azure Databricks.
• Excellent problem-solving skills and attention to detail.

Responsibilities

• Design and develop scalable data architectures using PySpark and Azure Databricks.
• Implement data processing pipelines ensuring data quality, integrity, and security.
• Provide technical guidance and mentorship to junior team members.

Skills

PySpark

Azure

Data processing

Data architecture

Collaboration

Problem-solving

Attention to detail

Communication

Education

Degree in Computer Science, Information Technology, or a related field

Job description

Azure Data Engineer/Architect

Location: Toronto, ON (Hybrid Mode)

Job Summary:

• We are seeking an experienced Architect with 7 to 9 years of experience to join our team in a hybrid work model.
• The ideal candidate will have expertise in PySpark and Azure Databricks and will be responsible for designing and implementing data solutions.
• This role requires a proactive individual who can drive innovation and efficiency in data processing and analytics.

Required Skills:

• Technical Skills: PySpark, Azure
• Responsibilities:
• Design and develop scalable data architectures using PySpark and Azure Databricks to meet business requirements.
• Collaborate with cross-functional teams to understand data needs and translate them into technical solutions.
• Implement data processing pipelines that ensure data quality, integrity, and security.
• Optimize data workflows for performance and cost-effectiveness in a cloud environment.
• Provide technical guidance and mentorship to junior team members to foster growth and development.
• Conduct regular reviews of data architecture and recommend improvements for efficiency.
• Stay updated with industry trends and technologies to ensure the company remains competitive.
• Troubleshoot and resolve complex data-related issues to maintain system reliability.
• Document data architecture designs and processes for future reference and compliance.
• Engage with stakeholders to gather feedback and refine data solutions to meet business objectives.
• Ensure adherence to best practices and standards in data architecture and engineering.
• Contribute to strategic planning of data initiatives to align with company goals.
• Drive innovation by exploring new tools and techniques to enhance data processing capabilities.

Qualifications:

• Strong understanding of PySpark and its application in data processing.
• Expertise in Azure Databricks and cloud-based data solutions.
• Proven track record of designing scalable data architectures.
• Proficiency in optimizing data workflows for performance and cost.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills for effective collaboration.
• Degree in Computer Science, Information Technology, or a related field.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without discrimination. We promote and support a diverse workforce across all levels in the company.