Azure Databricks Developer

United Software Group Inc.; Canada; On-site; CAD 80,000 - 100,000; Full time

Job summary

An established industry player is seeking an Azure Databricks Developer to transition from Azure Synapse Analytics to Databricks. This exciting role requires strong expertise in Python, SQL, and the Azure data ecosystem, particularly in Databricks. The ideal candidate will have a proven track record in big data engineering, developing automated systems, and working with complex data sets. You'll be part of a dynamic team, driving innovative solutions that solve real business problems and enhance data security. If you're passionate about data and technology, this opportunity could be your next big career move.

Qualifications

• 5+ years of experience in Python and SQL programming at an expert level.
• Strong background in Azure data ecosystem with Databricks and Synapse Analytics.

Responsibilities

• Drive big data engineering projects independently with minimal supervision.
• Develop automated security systems and response systems for data management.

Skills

Python

SQL

Databricks

Big Data Engineering

Azure Data Ecosystem

Data Visualization

Cross-functional Collaboration

Education

Microsoft Certification (DP-203)

Databricks Certified Data Engineer Professional

Tools

Azure Synapse Analytics

GitHub

Azure DevOps

Power BI

Databricks Workflows

Prefect

Job description

Job Title: Azure Databricks Developer

Work location : Halifax, CA (Permanent remote)

12 Months Contract

Summary:

Moving from Azure Synapse Analytics to Databricks. Looking for strong PYTHON/SQL/Databricks experience.

Detailed Requirements:

• 5+ years’ experience programming in both SQL and Python. ("Expert Level Required" – Will be tested in interview process)
• 5+ years’ experience working in the Azure data ecosystem (Databricks & Azure Synapse Analytics)
• 3+ years’ developing big data engineering systems powered by APIs and creating medallion architecture (bronze, silver, gold) on structured and nonstructured data.
• 2 + years’ experience automating workloads using one of the following tools (Databricks workflows, Prefect, CI/CD)
• 2+ years’ experience working within source and version control systems as (GitHub or Azure DevOps)
• 2+ years’ experience developing automated security systems around data (Schema security, table level security, row level security, dynamic data masking)
• 2+ years’ experience developing automated response systems for production grade data systems (Alerting, Monitoring, Logging, and Automated backups)
• 2+ years’ experience developing and working with credential management systems (Azure key vault, HashiCorp, etc.)
• Proven ability to drive big data engineering projects independently with minimal supervision.
• Must have one of the following - (Microsoft Certification (DP-203) & Preferred ?? Databricks Certified Data Engineer Professional)
• Proficiency using Power BI (Star Schema, DAX, Performance Analyzer, BPA Tabular)
• Proven background in working with big and complex data sets within large organizations
• Ability to analyze data to solve a wide variety of business problems and create data visualizations that drive strategic direction
• Proven ability to work with cross-functional teams and translate requirements between business, project management and technical projects or programs
• Experience with multiple cloud technologies is a major plus (ServiceNow, Splunk, Dynatrace, Axonius, Azure Log Analytics)