Data Engineer (Azure)

Tiger Analytics; Old Toronto; On-site; CAD 80,000 - 120,000; Full time

Job summary

Join a fast-growing advanced analytics consulting firm as a Data Engineer, where your expertise in Python and Pyspark will be crucial in building efficient data pipelines. This role offers a significant opportunity for career development in a dynamic and entrepreneurial environment. Collaborate with a team of analytics experts to harmonize raw data into user-friendly formats and drive business value for Fortune 500 companies. If you are passionate about data science and eager to make an impact, this is the perfect opportunity for you to thrive and grow in your career.

Qualifications

• 4+ years of IT experience with strong analytical skills.
• Expertise in Python, Pyspark, and building data pipelines.

Responsibilities

• Combine data from different sources to align with business goals.
• Build and maintain data ingestion pipelines using Azure stack.

Skills

Python

Pyspark

Azure Stack

Apache Spark

SQL

ETL Processing

Delta Lake

Azure Databricks

Data Factory

Data Wrangling

Education

Bachelor’s degree in Computer Science

Tools

Azure Data Factory

Azure Databricks

Apache Spark

Unix

Job description

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in the world.

We are looking for a Data Engineer to join our growing team of analytics experts. The right candidate will have strong analytical skills and the ability to combine data from different sources and will strive for efficiency by aligning data systems with business goals.

• Bachelor’s degree in Computer Science or similar field
• 4+ years of experience in IT industry
• Expertise in Python and Pyspark
• Experience building data pipelines using Azure stack
• 2+ years of experience using Apache spark
• Good working experience on Delta Lake and ETL processing
• Proficiency in SQL queries
• Prior experience of working in a Unix environment
• Experience in harmonizing raw data into a consumer-friendly format using Azure Databricks
• Experience extracting/querying/joining large data sets at scale
• Experience building data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data
• Experience in data wrangling, advanced analytic modeling is preferred
• Exposure to Java is a plus
• Strong communication and organizational skills

This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.