Data Engineer

Altimetrik; Mississauga; On-site; CAD 80,000 - 100,000; Full time

Job summary

A technology firm in Peel Region, Mississauga is seeking a Mid-Senior level software developer proficient in Python and Spark. This full-time role involves designing, developing, and maintaining software solutions, as well as optimizing applications for performance and security. If you are passionate about software development and enjoy working with cutting-edge technologies, this position could be for you.

Qualifications

• Strong proficiency in Python and Spark.

Responsibilities

• Design, develop, and maintain software solutions using Python.
• Develop Python and pyspark programs for data analysis.
• Develop back-end services, APIs, and integrate databases.
• Optimize applications for performance, security, and maintainability.

Skills

Python

Apache Spark

Job description

Direct message the job poster from Altimetrik

Overview

Design, develop, and maintain software solutions using Python.

Responsibilities

• Design, develop, and maintain software solutions using Python.
• Develop Python and pyspark programs for data analysis. Develop a Custom Framework for generating rules (a rules engine).
• Develop Python code to gather data from HBase and design solutions to implement using PySpark. Utilize Apache Spark DataFrames/RDDs for business transformations and Hive Context for read/write operations.
• Develop back-end services, APIs, and integrate databases.
• Optimize applications for performance, security, and maintainability.
• Troubleshoot and resolve software defects and issues.

Required Skills

• Strong proficiency in Python and Spark.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• Software Development and Banking