Core Java, Apache Spark, Python

PeoplePilot; Montreal; Presencial; CAD 110.000 - 140.000; Jornada completa

Descripción de la vacante

PeoplePilot in Montreal is seeking a highly motivated Software Engineer with Core Java, Apache Spark, Python, SQL and Linux to design, develop and support scalable server‑side applications and analytical data processing systems.

The candidate will build high‑performance data pipelines, integrate analytical platforms, and collaborate with cross‑functional teams to deliver robust, maintainable solutions; cloud and container experience (AWS/Azure/GCP; Docker, Kubernetes) and CI/CD in Agile

Formación

• Senior years of hands-on experience in software development and analytical system integration.
• Strong programming expertise in Core Java.
• Hands-on experience with Apache Spark for distributed data processing.
• Proficiency in SQL and relational databases.
• Strong working knowledge of Linux/Unix operating systems.
• Experience with RESTful APIs and system integration.

Responsabilidades

• Design, develop, test, and maintain high-performance, scalable server-side applications using Core Java and Python.
• Build and optimize large-scale data processing solutions using Apache Spark.
• Develop and maintain database solutions, write complex SQL queries, and optimize database performance.
• Design and integrate analytical systems to process and analyze large volumes of structured and unstructured data.
• Collaborate with cross-functional teams including business analysts, architects, data engineers, and QA teams to deliver robust solutions.
• Troubleshoot, debug, and resolve application and system performance issues.
• Work in Linux environments for application deployment, monitoring, and support activities.
• Participate in application architecture discussions and contribute to technical design decisions.
• Ensure adherence to coding standards, security guidelines, and software development best practices.
• Support CI/CD processes and application lifecycle management.

Conocimientos

Core Java

Apache Spark

Python

SQL

Linux

RESTful APIs

Multithreading

OO design

Distributed data processing

Microservices

Herramientas

Docker

Kubernetes

AWS

Azure

GCP

Descripción del empleo

We are seeking a highly motivated and experienced Software Engineer with strong expertise in Core Java, Apache Spark, Python, SQL, and Linux to design, develop, and support scalable server-side applications and analytical data processing systems.

The ideal candidate will have hands-on experience in building high-performance applications, integrating analytical platforms, and working with large-scale data processing frameworks.

Key Responsibilities

• Design, develop, test, and maintain high-performance, scalable server-side applications using Core Java and Python.
• Build and optimize large-scale data processing solutions using Apache Spark.
• Develop and maintain database solutions, write complex SQL queries, and optimize database performance.
• Design and integrate analytical systems to process and analyze large volumes of structured and unstructured data.
• Collaborate with cross-functional teams including business analysts, architects, data engineers, and QA teams to deliver robust solutions.
• Troubleshoot, debug, and resolve application and system performance issues.
• Work in Linux environments for application deployment, monitoring, and support activities.
• Participate in application architecture discussions and contribute to technical design decisions.
• Ensure adherence to coding standards, security guidelines, and software development best practices.
• Support CI/CD processes and application lifecycle management.

Key Requirements

• Senior years of hands-on experience in software development and analytical system integration.
• Strong programming expertise in Core Java.
• Hands-on experience with Apache Spark for distributed data processing.
• Proficiency in SQL and relational databases.
• Strong working knowledge of Linux/Unix operating systems.
• Experience in application/server-side development and microservices-based architectures.
• Experience designing, building, and integrating analytical and data processing systems.
• Strong understanding of data structures, algorithms, object-oriented design principles, and multithreading.
• Experience with RESTful APIs and system integration.
• Excellent problem-solving and debugging skills.

Preferred Qualifications

• Experience with cloud platforms such as AWS, Azure, or GCP.
• Knowledge of Hadoop ecosystem technologies.
• Experience with containerization technologies such as Docker and Kubernetes.
• Familiarity with CI/CD tools and DevOps practices.
• Experience working in Agile/Scrum environments.
• Strong analytical and problem-solving skills.
• Ability to work independently and collaboratively in a fast-paced environment.
• Excellent communication and stakeholder management skills.
• Commitment to delivering high-quality, scalable, and maintainable solutions.

Nice to Have