Software Engineer

Exigo Tech; Sydney; In loco; AUD 100.000 - 140.000; Tempo pieno

Descrizione del lavoro

Exigo Tech in Sydney is seeking a Software Engineer/Developer to design, build, and support scalable backend services and data-processing solutions. You will work with .NET Core, Python, PySpark, Spark, Hadoop-YARN, Trino, Delta Lake, Docker, PostgreSQL, and Linux to translate requirements into secure, maintainable production systems.

The role emphasizes performance, reliability, and platform scalability within a collaborative delivery team.

Competenze

• Bachelor's degree or equivalent practical experience.
• Minimum 3.5 years of relevant professional experience in software development, backend engineering, data engineering, or a closely related role.
• Strong programming capability in C# and Python, with practical SQL experience.
• Hands-on experience developing .NET Core / ASP.NET Web APIs and REST-based integrations.
• Experience with PySpark and Apache Spark for distributed processing of large datasets.
• Working knowledge of Hadoop and YARN, including cluster execution concepts and resource management.

Mansioni

• Design, develop, test, deploy, and maintain backend services using C#, .NET Core, and ASP.NET Web API.
• Build secure, reliable RESTful APIs that expose processed reporting data and integrate application and data platforms.
• Develop and optimize high-volume reporting and data-processing pipelines using Python, PySpark, and Apache Spark.
• Implement data transformation, validation, reconciliation, and error-handling controls to support accurate, dependable outputs.
• Work with Spark in standalone and cluster modes, including driver and executor behavior, resource allocation, job execution, and performance tuning.
• Contribute to scalable Hadoop-YARN architectures and support the migration or improvement of distributed workloads.
• Use Trino for distributed SQL processing and Delta Lake / Delta Parquet for efficient storage, querying, and data management.
• Package and deploy Spark, Trino, and related services using Docker; maintain consistent configuration across environments.
• Deploy, monitor, and troubleshoot workloads in production Linux environments, including job scheduling through cron and crontab.

Conoscenze

C#

Python

SQL

C++ exposure

Formazione

Bachelor's degree in Computer Science, Information Technology, Software Engineering, or related discipline

Strumenti

Docker

Linux

PostgreSQL

PySpark

Apache Spark

Hadoop

YARN

Trino

Delta Lake

Descrizione del lavoro

Exigo Tech is a Sydney-based Technology Solutions Provider focused on providing solutions on three major verticals; Infrastructure, Cloud, and Application to businesses across Australia. We help companies reach operational efficiencies by empowering them with technology solutions that drive their business processes.

Exigo Tech is currently looking for a Software Engineer/ Developer (full-time)

Role Overview

We are seeking an experienced Software Developer to design, build, and support scalable backend services and distributed data-processing solutions. The role combines .NET-based API development with Python and PySpark engineering across Apache Spark, Hadoop-YARN, Trino, Delta Lake, Docker, PostgreSQL, and Linux environments. The successful candidate will translate business and reporting requirements into secure, maintainable, production-ready solutions and contribute to performance, reliability, and platform scalability.

Responsibilities

• Design, develop, test, deploy, and maintain backend services using C#, .NET Core, and ASP.NET Web API.
• Build secure, reliable RESTful APIs that expose processed reporting data and integrate application and data platforms.
• Develop and optimize high-volume reporting and data-processing pipelines using Python, PySpark, and Apache Spark.
• Implement data transformation, validation, reconciliation, and error-handling controls to support accurate, dependable outputs.
• Work with Spark in standalone and cluster modes, including driver and executor behavior, resource allocation, job execution, and performance tuning.
• Contribute to scalable Hadoop-YARN architectures and support the migration or improvement of distributed workloads.
• Use Trino for distributed SQL processing and Delta Lake / Delta Parquet for efficient storage, querying, and data management.
• Package and deploy Spark, Trino, and related services using Docker; maintain consistent configuration across environments.
• Deploy, monitor, and troubleshoot workloads in production Linux environments, including job scheduling through cron and crontab.

Technical Skills

• Core programming : C#, Python, SQL; C++ exposure is advantageous
• Data and distributed systems : Apache Spark, PySpark, Hadoop, YARN, Trino, Delta Lake / Delta Parquet
• Infrastructure and operations : Docker, Linux (Ubuntu), cron / crontab, Spark cluster configuration and deployment
• Additional exposure : Angular, Unity (C#), or Unreal Engine (C++) is advantageous but not essential
• Analytical problem-solving and structured troubleshooting
• Ownership, accountability, and attention to production quality
• Scalable solution design and performance awareness
• Cross-functional collaboration and requirement interpretation
• Adaptability across application, data, and infrastructure layers
• Clear technical documentation and knowledge sharing

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related discipline, or equivalent practical experience.
• Minimum 3.5 years of relevant professional experience in software development, backend engineering, data engineering, or a closely related role.
• Strong programming capability in C# and Python, with practical SQL experience.
• Hands-on experience developing .NET Core / ASP.NET Web APIs and REST-based integrations.
• Hands-on experience with PySpark and Apache Spark for distributed processing of large datasets.
• Working knowledge of Hadoop and YARN, including cluster execution concepts and resource management.
• Experience with Docker and production Linux environments, preferably Ubuntu.
• Experience with PostgreSQL or a comparable relational database.
• Ability to diagnose application, data-pipeline, and infrastructure issues using logs, metrics, and systematic troubleshooting.
• Clear written and verbal communication, sound analytical judgment, and the ability to work effectively in a collaborative delivery team.
• with clear career growth opportunities.
• Work with cutting-edge Microsoft Cloud and IT infrastructure technologies.
• A culture of collaboration, innovation, and accountability—we get things done.
• Competitive salary - AU $100k - AU $140k.