Cloud & Data Engineer

Peritos Solutions; City of Brisbane; On-site; AUD 120,000 - 180,000; Full time

Job summary

Peritos Solutions is seeking a Cloud & Data Engineer in Brisbane to design, implement, automate, and support cloud infrastructure and data platforms. The role blends cloud engineering, DevOps, data engineering, security and cost optimisation.

You will work on customer projects and internal solutions, deploying across AWS and Azure with IaC, security controls, and cost management. Strong scripting and data skills are required.

Qualifications

• Hands-on AWS and/or Azure experience with practical cloud engineering.
• Experience with IaC tools such as Terraform, CloudFormation or equivalent.
• Strong SQL knowledge and data pipeline development skills.
• Proficiency in Python and/or PySpark for data processing.
• Familiarity with DevOps practices and CI/CD pipelines.
• Understanding of cloud security, cost optimisation and FinOps.
• Experience with BI tools like Power BI or cloud analytics services.
• Consulting or customer-facing project experience is a plus.
• Certification in AWS/Azure/DevOps is advantageous.

Responsibilities

• Design, deploy and manage cloud environments across AWS and Azure.
• Develop data ingestion, transformation and analytics pipelines.
• Implement IaC to automate provisioning and deployments.
• Configure networking, IAM, security groups and encryption.
• Perform Well-Architected reviews and cost optimisation.
• Build and maintain CI/CD pipelines and DevOps automation.
• Support cloud migrations and application modernisation.
• Collaborate with customers and internal teams on deliverables.

Skills

AWS & Azure

Terraform

Python

SQL

Power BI

DevOps

GitHub Actions

Security & FinOps

REST APIs

Education

Bachelor's degree in CS or related

Tools

Terraform

Azure DevOps

GitHub Actions

CloudFormation / ARM templates

Bicep

Job description

We are looking for a Cloud & Data Engineer with hands-on experience across AWS and Microsoft Azure to design, implement, automate, and support cloud infrastructure and modern data platforms. The role combines cloud engineering, DevOps, data engineering, security, and cost optimisation, working across customer projects and internal solutions.

Key Responsibilities

• Design, deploy, and manage cloud environments across AWS and Azure.
• Implement cloud infrastructure using Infrastructure as Code (IaC) such as Terraform, AWS CloudFormation, Bicep, or ARM templates.
• Configure networking including VPC/VNet, subnets, routing, security groups/NSGs, load balancers, VPNs, DNS and private endpoints.
• Implement secure identity and access using AWS IAM, Microsoft Entra ID, RBAC, roles and policies.
• Build and maintain compute solutions using EC2, Lambda, ECS/EKS, Azure VMs, Functions and AKS.
• Implement storage solutions using Amazon S3, EBS, Azure Blob Storage, ADLS Gen2 and Azure Files.
• Support cloud migrations and application modernisation initiatives.
• Perform AWS Well-Architected and Azure architecture reviews covering security, reliability, performance, operational excellence and cost.
• Configure monitoring, logging and alerting using CloudWatch, CloudTrail, Azure Monitor, Log Analytics and Application Insights.
• Implement backup, disaster recovery, high availability and business continuity solutions.
• Analyse cloud consumption and recommend cost optimisation and FinOps improvements.
• Design and develop scalable data ingestion and transformation pipelines.
• Build batch and near-real-time data processing solutions.
• Work with structured, semi-structured and unstructured datasets.
• Develop ETL/ELT pipelines using services such as:
• AWS Glue, Lambda, S3, Athena, Redshift, RDS and Step Functions
• Design data lake and lakehouse architectures.
• Develop data transformation processes using SQL, Python and PySpark.
• Implement data quality, validation, reconciliation and monitoring processes.
• Optimise data pipelines and queries for performance and cost.
• Support reporting and analytics platforms including Power BI and QuickSight.
• Implement appropriate data security, encryption, access controls and governance.

DevOps & Automation

• Build and maintain CI/CD pipelines using Azure DevOps, GitHub Actions, AWS CodePipeline or similar platforms.
• Automate cloud provisioning, deployment and operational activities.
• Work with Git-based branching, release and deployment processes.
• Implement environment management across Development, Test/UAT and Production.
• Support containerised workloads using Docker, Kubernetes, EKS and AKS.
• Implement automated security and compliance checks within deployment pipelines.
• Troubleshoot cloud infrastructure, deployment and application issues.

Security & Governance

• Apply AWS and Azure cloud security best practices.
• Implement least-privilege access and secure secrets management.
• Configure encryption, logging, monitoring and security controls.
• Support cloud governance, tagging, policies and compliance requirements.
• Assist with security assessments, vulnerability remediation and DevSecOps initiatives.
• Support implementation of AWS Control Tower/Security Hub/GuardDuty and Azure Policy/Defender for Cloud where applicable.

Required Technical Skills

• Strong hands-on experience with AWS and/or Microsoft Azure, with practical exposure to both preferred.
• AWS: EC2, S3, IAM, VPC, Lambda, RDS, CloudWatch, CloudTrail and Glue.
• Azure: VMs, Storage, VNet, Entra ID, Azure SQL, Data Factory, ADLS, Functions and Azure Monitor.
• Strong knowledge of SQL.
• Working knowledge of Python and/or PySpark.
• Experience with Terraform or another Infrastructure as Code technology.
• Experience building CI/CD pipelines.
• Understanding of REST APIs and system/data integration.
• Good understanding of cloud networking and security.
• Experience troubleshooting production cloud and data workloads.
• Microsoft Fabric, Databricks, Synapse or Redshift experience.
• Generative AI services such as Amazon Bedrock or Azure AI Foundry/Azure OpenAI.
• AWS Well-Architected Framework and Azure Cloud Adoption Framework knowledge.
• Power BI or Amazon QuickSight.
• FinOps and cloud cost optimisation.
• Experience working in consulting or customer-facing cloud projects.

Preferred Certifications

• AWS Certified Solutions Architect / Data Engineer / DevOps Engineer.
• Microsoft Azure Data Engineer or Fabric certification.
• Terraform Associate or equivalent certification.
• Strong analytical and troubleshooting skills.
• Ability to independently own technical deliverables.
• Good written and verbal communication.
• Ability to translate business requirements into technical solutions.
• Comfortable working across multiple customer environments and technologies.
• Strong documentation and knowledge-transfer skills.
• Ability to work collaboratively with architects, developers, data engineers, security teams and customer stakeholders