A complete application in a minute
Tailored resume and cover letter, ready to send.
XPT Software in Sydney is looking for a data engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform, enabling reliable batch and real-time processing.
You will leverage BigQuery for data warehousing, write efficient Python and SQL, and implement Dataflow/Beam workflows. Collaboration with analysts and stakeholders is essential to ensure governance and security.
Design, develop, and maintain scalable data pipelines using GCP services. Build and optimise ETL/ELT workflows for batch and real-time data processing. Work with Google BigQuery for data warehousing, SQL development, and query optimisation. Develop data processing solutions using Python, PySpark, and Apache Beam. Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub. Build and manage data lakes and data warehouses on Google Cloud. Implement data quality checks, data validation, and monitoring. Optimise pipeline performance, scalability, and cost efficiency. Collaborate with data analysts, data scientists, architects, and business teams. Ensure data security, governance, and compliance best practices.