Generative AI Data Engineer — Hybrid & Flexible

Compare The Market; Brisbane; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Flexible work options

One day WFH per week

ME leave and Volunteer Day leave

Free coffee on Mondays

Additional leave purchase

Return To Work bonus

Recognition program

Job summary

Compare The Market is seeking an AI Data Engineer to design and deliver scalable AI-enabled data solutions that accelerate the company’s adoption of Generative and agentic AI. You will work across a cloud data platform to build intelligent automation, reusable AI services, and AI-ready capabilities for data discovery, decision-making, and delivery.

The role requires 4+ years across GenAI, data engineering, or data science, with hands-on experience in LangChain, LlamaIndex, PyTorch, and

Qualifications

• Bachelor’s degree in Computer Science, Data Science, Mathematics, or a related discipline.
• 4+ years’ experience across GenAI, Data, Software or Integration Engineering, or Data Science, delivering enterprise-scale solutions.
• Strong Generative and Agentic AI experience across LLMs, RAG, vector search, embeddings, AI agents, tool calling, and multi-agent architectures.
• Experience building AI-powered applications, including copilots, chatbots, knowledge assistants, intelligent automation, and agent workflows.

Responsibilities

• Build AI-driven data solutions and agent-based products supporting Generative AI, advanced analytics, automation, and data discovery.
• Develop and operationalise LLMs, RAG, semantic search, vector retrieval, embeddings, and knowledge management capabilities.
• Build agentic AI solutions using AI agents, orchestration frameworks, multi-agent architectures, automation, APIs, and reusable services.
• Champion MLOps and LLMOps practices including monitoring, observability, benchmarking, experiment tracking, and token management.
• Drive AI innovation, performance, cost optimisation, governance, security, privacy, and Responsible AI.

Skills

GenAI experience

LLMs & RAG

AI agents & tool calling

MLOps & LLMops

Cloud data platforms

Education

Bachelor's degree in CS/Data Science

Tools

LangChain

LangGraph

LlamaIndex

Hugging Face

PyTorch

Semantic Kernel

CrewAI

Copilot Studio

Job description

Compare The Market is seeking an AI Data Engineer to design and deliver scalable AI-enabled data solutions that accelerate the company’s adoption of Generative and agentic AI. You will work across a cloud data platform to build intelligent automation, reusable AI services, and AI-ready capabilities for data discovery, decision-making, and delivery.

The role requires 4+ years across GenAI, data engineering, or data science, with hands-on experience in LangChain, LlamaIndex, PyTorch, and