Data Engineer

Access UK; Kuala Lumpur; Hybrid; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Health contribution

25 days leave

Charity days

Hybrid office

Job summary

Access Group is seeking a passionate Data Engineer to design, build, and operate scalable data pipelines on Databricks, ingesting data from APIs and shaping models with dimensional and medallion architectures.

You will work with stakeholders across product, engineering, analytics, and business teams to deliver reliable, end-to-end data solutions, leveraging AI-assisted development while ensuring data quality and governance.

Qualifications

• 3-5 years of professional experience in Data Engineering.
• Strong hands-on experience with Databricks, including Spark/PySpark, SQL, Delta Lake, and Databricks Workflows.
• Experience building and supporting API-driven data ingestion pipelines.
• Solid understanding of dimensional modelling and layered/medallion data architectures.
• Experience with data engineering frameworks and tools, including orchestration, testing, CI/CD, and Git-based development practices.
• Strong programming skills in Python and SQL.
• Experience working with structured and unstructured data sources.
• Understanding of AI-assisted development and the practical use of AI in data engineering workflows, including development, testing, documentation, and validation.
• Strong communication and stakeholder management skills.

Responsibilities

• Design, build, and operate reliable data pipelines on Databricks, from ingestion through to curated, consumption-ready data layers.
• Ingest data from internal and third-party APIs, managing authentication, pagination, schema evolution, rate limiting, retries, and incremental loading.
• Develop and maintain scalable data models using dimensional and medallion architecture principles to support analytics, reporting, and downstream applications.
• Apply modern data engineering best practices, including modular development, automated testing, orchestration, CI/CD pipelines, version control, and environment promotion.
• Monitor data pipeline performance, quality, reliability, and cost efficiency, proactively resolving issues before they impact users.
• Collaborate with product, engineering, analytics, and business teams to deliver robust end-to-end data solutions.
• Leverage AI-assisted development tools and agentic workflows to accelerate coding, testing, documentation, and solution design while maintaining accountability for quality and outcomes.
• Identify opportunities for automation and continuous improvement across the data platform.
• Contribute to engineering standards, documentation, peer reviews, and knowledge-sharing initiatives.

Skills

Databricks

Spark/PySpark

SQL

Delta Lake

APIs ingestion

Dimensional modelling

Medallion architecture

Orchestration/CI/CD

Python

Data wrangling

Communication

Tools

Databricks

Azure DevOps

Git-based workflows

Neo4j

Job description

We're looking for people to join the Access family, who share our passion for believing in better, and who will help us continue to grow.

Love Work. Love Life. Be You. - is central to our success and how we give our customers the freedom to do more of what's important to them.

What does Access offer you?

We offer a blended approach to office working, encouraging you to collaborate and connect in one of our thriving offices. We deliver on what we say, taking the development of our people seriously. We'll work with you to progress your success plan and provide opportunities to accelerate your career.

On top of a competitive salary, our wellbeing days taking you to 25 days leave a year and a health contribution, you'll also be able to choose from a range of benefits to suit you. We're an organisation that likes to give back, so you'll also have three charity days allocated to support a cause that matters to you.

About You

You are a passionate Data Engineer who enjoys building scalable, high-quality data solutions that drive business value. You thrive in a fast-paced environment where innovation, automation, and continuous improvement are encouraged.

You bring a strong foundation in modern data engineering practices and enjoy solving complex data challenges. You're equally comfortable collaborating with technical teams and business stakeholders, ensuring data is reliable, accessible, and actionable.

You're excited by emerging AI technologies and understand how to leverage AI-powered tools to enhance productivity while maintaining engineering excellence and data quality.

Day-to-day, you will:

• Design, build, and operate reliable data pipelines on Databricks, from ingestion through to curated, consumption-ready data layers.
• Ingest data from internal and third-party APIs, managing authentication, pagination, schema evolution, rate limiting, retries, and incremental loading.
• Develop and maintain scalable data models using dimensional and medallion architecture principles to support analytics, reporting, and downstream applications.
• Apply modern data engineering best practices, including modular development, automated testing, orchestration, CI/CD pipelines, version control, and environment promotion.
• Monitor data pipeline performance, quality, reliability, and cost efficiency, proactively resolving issues before they impact users.
• Collaborate with product, engineering, analytics, and business teams to deliver robust end-to-end data solutions.
• Leverage AI-assisted development tools and agentic workflows to accelerate coding, testing, documentation, and solution design while maintaining accountability for quality and outcomes.
• Identify opportunities for automation and continuous improvement across the data platform.
• Contribute to engineering standards, documentation, peer reviews, and knowledge-sharing initiatives.

Your skills and experiences might also include:

Essential

• 3-5 years of professional experience in Data Engineering.
• Strong hands-on experience with Databricks , including Spark/PySpark, SQL, Delta Lake, and Databricks Workflows.
• Experience building and supporting API-driven data ingestion pipelines.
• Solid understanding of dimensional modelling and layered/medallion data architectures.
• Experience with data engineering frameworks and tools, including orchestration, testing, CI/CD, and Git-based development practices.
• Strong programming skills in Python and SQL.
• Experience working with structured and unstructured data sources.
• Understanding of AI-assisted development and the practical use of AI in data engineering workflows, including development, testing, documentation, and validation.
• Strong communication and stakeholder management skills.

Desirable

• Experience with AI-assisted development tools such as Claude Code, OpenAI Codex, GitHub Copilot CLI, or Devin.
• Experience working with Neo4j or other graph databases, including graph modelling and Cypher.
• Experience with NoSQL technologies and non-relational data stores.
• Exposure to Azure services, including Entra ID and Azure DevOps.
• Experience handling observability, monitoring, security, vulnerability, or infrastructure-related datasets.
• Familiarity with Business Intelligence platforms and reporting tools.
• Experience developing lightweight services or APIs using frameworks such as FastAPI.

What are we all about?

The Access Group is one of the largest UK-headquartered business management software providers. It provides solutions that empower more than 160,000 small and mid-sized organisations in commercial and non-profit sectors across Europe, USA and APAC, giving every employee the freedom to do more of what's important. Its innovative cloud solutions and integrated AI software experience across multiple Access products transform how business technology is used.

With over 9,300 talented individuals driving innovation and customer excellence, we're shaping the future of work. And we want you to be part of it. At Access, people are at the heart of