AI-Driven Data Platform Engineer (Azure Databricks)

Goodfit; Hinoba-an; On-site; PHP 900,000 - 1,200,000; Full time

Job summary

Goodfit is seeking a Data Engineer to build and operate modern data platforms on Azure Databricks, collaborating with a Senior Architect from ingestion to production support. You’ll take ownership of platform/DevOps aspects and drive end-to-end delivery.

You will implement batch and streaming data pipelines, develop analytics-ready datasets and dashboards, and leverage AI-assisted tooling to improve efficiency and reliability across the data platform.

Qualifications

• 4-6 years of hands-on experience in Data Engineering / Data Platforms.
• Strong Python/PySpark and SQL skills.
• Strong hands-on experience with Azure Databricks, Delta Lake and Medallion Architecture.
• Experience with batch + real-time/streaming data engineering.
• Hands-on experience with Unity Catalog, Databricks Workflows/Jobs and Structured Streaming.
• Experience with ADLS Gen2, Event Hubs, Azure DevOps/Git and Key Vault.
• Good understanding of CI/CD, cloud security and production operations.
• Hands-on experience with a BI/dashboarding tool.
• Strong problem-solving and ownership mindset.
• Comfortable using AI coding assistants/agents and eager to adopt emerging AI-native engineering practices.

Responsibilities

• Build scalable batch and real-time data pipelines using Databricks, PySpark, SQL and Delta Lake.
• Implement Medallion Architecture (Bronze/Silver/Gold) and governed data products using Unity Catalog.
• Build streaming solutions using Structured Streaming and Azure Event Hubs.
• Work with ADLS Gen2, Azure Key Vault and Azure DevOps.
• Own CI/CD, deployment automation, monitoring and production troubleshooting.
• Optimize data pipelines and Databricks workloads for performance, reliability and cost.
• Build analytical datasets and dashboards using BI/visualization tools.
• Develop data products that can support analytics, ML and GenAI applications.
• Leverage AI agents and AI-native developer tools for coding, testing, documentation, troubleshooting and automation.
• Collaborate with architects, analysts and business stakeholders to deliver production-ready solutions.

Skills

Python/PySpark

SQL

Ownership mindset

AI-assisted development

Tools

Azure Databricks

Delta Lake

Medallion Architecture

Unity Catalog

Databricks Workflows/Jobs

ADLS Gen2

Event Hubs

Azure DevOps/Git

Key Vault

BI/Dashboarding tool

Job description

Goodfit is seeking a Data Engineer to build and operate modern data platforms on Azure Databricks, collaborating with a Senior Architect from ingestion to production support. You’ll take ownership of platform/DevOps aspects and drive end-to-end delivery.

You will implement batch and streaming data pipelines, develop analytics-ready datasets and dashboards, and leverage AI-assisted tooling to improve efficiency and reliability across the data platform.