Data Engineer: GenAI Pipelines on AWS & Databricks

Assurity Trusted Solutions Pte Ltd; Santo Niño 1st; On-site; PHP 600,000 - 1,000,000; Full time

Benefits offered by this job

GovTech affiliation

Annual training budget

Performance bonus

Job summary

Assurity Trusted Solutions is seeking a Data Engineer to design, build, and optimize scalable data pipelines powering business insights and GenAI use cases. You will work with Databricks on AWS, model data for BI tools like Tableau, and collaborate with data scientists to operationalize GenAI workflows.

The role requires 3+ years in data engineering, strong PySpark/SQL, AWS, and Python with source control. You will contribute to data security and governance while driving scalable engineering

Qualifications

• 3+ years of experience in data engineering or a similar technical role.
• Strong experience with Databricks, Spark (PySpark/SQL), and AWS services (S3, Glue, Lambda, Redshift, Athena).
• Solid understanding of data warehouse design, data modeling, and performance tuning.
• Hands-on experience with Tableau or other BI/reporting tools.
• Familiarity with GenAI or LLM applications—deploying models via API, integrating embedding stores, or managing text/chat pipelines.
• Proficient in Python and strong understanding of version control (Git).
• Knowledge of API design, data orchestration (Airflow, dbt), and CI/CD practices.
• Excellent problem-solving, communication, and documentation skills.

Responsibilities

• Design, build, and maintain robust ETL/ELT pipelines using Databricks (PySpark, SQL) on AWS-based data platforms.
• Develop and optimize data models and tables to support BI tools such as Tableau and internal reporting use cases.
• Collaborate with data scientists and AI engineers to operationalize GenAI models, including orchestrating data dependencies, prompt stores, and inference pipelines.
• Implement monitoring, version control, and quality standards across ETL workflows and data schemas.
• Collaborate with business teams to translate data requirements into scalable engineering solutions.
• Ensure data security and compliance with organizational and regional guidelines.

Skills

Data engineering

ETL/ELT

Data modeling

Python

Git

API design

Airflow

dbt

CI/CD

GenAI/LLM familiarity

Tableau

Problem-solving

Communication

Documentation

Tools

Databricks

Spark

PySpark/SQL

AWS

Tableau

Airflow

dbt

Git

CI/CD

Job description

Assurity Trusted Solutions is seeking a Data Engineer to design, build, and optimize scalable data pipelines powering business insights and GenAI use cases. You will work with Databricks on AWS, model data for BI tools like Tableau, and collaborate with data scientists to operationalize GenAI workflows.

The role requires 3+ years in data engineering, strong PySpark/SQL, AWS, and Python with source control. You will contribute to data security and governance while driving scalable engineering