Staff Data Platform Engineer

TrendMicro; Austin (TX); Sur place; USD 170 000 - 210 000; Plein temps

Avantages offerts par ce poste

Comprehensive medical, dental and visi

Life insurance

Short & Long Term Disability

Paid Time Off 14 Annual Holidays

Tuition Assistance

Employee Resource Groups

Résumé du poste

TrendAI is seeking a Staff Data Engineer to design and build the Vision One Data Platform, enabling data discovery, governance, and self-service analytics for product teams across OLTP sources.

You will lead data platform architecture, implement CDC pipelines, and collaborate with security and product teams to ensure scalable, reliable data movement and accessible semantic data discovery.

Qualifications

• 8+ years of experience in data engineering, distributed systems, backend engineering, or a related field.
• Strong experience designing and building large-scale data platforms and data pipelines.
• Deep understanding of OLTP and OLAP architectures and the tradeoffs between them.
• Hands-on experience with CDC, data replication, and streaming architectures.

Responsabilités

• Design and build the Vision One Data Platform, including data ingestion, replication, transformation, governance, discovery, and serving capabilities.
• Build scalable data pipelines and change-data-capture (CDC) architectures using Datastream and similar streaming/replication technologies.
• Enable self-service dbt across Vision One OLTP data sources, providing product teams with governed capabilities to transform, model, test, document, and expose their data.
• Establish patterns for safely extracting and replicating data from OLTP and distributed SQL databases into analytical and downstream data systems.
• Design architectures around distributed SQL technologies such as YugabyteDB, CockroachDB, or similar platforms.
• Work with technologies such as Databricks and modern analytical processing engines to support large-scale data processing and analytics.
• Build a comprehensive data catalog and metadata foundation that enables teams and AI agents to understand what data exists, where it comes from, what it means, and how it can be used.
• Develop semantic data discovery capabilities that allow engineers, analysts, applications, and AI agents to discover relevant data based on business meaning rather than only database/schema names.

Connaissances

Data engineering

Distributed systems

SQL

dbt

CDC

Data governance

Python

API design

CI/CD

Outils

YugabyteDB

CockroachDB

Datastream

Databricks

Spark

Snowflake

BigQuery

Kafka

dbt

Description du poste

TrendAI is seeking a Staff Data Engineer to design and build the Vision One Data Platform, enabling data discovery, governance, and self-service analytics for product teams across OLTP sources.

You will lead data platform architecture, implement CDC pipelines, and collaborate with security and product teams to ensure scalable, reliable data movement and accessible semantic data discovery.