Staff Data Engineer - Data Platform

TrendMicro; Austin (TX); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Paid Time Off

Parental leave

Job summary

TrendAI is seeking a Staff Data Engineer to design and build the Vision One Data Platform, enabling data discovery, governance, and self-service data transformation with dbt across OLTP sources. You will shape data movement, lineage, and semantic discovery while collaborating with security and platform teams.

The role requires deep expertise in distributed SQL, CDC, and large-scale data processing using Databricks, Spark, and modern analytics engines.

Qualifications

• 8+ years of experience in data engineering, distributed systems, backend engineering, or a related field.
• Strong experience designing and building large-scale data platforms and data pipelines.
• Deep understanding of OLTP and OLAP architectures and tradeoffs.
• Hands-on experience with CDC, data replication, and streaming architectures.
• Strong SQL expertise and experience with relational databases at scale.

Responsibilities

• Design and build the Vision One Data Platform, including data ingestion, replication, transformation, governance, discovery, and serving capabilities.
• Build scalable data pipelines and CDC architectures using technologies such as Datastream and similar streaming/replication technologies.
• Enable self-service dbt across Vision One OLTP data sources, providing governed capabilities to transform, model, test, document, and expose data.
• Establish patterns for safely extracting and replicating data from OLTP and distributed SQL databases into analytical and downstream data systems.
• Design architectures around distributed SQL technologies such as YugabyteDB, CockroachDB, or similar platforms.
• Work with Databricks and modern analytical processing engines to support large-scale data processing and analytics.
• Build a comprehensive data catalog and metadata foundation for data understanding and reuse.
• Develop semantic data discovery capabilities enabling data discovery by business meaning.
• Establish data governance standards covering ownership, lineage, schemas, quality, access control, retention, and lifecycle management.
• Develop reusable data platform primitives and APIs for self-service consumption.
• Build automated mechanisms for data quality, schema evolution, lineage, observability, and freshness monitoring.
• Design for evolving product schemas and manage changes without duplication.
• Partner with security and platform teams for fine-grained data access controls.
• Help establish source-of-truth architecture and minimize duplication.
• Provide technical leadership and architectural guidance to other data engineers and product teams.
• Drive standards around reliability, scalability, performance, cost efficiency, and operational excellence.

Skills

SQL expertise

CDC experience

Data pipelines

Distributed systems

API design

CI/CD

Observability

Leadership

Tools

Datastream

dbt

Databricks

Spark

Trino

Snowflake

BigQuery

YugabyteDB

CockroachDB

Job description

About the Role

We are looking for a Staff Data Engineer – Data Platform to help design and build the next generation of the Vision One Data Platform. This is a highly technical, hands‑on role focused on creating a modern data foundation that enables Vision One engineering teams to discover, govern, access, transform, and analyze data across the platform. You will work at the intersection of distributed databases, data engineering, data governance, semantic discovery, and self‑service analytics. A key part of the role is enabling dbt as a self‑service data transformation and modeling capability across Vision One OLTP databases, while building the underlying architecture, governance, and data movement infrastructure required to do this reliably at scale. You will work closely with platform, product, security, and data engineering teams to establish common data standards and infrastructure that can be reused across Vision One.

What You’ll Do

Design and build the Vision One Data Platform, including data ingestion, replication, transformation, governance, discovery, and serving capabilities. Build scalable data pipelines and change‑data‑capture (CDC) architectures using technologies such as Datastream and similar streaming/replication technologies. Enable self‑service dbt across Vision One OLTP data sources, providing product teams with governed capabilities to transform, model, test, document, and expose their data without requiring the central data platform team to build every pipeline. Establish patterns for safely extracting and replicating data from OLTP and distributed SQL databases into analytical and downstream data systems. Design architectures around distributed SQL technologies such as YugabyteDB, CockroachDB, or similar platforms. Work with technologies such as Databricks and modern analytical processing engines to support large‑scale data processing and analytics. Build a comprehensive data catalog and metadata foundation that enables teams and AI agents to understand what data exists, where it comes from, what it means, and how it can be used. Develop semantic data discovery capabilities that allow engineers, analysts, applications, and AI agents to discover relevant data based on business meaning rather than only database/schema names. Establish data governance standards covering ownership, lineage, schemas, quality, access control, retention, and lifecycle management. Develop reusable data platform primitives and APIs that product teams can consume as self‑service capabilities. Build automated mechanisms for data quality, schema evolution, lineage, observability, and freshness monitoring. Design for evolving product schemas and ensure the platform can accommodate continuous changes without creating excessive duplication or operational overhead. Partner with security and platform engineering teams to establish appropriate fine‑grained data access controls across databases, schemas, tables, and data products. Help establish the source‑of‑truth architecture for Vision One data while minimizing unnecessary data duplication. Provide technical leadership and architectural guidance to other data engineers and product engineering teams. Drive engineering standards around reliability, scalability, performance, cost efficiency, and operational excellence.

What You Bring Required

8+ years of experience in data engineering, distributed systems, backend engineering, or a related field. Strong experience designing and building large‑scale data platforms and data pipelines. Deep understanding of OLTP and OLAP architectures and the tradeoffs between them. Hands‑on experience with CDC, data replication, and streaming architectures. Strong SQL expertise and experience working with relational databases at scale. Experience with distributed SQL databases, such as YugabyteDB, CockroachDB, Spanner, or similar technologies. Experience building data transformation workflows using dbt or similar data modeling frameworks. Experience with modern analytical/data platforms such as Databricks, Spark, Trino, Snowflake, BigQuery, or equivalent. Strong understanding of data governance concepts including metadata, lineage, data quality, ownership, access control, and data catalogs. Experience designing systems that support self‑service data consumption and transformation. Strong software engineering fundamentals, including API design, testing, CI/CD, observability, and production operations. Ability to work across organizational boundaries and influence architecture and engineering standards without relying solely on formal authority.

Preferred Qualifications

Experience building a company‑wide or platform‑level Data Platform rather than individual product pipelines. Experience with Datastream, Debezium, Kafka, or similar CDC/streaming technologies. Experience with YugabyteDB or CockroachDB in production environments. Experience operating Databricks or similar distributed data‑processing platforms. Experience designing data catalogs, semantic layers, knowledge graphs, or ontology‑driven data discovery. Experience building platforms that expose data to AI/agentic applications. Experience with data mesh, data products, or domain‑oriented data architectures. Experience implementing fine‑grained authorization for data platforms. Experience managing large‑scale telemetry, security, observability, or other high‑volume data. Experience balancing data quality, query performance, platform reliability, and infrastructure cost.

What Success Looks Like

In this role, you will help establish a Data Platform where: Vision One data can be discovered through a common semantic layer, rather than requiring teams to understand every underlying database and schema. Product teams can use dbt as a governed self‑service capability across their OLTP data. Data lineage, ownership, quality, and access policies are built into the platform rather than managed manually. Data can move reliably from distributed OLTP systems into analytical and downstream systems through standardized CDC and streaming patterns. Product teams can consume platform capabilities without repeatedly building their own ingestion, transformation, governance, and discovery infrastructure. The platform provides a trusted source of truth while minimizing unnecessary copies of data. The resulting data foundation can support not only traditional analytics and applications, but also AI and agentic experiences across Vision One.

Engineering Leadership

As a Staff Engineer, you will be expected to operate beyond the boundaries of a single team. You will shape architecture, establish technical standards, mentor engineers, drive cross‑team adoption, and solve ambiguous problems that span multiple products and systems. You should be comfortable going deep into implementation details while simultaneously thinking about the long‑term architecture of a large‑scale, multi‑product security data platform.

Why Join TrendAI?

TrendAI is a leader in AI security. We not only delivered the first open‑weight, cybersecurity‑focused large language model, but also the industry's first security companion agent evaluated directly by customers. Trend Vision One integrates endpoint, cloud, network, email, identity, AI application, and data security into a single, unified platform. In this role, you will help define how a security‑critical product is built — including how AI shapes the development process itself. You will partner with engineering leaders applying AI to that process, working in an environment where the bar on systems thinking, critical review, and security instinct has gone up, not down.

What We Offer You:

• Comprehensive medical, dental and vision insurance
• Life insurance
• Short & Long Term Disability
• Pre‑partum, maternity, parental and medical leave
• Mental Health Wellness Program
• Adoption Assistance
• Wellness Incentive
• Pet Insurance
• 401(k) with company match
• Paid Time Off 14
• Annual Holidays
• Tuition Assistance
• Employee Resource Groups

We offer competitive compensation with bonus opportunity tied to company performance, along with room to enhance your skills through ongoing learning and broad technological opportunities. Achieving work‑life balance is a priority, complemented by team activities, fostering an environment rooted in equity, inclusion, and collaboration, that is reflected in both our culture and our work.

Trend Micro provides equal employment opportunity for all applicants and employees.

Trend Micro does not unlawfully discriminate on the basis of race, color, religion, sex, pregnancy and childbirth or related medical conditions, national origin, ancestry, age, physical or mental disability, medical condition, family care leave status, veteran status, marital status, sexual orientation, or gender identity.

TrendAI, the global AI security leader and enterprise business unit of Trend Micro, empowers organizations with full AI visibility and consolidated security that inspires confidence, drives innovation, and eliminates risk. Trusted by the largest enterprises and governments across 185 countries, TrendAI secures the entire organization, from identities to infrastructure to data. We embrace change, empower our people, and foster innovation in an increasingly connected world. Our diverse, multicultural workforce is at the heart of our global success. At TrendAI, we’re always seeking exceptional talent; people who want to collaborate with the best and push boundaries together. Here, your work goes beyond building a career. You will help protect what matters and play a vital role in shaping a safer, more trustworthy AI-powered future. Explore working at TrendAI AI Fearlessly.