Data Engineer

Valiant Technologies LLC; Houston (TX); Presencial; USD 120.000 - 160.000; Jornada completa

Descripción de la vacante

Valiant Technologies LLC is seeking a data engineer to design, build, and maintain scalable data pipelines across structured, semi-structured, and unstructured data sources. You will implement ingestion, transformation with dbt, and manage Snowflake as the central data platform in an AWS-based environment.

Collaborate with data architects and business stakeholders to define trusted data products, ensure data quality, governance, and security, and support analytics and AI use cases.

Responsabilidades

• Design, build, and maintain scalable data pipelines across structured, semi-structured, and unstructured data sources.
• Develop data ingestion and extract-load processes using Informatica, aligning with enterprise standards and existing in-house capabilities.
• Build transformation logic using dbt, including modular models, testing, documentation, and deployment workflows.
• Design and manage data structures in Snowflake, with Snowflake positioned as the central strategic data platform.
• Work with AWS-based data services and infrastructure, supporting applications and data products running in the organization’s AWS environment.
• Support data architecture using Iceberg managed tables, including open table formats, interoperability, cataloging, and governed access patterns.
• Use Snowflake Catalog and Snowflake Horizon to support metadata management, data discovery, governance, lineage, policy enforcement, and trusted data sharing.
• Collaborate with data architects, governance teams, analysts, application teams, and business stakeholders to define trusted data products.
• Work with domain experts to understand business concepts, entities, relationships, and terminology.
• Support ontology-driven modeling, including entity definitions, taxonomies, relationships, business glossaries, and semantic mappings.
• Translate business and domain concepts into logical data models, physical data models, and reusable data products.
• Implement data quality checks, validation rules, lineage, observability, and governance controls.
• Support data products and applications such as news intelligence, asset intelligence, analytics, and AI-enabled use cases.
• Ensure data solutions meet enterprise requirements for security, privacy, access control, performance, and reliability.

Descripción del empleo

• Design, build, and maintain scalable data pipelines across structured, semi-structured, and unstructured data sources.
• Develop data ingestion and extract-load processes using Informatica, aligning with enterprise standards and existing in-house capabilities.
• Build transformation logic using dbt, including modular models, testing, documentation, and deployment workflows.
• Design and manage data structures in Snowflake, with Snowflake positioned as the central strategic data platform.
• Work with AWS-based data services and infrastructure, supporting applications and data products running in the organization’s AWS environment.
• Support data architecture using Iceberg managed tables, including open table formats, interoperability, cataloging, and governed access patterns.
• Use Snowflake Catalog and Snowflake Horizon to support metadata management, data discovery, governance, lineage, policy enforcement, and trusted data sharing.
• Collaborate with data architects, governance teams, analysts, application teams, and business stakeholders to define trusted data products.
• Work with domain experts to understand business concepts, entities, relationships, and terminology.
• Support ontology-driven modeling, including entity definitions, taxonomies, relationships, business glossaries, and semantic mappings.
• Translate business and domain concepts into logical data models, physical data models, and reusable data products.
• Implement data quality checks, validation rules, lineage, observability, and governance controls.
• Support data products and applications such as news intelligence, asset intelligence, analytics, and AI-enabled use cases.
• Ensure data solutions meet enterprise requirements for security, privacy, access control, performance, and reliability.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.