Data Engineer

Machine Learning Technologies, LLC; Houston (TX); Presencial; USD 110.000 - 170.000; Jornada completa

Descripción de la vacante

Machine Learning Technologies, LLC seeks a data engineer to design, build, and maintain scalable data pipelines across diverse data sources. You will implement ingestion using Informatica, craft transformations with dbt, and shape Snowflake data structures as the central platform.

You will work with AWS services, governance teams, and domain experts to ensure secure, reliable data products and semantic mappings across the enterprise.

Formación

• Design, build, and maintain scalable data pipelines across structured, semi-structured, and unstructured data sources.
• Develop data ingestion and extract-load processes using Informatica, aligning with enterprise standards and existing in-house capabilities.
• Build transformation logic using dbt, including modular models, testing, documentation, and deployment workflows.
• Design and manage data structures in Snowflake, with Snowflake positioned as the central strategic data platform.
• Work with AWS-based data services and infrastructure, supporting applications and data products running in the organization’s AWS environment.
• Support ontology-driven modeling, including entity definitions, taxonomies, relationships, business glossaries, and semantic mappings.

Responsabilidades

• Design, build, and maintain scalable data pipelines across structured, semi-structured, and unstructured data sources.
• Develop data ingestion and extract-load processes using Informatica, aligning with enterprise standards and existing in-house capabilities.
• Build transformation logic using dbt, including modular models, testing, documentation, and deployment workflows.
• Design and manage data structures in Snowflake, with Snowflake positioned as the central strategic data platform.
• Work with AWS-based data services and infrastructure, supporting applications and data products running in the organization’s AWS environment.
• Support data architecture using Iceberg managed tables, including open table formats, interoperability, cataloging, and governed access patterns.
• Use Snowflake Catalog and Snowflake Horizon to support metadata management, data discovery, governance, lineage, policy enforcement, and trusted data sharing.
• Collaborate with data architects, governance teams, analysts, application teams, and business stakeholders to define trusted data products.
• Work with domain experts to understand business concepts, entities, relationships, and terminology.
• Support ontology-driven modeling, including entity definitions, taxonomies, relationships, business glossaries, and semantic mappings.
• Translate business and domain concepts into logical data models, physical data models, and reusable data products.
• Implement data quality checks, validation rules, lineage, observability, and governance controls.
• Support data products and applications such as news intelligence, asset intelligence, analytics, and AI-enabled use cases.
• Ensure data solutions meet enterprise requirements for security, privacy, access control, performance, and reliability.

Conocimientos

ETL/ELT

Snowflake modeling

dbt development

Informatica

AWS data services

Herramientas

dbt

AWS

Iceberg

Governance tools

Metadata mgmt

Descripción del empleo

• Design, build, and maintain scalable data pipelines across structured, semi-structured, and unstructured data sources.
• Develop data ingestion and extract-load processes using Informatica, aligning with enterprise standards and existing in-house capabilities.
• Build transformation logic using dbt, including modular models, testing, documentation, and deployment workflows.
• Design and manage data structures in Snowflake, with Snowflake positioned as the central strategic data platform.
• Work with AWS-based data services and infrastructure, supporting applications and data products running in the organization’s AWS environment.
• Support data architecture using Iceberg managed tables, including open table formats, interoperability, cataloging, and governed access patterns.
• Use Snowflake Catalog and Snowflake Horizon to support metadata management, data discovery, governance, lineage, policy enforcement, and trusted data sharing.
• Collaborate with data architects, governance teams, analysts, application teams, and business stakeholders to define trusted data products.
• Work with domain experts to understand business concepts, entities, relationships, and terminology.
• Support ontology-driven modeling, including entity definitions, taxonomies, relationships, business glossaries, and semantic mappings.
• Translate business and domain concepts into logical data models, physical data models, and reusable data products.
• Implement data quality checks, validation rules, lineage, observability, and governance controls.
• Support data products and applications such as news intelligence, asset intelligence, analytics, and AI-enabled use cases.
• Ensure data solutions meet enterprise requirements for security, privacy, access control, performance, and reliability.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.