Data Engineer

Quantum Technologies. LLC; Houston (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Quantum Technologies. LLC is seeking a Data Engineer to design, build, and scale a modern cloud data platform centered on Snowflake and AWS. You will work with ontology-driven modeling, metadata, and governed data products to enable analytics, AI, and BI use cases.

The role emphasizes data ingestion, transformation, and governance, with collaboration across governance teams, analysts, and business stakeholders. Strong SQL and Python skills are required.

Qualifications

• Strong experience in data engineering, data modeling, ETL/ELT, and cloud data platform development.
• Hands-on Snowflake experience with data modeling, performance optimization, and access controls.
• Experience working in AWS cloud environments.
• Experience with Informatica for ingestion and data integration patterns.
• Experience with dbt for transformations, testing, and analytics workflows.
• Understanding of Iceberg/open table formats, schema evolution, and catalog access.
• Familiarity with data cataloging, governance, lineage, metadata management, and policy-driven data access.
• Knowledge of ontology, semantic modeling, taxonomies, business glossaries, or knowledge graphs.
• Strong SQL skills and Python or similar data language.
• Ability to translate business concepts into data entities and metrics.

Responsibilities

• Design, build, and maintain scalable data pipelines across structured, semi-structured, and unstructured data.
• Develop ingestion and ETL/ELT processes using Informatica in line with enterprise standards.
• Build modular transformation logic using dbt, with tests and documentation.
• Design and manage Snowflake data structures as the central platform.
• Work with AWS data services to support apps and data products in AWS.
• Support governance using Iceberg managed tables, cataloging, and access controls.
• Use Snowflake Catalog and Horizon for metadata management, discovery, lineage, and data sharing.
• Collaborate with data architects, governance teams, analysts, and stakeholders to define trusted data products.
• Work with domain experts to model entities, relationships, and terminology.
• Implement data quality checks, observability, and governance controls.

Skills

Data engineering

ETL/ELT

Cloud data platforms

SQL

Python

Data modeling

Data governance

Communication

Tools

Snowflake

AWS

Informatica

dbt

Iceberg

Snowflake Horizon

Snowflake Catalog

Job description

Job Description:

Focus:

Snowflake, AWS, Iceberg, Data Governance, and Ontology-Driven Data Models

Data Architect- Familiarity with data cataloging, governance, lineage, metadata management, and policy-driven data access.

Understanding of ontology, semantic modeling, taxonomies, business glossaries, or knowledge graph concepts. + Claude Mandatory + AWS working knowledge + Oil and Natural Gas MidStream Domain

Role Summary:

We are looking for a Data Engineer to help design, build, and scale a modern cloud data platform centered on Snowflake and AWS. The ideal candidate has strong data engineering fundamentals, experience with enterprise data platforms, and the ability to work with ontologies, semantic models, metadata, and governed data products.

This role will support strategic data initiatives using Snowflake, AWS, Iceberg managed tables, Snowflake Catalog, Snowflake Horizon, Informatica, and dbt. The Data Engineer will help create trusted, reusable data assets that support applications, analytics, AI, and business intelligence use cases.

Key Responsibilities:

• Design, build, and maintain scalable data pipelines across structured, semi-structured, and unstructured data sources.
• Develop data ingestion and extract-load processes using Informatica, aligning with enterprise standards and existing in-house capabilities.
• Build transformation logic using dbt, including modular models, testing, documentation, and deployment workflows.
• Design and manage data structures in Snowflake, with Snowflake positioned as the central strategic data platform.
• Work with AWS-based data services and infrastructure, supporting applications and data products running in the organization’s AWS environment.
• Support data architecture using Iceberg managed tables, including open table formats, interoperability, cataloging, and governed access patterns.
• Use Snowflake Catalog and Snowflake Horizon to support metadata management, data discovery, governance, lineage, policy enforcement, and trusted data sharing.
• Collaborate with data architects, governance teams, analysts, application teams, and business stakeholders to define trusted data products.
• Work with domain experts to understand business concepts, entities, relationships, and terminology.
• Support ontology-driven modeling, including entity definitions, taxonomies, relationships, business glossaries, and semantic mappings.
• Translate business and domain concepts into logical data models, physical data models, and reusable data products.
• Implement data quality checks, validation rules, lineage, observability, and governance controls.
• Support data products and applications such as news intelligence, asset intelligence, analytics, and AI-enabled use cases.
• Ensure data solutions meet enterprise requirements for security, privacy, access control, performance, and reliability.

Required Skills:

• Strong experience in data engineering, data modeling, ETL/ELT, and cloud data platform development.
• Hands-on experience with Snowflake, including data modeling, performance optimization, access controls, and scalable warehouse/lakehouse patterns.
• Experience working in AWS cloud environments.
• Experience with Informatica or similar enterprise data integration platforms for extract-load and ingestion patterns.
• Experience with dbt for data transformations, testing, documentation, and analytics engineering workflows.
• Understanding of Apache Iceberg or open table formats, including managed tables, schema evolution, interoperability, and catalog-based access.
• Familiarity with data cataloging, governance, lineage, metadata management, and policy-driven data access.
• Understanding of ontology, semantic modeling, taxonomies, business glossaries, or knowledge graph concepts.
• Strong SQL skills and experience with Python or another data engineering language.
• Ability to work with business stakeholders to define data entities, relationships, metrics, and data product requirements.
• Strong communication, documentation, and problem-solving skills.

Preferred Skills:

• Experience with Snowflake Catalog and Snowflake Horizon.
• Experience building governed data products for analytics, AI, or application use cases.
• Experience with enterprise governance tooling, especially Informatica governance capabilities.
• Experience with RDF, OWL, SHACL, SPARQL, graph databases, or knowledge graph platforms.
• Experience designing semantic layers, business glossaries, metadata models, or domain ontologies.
• Experience with CI/CD, Git, automated testing, and deployment workflows for data pipelines.
• Experience with data observability, lineage tracking, data contracts, and data quality frameworks.
• Experience working in complex enterprise data environments with multiple systems, domains, and stakeholder groups.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.