Data Engineer / Metadata Engineer

Omniscius Consulting; Arlington (VA); In loco; USD 110.000 - 150.000; Tempo pieno

Descrizione del lavoro

Omniscius Consulting is seeking a Data Engineer / Metadata Engineer to design and deliver enterprise-grade data pipelines and metadata capabilities that support analytics and data management.

You will build scalable ETL/ELT workflows, develop metadata repositories and catalogs, enforce data governance, and partner with stakeholders to translate requirements into scalable, cloud-native solutions in Azure, AWS, or Google Cloud.

Competenze

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related field or equivalent experience.
• 3-7 years of experience in data engineering, metadata management, or related data platform roles.
• Experience building and maintaining ETL/ELT pipelines.
• Strong SQL development and database management skills.
• Experience with data warehousing and large-scale data processing.
• Understanding of metadata management, data lineage, and data catalog concepts.
• Strong problem-solving, analytical, and communication skills.
• Active Top Secret (TS) clearance.

Mansioni

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Integrate data from multiple structured and unstructured sources into enterprise data platforms.
• Correlate and integrate datasets internal and external to the customer organization.
• Develop and optimize data models, data warehouses, data lakes, and lakehouse architectures.
• Ensure pipeline performance, reliability, and scalability meet enterprise expectations.
• Implement automation and monitoring for ingestion and processing workflows.
• Design and maintain enterprise metadata repositories and data catalogs.
• Define and manage metadata standards across business, technical, and operational domains.
• Build automated metadata collection, classification, and enrichment processes.
• Maintain metadata lineage and enable impact analysis across data assets.
• Support data governance initiatives and stewardship models.
• Develop cloud-native data solutions in Azure, AWS, or Google Cloud environments.
• Contribute to infrastructure-as-code and data platform automation.

Conoscenze

Data pipelines

ETL/ELT

SQL

Data warehousing

Metadata management

Data lineage

Data catalog

Data governance

Cloud experience

Communication

Formazione

Bachelor's degree

Strumenti

Microsoft Purview

Collibra

Alation

Informatica EDC

Apache Atlas

Descrizione del lavoro

Omniscius Consulting is seeking a Data Engineer / Metadata Engineer to design and deliver enterprise-grade data pipelines and metadata capabilities that support analytics and data management. The role centers on building reliable ETL/ELT workflows, developing metadata repositories and catalogs, and strengthening data governance through quality monitoring, lineage, and discoverability.

What you’ll do

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Integrate data from multiple structured and unstructured sources into enterprise data platforms.
• Correlate and integrate datasets both internal and external to the customer organization.
• Develop and optimize data models, data warehouses, data lakes, and lakehouse architectures.
• Ensure pipeline performance, reliability, and scalability meet enterprise expectations.
• Implement automation and monitoring for ingestion and processing workflows.
• Design and maintain enterprise metadata repositories and data catalogs.
• Define and manage business, technical, and operational metadata standards.
• Build automated metadata collection, classification, and enrichment processes.
• Maintain metadata lineage and enable impact analysis across data assets.
• Ensure metadata consistency and accuracy across enterprise systems.
• Support enterprise data governance initiatives and best practices.
• Partner with business and technical stakeholders on data ownership and stewardship models.
• Implement data quality monitoring and validation controls.
• Ensure compliance with organizational data policies and regulatory requirements.
• Support master data management (MDM) and reference data initiatives.
• Develop and support cloud-native data solutions in Azure, AWS, or Google Cloud environments.
• Build and optimize data integration using cloud services and modern data tools.
• Support enterprise analytics, AI/ML, business intelligence workloads, including automation-first pipeline development.
• Contribute to infrastructure-as-code and data platform automation efforts.
• Work with data architects, analysts, data scientists, governance teams, and business stakeholders to translate requirements into solutions.
• Support data discovery, self-service analytics, and data literacy initiatives.
• Document system designs, data flows, metadata models, and operational procedures.

Required qualifications

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field, or equivalent experience.
• 3-7 years of experience in data engineering, metadata management, or related data platform roles.
• Experience building and maintaining ETL/ELT pipelines.
• Strong SQL development and database management skills.
• Experience with data warehousing and large-scale data processing.
• Understanding of metadata management, data lineage, and data catalog concepts.
• Strong problem-solving, analytical, and communication skills.
• Active Top Secret (TS) clearance.

Technologies you may work with

• SQL, ETL/ELT
• Azure, AWS, Google Cloud
• Microsoft Purview, Collibra, Alation
• Informatica EDC, Apache Atlas
• Data Governance Frameworks, Data Quality Management
• Master Data Management (MDM)
• Data Modeling, Data Mesh and Data Fabric

Location: Arlington, VA (onsite)
Minimum experience: 3 years