Data Engineer

Metas Solutions; Oregon; Hybrid; USD 110,000 - 150,000; Full time

Job summary

Metas Solutions is seeking a Data Engineer to design, build, and maintain scalable ETL/ELT pipelines and data stores across cloud environments. You will transform raw data into analysis-ready formats, validate data quality, and collaborate with analysts, product teams, and developers to meet evolving data requirements.

The role focuses on feeding reporting, modeling, and visualization efforts with robust data pipelines and storage architectures, ensuring reliable ingestion from diverse sources

Qualifications

• 3+ years of experience in Data Warehouse development.
• 3+ years of experience with data analysis of aggregated data from multiple sources in cloud-based environments.
• 2+ years of experience developing and maintaining scalable data stores for big data.
• Experience with SQL and Python for retrieving, parsing, and processing structured and unstructured data.
• Experience developing scalable ETL/ELT workflows for reporting and analytics using cloud-based technologies.
• Experience with Cloudera or Hadoop technologies to ingest, transform, and process data.
• Experience leveraging generative AI coding tools to assist in development.
• Ability to perform backend SQL and NoSQL database testing, including post-deployment data validation.
• Bachelor's degree; US citizenship or permanent resident.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for multiple cloud-based sources.
• Build and optimize data storage solutions (data warehouses, data lakes, or lake houses) to support analytics.
• Perform backend SQL and NoSQL testing, data validation, and troubleshooting ingestion or schema issues.
• Collaborate with analysts, engineers, and stakeholders to translate requirements into data models and workflows.
• Develop scripts to convert diverse data types into usable formats and monitor cloud platforms.

Skills

SQL

Python

ETL/ELT

Data Warehousing

Cloud Data Pipelines

Data Modeling

Big Data Tools

Education

Bachelor's degree

Tools

AWS Glue

AWS Athena

Postgres

Hadoop/Cloudera

Spark

Databricks

Kafka

Job description

About Us:

Metas Solutions excels in providing strategic consulting, program management, and data-driven analytics to federal public health agencies. Our expertise enhances health systems and delivers measurable outcomes, helping agencies achieve their mission. We collaborate with federal partners to implement agile solutions for national public health initiatives, driving impactful changes through cutting-edge programs that strengthen communities and promote well-being. See www.metassolutions.com for further details about us and careers with Metas.

Metas Solutions has an "immediate opening" for a talented Data Engineer to provide specialized Data Engineering support to build, optimize, and maintain cloud-based data pipelines, platforms, and data stores that enable analytics across large, diverse datasets. This role includes designing scalable ETL/ELT workflows, structuring data storage architectures, and ensuring reliable data ingestion from multiple structured and unstructured sources. You'll support mission-driven analytics efforts by transforming raw data into analysis-ready formats, performing backend SQL/NoSQL testing, and validating data quality throughout the pipeline lifecycle. In this position, you will collaborate with analysts, product teams, and developers to understand evolving data requirements, define technical specifications, and implement end-to-end solutions supporting reporting, modeling, and visualization needs.

Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and deliver structured and unstructured data from multiple cloud-based sources.
• Build and optimize data storage solutions (data warehouses, data lakes, or lake houses) that support large-scale analytics, reporting, and business intelligence needs.
• Perform backend SQL and NoSQL testing, including data validation, post-deployment checks, and troubleshooting of ingestion or schema issues.
• Collaborate cross-functionally with analysts, engineers, and stakeholders to translate requirements into technical data models, workflows, and pipeline specifications.
• Develop scripts and automation to convert diverse data types into usable formats, while scaling, monitoring, and operating cloud-based data platforms.

Qualifications:

• 3+ years of experience in Data Warehouse development
• 3+ years of experience with data analysis of aggregated data from multiple sources in cloud-based environments
• 2+ years of experience developing and maintaining scalable data stores that supply big data in forms needed for business analysis
• Experience with SQL and Python for retrieving, parsing, and processing structured and unstructured data
• Experience developing scalable ETL or ELT workflows for reporting and analyticsusing cloud-based technologies
• Experience with using Cloudera or Hadoop technologies to ingest, transform, and process data
• Experience leveraging generative AI coding tools to assist in development
• Ability to perform backend SQL and NoSQL database testing, including post-deployment and data validation testing
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor's degree
• Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder)

Additional Qualifications:

• Experience creating solutions within a collaborative and cross-functional team environment
• Experience with AWS Glue, AWS Athena, and Postgres
• Experience with distributed data and computing tools such as Spark, Databricks, Hive, AWS EMR, or Kafka
• Experience working on real-time data and streaming applications
• Experience with NoSQL implementation using MongoDB or Cassandra
• Experience with data warehousing, including AWS Redshift, MySQL, or Snowflake
• Experience with UNIX and Linux, including basic commands and Shell scripting
• Experience with Agile engineering practices

Security Requirements:

• Must be US Citizen and with the ability to obtain a US Government security clearance (Public Trust 5) within a reasonable period
• Market competitive salary, commensurate with experience and education
• Comprehensive benefits package available, Medical, Dental, Vision and Life Insurance, Paid Time Off (PTO), 401K with company match, growth, and promotion opportunities

Notice on Candidate AI Usage

Metas Solutions is committed to maintaining a fair and competitive interview process for all candidates, based on their experience, skills, and education. To preserve the integrity and fairness of our interview process, candidates are expected to respond to all interview questions based on their own knowledge, skills, and experience. The use of artificial intelligence (AI) tools or other third-party resources to generate, assist with, or provide interview responses during phone, virtual, or in-person interviews is not permitted. Any use of AI-assisted responses during the interview process may result in disqualification from further consideration for employment.

We are an Equal Opportunity Employer/Veterans/Disabled