Data Engineer

Metas Solutions; Atlanta (GA); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Medical, Dental, Vision Insurance

Paid Time Off (PTO)

401K with company match

Growth and promotion opportunities

Job summary

Metas Solutions is seeking a Data Engineer to build, optimize, and maintain cloud-based data pipelines, stores, and analytics-ready data. You will design scalable ETL/ELT workflows, structure data architectures, and ensure reliable ingestion from diverse sources.

Collaboration with analysts, product teams, and developers will drive end-to-end data solutions for reporting, modeling, and visualization. Your role focuses on transforming raw data into analytics-ready formats, performing backend

Qualifications

• Bachelor's degree is required.
• Experience with data warehousing in cloud environments.
• Security clearance eligibility (Public Trust) may be required.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines from multiple cloud sources.
• Build data storage solutions (warehouses/lakes) for large-scale analytics and BI.
• Perform backend SQL and NoSQL testing and data validation.
• Collaborate with analysts, engineers, and stakeholders to translate data requirements into models and workflows.
• Develop automation to convert diverse data types into usable formats and ensure data quality.

Education

Bachelor's degree

Tools

SQL

Python

Cloudera

Hadoop

Spark

Databricks

Hive

AWS EMR

Kafka

MongoDB

Cassandra

PostgreSQL

Snowflake

Unix/Linux

Job description

About Us

Metas Solutions excels in providing strategic consulting, program management, and data-driven analytics to federal public health agencies. Our expertise enhances health systems and delivers measurable outcomes, helping agencies achieve their mission. We collaborate with federal partners to implement agile solutions for national public health initiatives, driving impactful changes through cutting-edge programs that strengthen communities and promote well-being.

See www.metassolutions.com for further details about us and careers with Metas.

Job Description

Metas Solutions has an "immediate opening" for a talented Data Engineer to provide specialized Data Engineering support to build, optimize, and maintain cloud-based data pipelines, platforms, and data stores that enable analytics across large, diverse datasets. This role includes designing scalable ETL/ELT workflows, structuring data storage architectures, and ensuring reliable data ingestion from multiple structured and unstructured sources. You'll support mission-driven analytics efforts by transforming raw data into analysis-ready formats, performing backend SQL/NoSQL testing, and validating data quality throughout the pipeline lifecycle. In this position, you will collaborate with analysts, product teams, and developers to understand evolving data requirements, define technical specifications, and implement end-to-end solutions supporting reporting, modeling, and visualization needs.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and deliver structured and unstructured data from multiple cloud-based sources.
• Build and optimize data storage solutions (data warehouses, data lakes, or lake houses) that support large-scale analytics, reporting, and business intelligence needs.
• Perform backend SQL and NoSQL testing, including data validation, post-deployment checks, and troubleshooting of ingestion or schema issues.
• Collaborate cross-functionally with analysts, engineers, and stakeholders to translate requirements into technical data models, workflows, and pipeline specifications.
• Develop scripts and automation to convert diverse data types into usable formats, while scaling, monitoring, and operating cloud-based data platforms.

Qualifications

• 3+ years of experience in Data Warehouse development
• 3+ years of experience with data analysis of aggregated data from multiple sources in cloud-based environments
• 2+ years of experience developing and maintaining scalable data stores that supply big data in forms needed for business analysis
• Experience with SQL and Python for retrieving, parsing, and processing structured and unstructured data
• Experience developing scalable ETL or ELT workflows for reporting and analyticsusing cloud-based technologies
• Experience with using Cloudera or Hadoop technologies to ingest, transform, and process data
• Experience leveraging generative AI coding tools to assist in development
• Ability to perform backend SQL and NoSQL database testing, including post-deployment and data validation testing
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor's degree
• Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder)

Additional Qualifications

• Experience creating solutions within a collaborative and cross-functional team environment
• Experience with AWS Glue, AWS Athena, and Postgres
• Experience with distributed data and computing tools such as Spark, Databricks, Hive, AWS EMR, or Kafka
• Experience working on real-time data and streaming applications
• Experience with NoSQL implementation using MongoDB or Cassandra
• Experience with data warehousing, including AWS Redshift, MySQL, or Snowflake
• Experience with UNIX and Linux, including basic commands and Shell scripting
• Experience with Agile engineering practices

Security Requirements

• Must be US Citizen and with the ability to obtain a US Government security clearance (Public Trust 5) within a reasonable period
• Market competitive salary, commensurate with experience and education
• Comprehensive benefits package available, Medical, Dental, Vision and Life Insurance, Paid Time Off (PTO), 401K with company match, growth, and promotion opportunities

Notice on Candidate AI Usage

Metas Solutions is committed to maintaining a fair and competitive interview process for all candidates, based on their experience, skills, and education. To preserve the integrity and fairness of our interview process, candidates are expected to respond to all interview questions based on their own knowledge, skills, and experience. The use of artificial intelligence (AI) tools or other third-party resources to generate, assist with, or provide interview responses during phone, virtual, or in-person interviews is not permitted. Any use of AI-assisted responses during the interview process may result in disqualification from further consideration for employment.

We are an Equal Opportunity Employer/Veterans/Disabled