ME00559-Data Engineer

Momentum Engineering, Inc.; Washington (Washington County); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

11 paid holidays

minimum of 3 weeks PTO

company sponsored group medical plan

company paid dental

vision

life insurance

STD/LTD plans

Job summary

Momentum Engineering, Inc. is seeking a data engineer to design and develop data pipelines that support end-to-end solutions across diverse settings. The role focuses on transforming raw data into usable information for IT applications, reporting, and applicant processing.

Responsibilities include building scalable infrastructure, maintaining ETL artifacts, and collaborating with stakeholders. The position involves occasional off-hours deployments and cross-team coordination in a federal

Qualifications

• Bachelor's degree or equivalent practical experience.
• Expertise in distributed computing frameworks to handle large-scale data processing.
• Familiarity working with AWS or other cloud environments.
• Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch and SQL.
• Proficient utilizing Python with libraries like pandas, PySpark, NiFi, Airflow, AWS Lambda or similar technologies.
• Working knowledge with Docker, Kubernetes, JMS/SQS, SNS and Kafka.
• Familiar with Linux/Unix server environments.
• Experience with Agile development methodology.
• Publishing and/or presenting design reports.
• Coordinating with team members to meet milestones.

Responsibilities

• Identify and implement internal process improvements including infrastructure redesign for scalability.
• Develop and design data pipelines for end-to-end solutions.
• Maintain artifacts like schemas, data dictionaries, and ETL transforms.
• Integrate data pipelines with AWS services to extract insights.
• Support data infrastructure needs and resolve data-related issues.
• Design data flows supporting raw and expected data.

Skills

Distributed computing

AWS cloud

PostgreSQL

S3

Redshift

MongoDB

DynamoDB

Redis

Elasticsearch/OpenSearch

SQL

Python pandas

PySpark

NiFi

Airflow

AWS Lambda

Docker

Kubernetes

JMS/SQS

SNS

Kafka

Linux

Agile

Jira

Confluence

ETL

Data pipelines

Data dictionaries

Education

Bachelor's degree

Master's degree

Tools

AWS

Docker

Kubernetes

JMS/SQS

Confluence

Jira

Job description

Job Summary

• Seeking a data engineer to work in a variety of settings to develop and design data pipelines to support end-to-end solutions
• Candidate will build systems that collect, manage, and convert raw data into usable information for multiple purposes to include but not limited to, IT application usage, reporting, applicant processing, etc.

Primary Responsibilities

• Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
• Develop and design data pipelines to support an end-to-end solution
• Develop and maintain artifacts (e.g. schemas, data dictionaries, and transforms related to ETL processes)
• Integrate data pipelines with AWS cloud services to extract meaningful insights
• Work with stakeholders to support their data infrastructure needs and assist with data-related technical issues
• Design and develop robust and functional dataflows to support raw data and expected data
• Provide Tier 3 technical support for deployed applications and dataflows
• Define and communicate a clear product vision for our client’s software products, aligning with user needs and business objectives
• Create and manage product roadmaps that reflect both innovation and growth strategies
• Partner with a government product owner and a product team of 7-8 FTEs
• Collaborate with the rest of data engineering team to design and launch new features
• Coordinate and document dataflows, capabilities, etc.
• Occasionally (as needed) support to off-hours deployment such as evening or weekends

Required Qualifications

• Must have active Top Secret/SCI clearance
• Bachelor’s degree or equivalent practical experience
• Expertise in distributed computing frameworks to handle large-scale data processing
• Familiarity working with Amazon Web Managed Services (AWS) or any other cloud environments
• Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch and SQL
• Proficient utilizing Python with key libraries like pandas and PySark, NiFi, Airflow, AWS Lambda or similar technologies
• Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS and Kafka
• Familiar with Linux/Unix server environments
• Experience with Agile development methodology
• Publishing and/or presenting design reports
• Coordinating with other team members to reach project milestones and deadlines
• Working knowledge with Collaboration tools, such as, Jira and Confluence

Desired Qualifications

• Master’s degree or equivalent experience in a related field
• Familiarity and experience with the Intelligence Community (IC), and the intel cycle
• Familiarity and experience with the Department of Homeland Security (DHS)
• Direct Experience with DHS and Intelligence Community (IC) component’s data architectures and environments (IC-GovCloud experience preferred)
• Experience with cloud message APIs and usage of push notifications
• Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security
• Working knowledge with public keys and digital certificates
• Experience with DevOps environments
• Expertise in various COTS, GOTS, and open source tools which support development of data integration and visualization applications
• Experience with cloud message APIs and usage of push notifications
• Specialization in Object Oriented Programming languages, scripting, and databases

Benefits and Compensation

• Exempt hourly position.
• 11 paid holidays
• minimum of 3 weeks PTO
• company sponsored group medical plan
• company paid dental
• vision
• life insurance
• STD/LTD plans
• Salary is dependent upon the candidate’s experience and qualifications.