Data/Software Engineer

NS2 Mission; North Dakota; On-site; USD 140,000 - 190,000; Full time

Job summary

NS2 Mission is seeking a Data & Software Engineer to design, develop, and maintain scalable data pipelines and software solutions supporting mission operations in a cloud-first environment. You will collaborate with a small, highly skilled team to leverage Python, Spark, and AWS services to transform complex data into actionable intelligence and drive modernization across platforms.

Security clearance consideration is noted (TS/SCI with an FSP).

Qualifications

• 5+ years of experience building production data pipelines and scalable ETL solutions.
• Advanced Python development experience, including Pandas and NumPy.
• Experience developing with Apache Spark and PySpark.
• Experience deploying containerized applications using Docker or Podman.
• Experience working with AWS services including S3, Lambda, and Step Functions.
• Strong SQL experience, including Trino, MySQL, and PostgreSQL with performance tuning and schema design.
• Experience working with NoSQL technologies such as DynamoDB.
• Experience with workflow orchestration tools including Apache Airflow and Apache Iceberg.
• Familiarity with Infrastructure as Code using Terraform or CloudFormation.
• Experience using Git and modern source control practices.
• Experience with Bash scripting for automation and data processing.
• Understanding of data governance, security, privacy, lineage, and compliance principles.

Responsibilities

• Design, develop, and maintain scalable end-to-end data pipelines using Python and modern data engineering frameworks.
• Build and optimize ETL workflows that process structured, unstructured, and geospatial data at scale.
• Deploy and manage containerized applications within AWS cloud environments.
• Develop and optimize SQL and NoSQL data solutions, including database design, performance tuning, and query optimization.
• Integrate AI/ML models and services into production data workflows.
• Utilize orchestration tools to automate data pipelines and manage Spark jobs.
• Maintain data governance, lineage, cataloging, and compliance best practices across enterprise datasets.
• Collaborate with stakeholders to gather requirements, design technical solutions, and support platform modernization initiatives.
• Troubleshoot pipeline failures, performance bottlenecks, and data quality issues while contributing to engineering best practices and technical documentation.

Skills

Python

Pandas

NumPy

Apache Spark

PySpark

Docker

AWS

SQL

NoSQL

Airflow

Terraform

Git

Bash

Data governance

Security & privacy

Tools

Docker

Podman

AWS

S3

Lambda

Step Functions

Apache Airflow

Apache Iceberg

Terraform

CloudFormation

Git

Bash

Spark

PostgreSQL

MySQL

DynamoDB

PostGIS

Job description

Build modern data solutions that drive mission-critical decision making. NS2 Mission is seeking a Data & Software Engineer to support the team in McLean, VA. In this role, you'll work as part of a small, highly collaborative engineering team to design, develop, and maintain scalable data pipelines and software solutions supporting mission operations. You'll leverage modern cloud technologies, big data frameworks, and AI/ML capabilities to build high-performance applications and data workflows that transform complex data into actionable intelligence.

If you enjoy solving challenging engineering problems while working across data, software, and cloud technologies, we'd love to hear from you.

Key Responsibilities

• Design, develop, and maintain scalable end-to-end data pipelines using Python and modern data engineering frameworks.
• Build and optimize ETL workflows that process structured, unstructured, and geospatial data at scale.
• Deploy and manage containerized applications within AWS cloud environments.
• Develop and optimize SQL and NoSQL data solutions, including database design, performance tuning, and query optimization.
• Integrate AI/ML models and services into production data workflows.
• Utilize orchestration tools to automate data pipelines and manage Spark jobs.
• Maintain data governance, lineage, cataloging, and compliance best practices across enterprise datasets.
• Collaborate with stakeholders to gather requirements, design technical solutions, and support platform modernization initiatives.
• Troubleshoot pipeline failures, performance bottlenecks, and data quality issues while contributing to engineering best practices and technical documentation.

Required Qualifications

• 5+ years of experience building production data pipelines and scalable ETL solutions.
• Advanced Python development experience, including Pandas and NumPy.
• Experience developing with Apache Spark and PySpark.
• Experience deploying containerized applications using Docker or Podman.
• Experience working with AWS services including S3, Lambda, and Step Functions.
• Strong SQL experience, including Trino, MySQL, and PostgreSQL with performance tuning and schema design.
• Experience working with NoSQL technologies such as DynamoDB.
• Experience with workflow orchestration tools including Apache Airflow and Apache Iceberg.
• Familiarity with Infrastructure as Code using Terraform or CloudFormation.
• Experience using Git and modern source control practices.
• Experience with Bash scripting for automation and data processing.
• Understanding of data governance, security, privacy, lineage, and compliance principles.

Preferred Qualifications

• Experience with Unity Catalog OSS, Apache Polaris, and OpenLineage.
• Experience with Apache Superset or similar data visualization platforms.
• Experience working with geospatial data technologies including H3 and PostGIS.
• Experience supporting AI/ML model deployment and production data workflows.
• Experience supporting large-scale data migration or platform modernization initiatives.

Position Clearance Requirement

TS/SCI with an FSP

Please be aware, many of our positions require the ability to obtain or maintain a U.S security clearance which requires U.S citizenship

We win with inclusion

NS2 Mission’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At NS2 Mission, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

NS2 Mission is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with NS2 Mission and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: [e-mail].

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.