Senior Data & Software Engineer — Pipelines, AI & AWS

NS2 Mission; McLean (VA); On-site; USD 140,000 - 180,000; Full time

Job summary

NS2 Mission in McLean, VA is seeking a Data & Software Engineer to design, develop, and maintain scalable data pipelines and software solutions supporting mission operations. You will work on cloud-based data workflows and AI/ML-enabled applications to transform complex data into actionable intelligence.

Join a small, highly collaborative team and contribute across Python data engineering, Spark, SQL/NoSQL databases, and containerized deployments in AWS.

Qualifications

• 5+ years of experience building production data pipelines and scalable ETL solutions.
• Advanced Python development experience with Pandas/NumPy.
• Experience with Spark/PySpark and containerized deployments (Docker/Podman).
• Experience with AWS services (S3, Lambda, Step Functions).
• Strong SQL skills (Trino, MySQL, PostgreSQL) and NoSQL (DynamoDB).
• Experience with Airflow/Iceberg and IaC tools (Terraform/CloudFormation).
• Git version control and Bash scripting.
• Knowledge of data governance, security, and privacy principles.

Responsibilities

• Design, develop, and maintain scalable end-to-end data pipelines.
• Build and optimize ETL workflows for structured, unstructured, and geospatial data.
• Deploy and manage containerized applications in AWS.
• Develop and optimize SQL/NoSQL data solutions and data modeling.
• Integrate AI/ML models into production data workflows.
• Use orchestration tools to automate pipelines and Spark jobs.
• Maintain data governance, lineage, and compliance practices.
• Collaborate with stakeholders to design technical solutions and modernize platforms.
• Troubleshoot pipeline failures and performance bottlenecks, document best practices.

Skills

Python

Pandas/NumPy

Apache Spark

PySpark

Docker/Podman

AWS (S3/Lambda/Step Functions)

SQL (Trino/MySQL/PostgreSQL)

NoSQL (DynamoDB)

Airflow/Iceberg

Terraform/CloudFormation

Git

Bash scripting

Data governance/security

Tools

Docker

Podman

Apache Airflow

Apache Iceberg

Terraform

CloudFormation

Spark tooling

Job description

NS2 Mission in McLean, VA is seeking a Data & Software Engineer to design, develop, and maintain scalable data pipelines and software solutions supporting mission operations. You will work on cloud-based data workflows and AI/ML-enabled applications to transform complex data into actionable intelligence.

Join a small, highly collaborative team and contribute across Python data engineering, Spark, SQL/NoSQL databases, and containerized deployments in AWS.