Data & Software Engineer with Security Clearance

Hoplite Solutions LLC; McLean (VA); On-site; USD 120,000 - 170,000; Full time

Job summary

Hoplite Solutions LLC seeks a Data and Software Engineer to build complex data flows for a custom application in McLean, VA. The role focuses on advanced Python programming, Spark/PySpark, and deploying data pipelines in cloud environments.

You will work with a small team to implement ETL workflows at scale, containerize apps, and integrate AI/ML services while ensuring data security and governance. This position requires 5+ years of hands-on data engineering experience and strong collaboration

Qualifications

• Minimum of 5 years' experience with Apache Spark & PySpark and advanced Python skills (Pandas/NumPy).
• Experience containerizing applications with Docker/Podman and deploying in AWS environments.
• Proficient in SQL (Trino) and NoSQL (DynamoDB) with data modeling and performance tuning.
• Familiar with data catalogs, data lineage, and geospatial data processing.
• Experience with ETL, data pipelines, and orchestration (Airflow, OpenLineage).
• Infrastructure as code experience with Terraform or CloudFormation.

Responsibilities

• Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight.
• Leverage problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks.
• Leverage background in large-scale data migration or platform modernization efforts.
• Contribute to data engineering documentation, best practices, and design patterns.

Skills

Python

PySpark

SQL

NoSQL (DynamoDB)

Bash scripting

Pandas

NumPy

Spark

Geospatial data handling

Tools

Docker

Podman

AWS S3

Lambda

Step Functions

Apache Iceberg

Airflow

Trino

PostgreSQL

NoSQL DynamoDB

Unity Catalog OSS

Apache Polaris

Apache Superset

Terraform

CloudFormation

OpenLineage

H3

PostGIS

Job description

Job Description Hoplite Solutions is seeking a Data and Software Engineer to join our team at McLean, VA. The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale.

Candidate must have experience:

• Building end-to-end data pipelines leveraging Python Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
• Containerizing and deploying applications in cloud environments like AWS.
• Working with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads.
• Leveraging industry standard tools for code control (Git, IaaC control, etc.)
• Working with data catalogs, tracking data lineage and handling a variety of data formats, including Geospatial.
• Using Bash scripting for automation and data processing tasks
• Integrating Al/ML services and models Responsibilities:

Responsibilities:

• Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
• Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
• Leverage a background in large-scale data migration or platform modernization efforts
• Contribute to data engineering documentation, best practices, and design patterns. Required Skills: Minimum of 5 years' experience with:

Required Skills: Minimum of 5 years' experience with:

• Apache Spark & PySpark
• Advanced Python skills (including Pandas & NumPy)
• Docker, Podman
• AWS S3, Lambda & Step functions
• Apache Iceberg, Airflow, etc.
• SQL (with Trino)
• NoSQL, DynamoDB
• Unity Catalog OSS, Apache Polaris
• Apache Superset
• Terraform or CloudFormation
• OpenLineage
• H3, PostGIS