Data & Software Engineer: Scalable Pipelines & Cloud Apps

Hoplite Solutions LLC; McLean (VA); On-site; USD 120,000 - 170,000; Full time

Job summary

Hoplite Solutions LLC seeks a Data and Software Engineer to build complex data flows for a custom application in McLean, VA. The role focuses on advanced Python programming, Spark/PySpark, and deploying data pipelines in cloud environments.

You will work with a small team to implement ETL workflows at scale, containerize apps, and integrate AI/ML services while ensuring data security and governance. This position requires 5+ years of hands-on data engineering experience and strong collaboration

Qualifications

• Minimum of 5 years' experience with Apache Spark & PySpark and advanced Python skills (Pandas/NumPy).
• Experience containerizing applications with Docker/Podman and deploying in AWS environments.
• Proficient in SQL (Trino) and NoSQL (DynamoDB) with data modeling and performance tuning.
• Familiar with data catalogs, data lineage, and geospatial data processing.
• Experience with ETL, data pipelines, and orchestration (Airflow, OpenLineage).
• Infrastructure as code experience with Terraform or CloudFormation.

Responsibilities

• Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight.
• Leverage problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks.
• Leverage background in large-scale data migration or platform modernization efforts.
• Contribute to data engineering documentation, best practices, and design patterns.

Skills

Python

PySpark

SQL

NoSQL (DynamoDB)

Bash scripting

Pandas

NumPy

Spark

Geospatial data handling

Tools

Docker

Podman

AWS S3

Lambda

Step Functions

Apache Iceberg

Airflow

Trino

PostgreSQL

NoSQL DynamoDB

Unity Catalog OSS

Apache Polaris

Apache Superset

Terraform

CloudFormation

OpenLineage

H3

PostGIS

Job description

Hoplite Solutions LLC seeks a Data and Software Engineer to build complex data flows for a custom application in McLean, VA. The role focuses on advanced Python programming, Spark/PySpark, and deploying data pipelines in cloud environments.

You will work with a small team to implement ETL workflows at scale, containerize apps, and integrate AI/ML services while ensuring data security and governance. This position requires 5+ years of hands-on data engineering experience and strong collaboration