Data & Software Engineer - End-to-End Pipelines (Python,AWS)

Hoplite Solutions LLC; McLean (VA); Vor Ort; USD 140.000 - 190.000; Vollzeit

Zusammenfassung

Hoplite Solutions LLC in McLean, VA is seeking a Data and Software Engineer to join our team. The role focuses on building complex data flows for a custom application, leveraging Python and Spark in production pipelines.

Cloud, SQL/NoSQL, and data governance experience are essential. The candidate will work with a small team to design, deploy, and optimize data solutions, including ETL workflows, data lineage, and geospatial data handling.

Qualifikationen

• Minimum of 5 years of experience in data engineering or software engineering roles.
• Strong Python experience with Pandas/NumPy for data processing.
• Hands-on with Spark ecosystems, ETL, and data pipelines.
• Experience with cloud deployments, containers, and CI/CD workflows.

Aufgaben

• Design and implement end-to-end data pipelines for complex analytical workloads.
• Optimize pipelines for quality, reliability, and scale with minimal oversight.
• Collaborate with stakeholders to translate data needs into robust solutions.
• Document patterns, best practices, and data governance considerations.

Kenntnisse

Advanced Python

Data engineering

Problem solving

Tools

Apache Spark

PySpark

Docker

Podman

AWS S3

Lambda

Step Functions

Apache Iceberg

Airflow

SQL

Trino

NoSQL

DynamoDB

UnityCatalog OSS

Apache Polaris

Apache Superset

Terraform

CloudFormation

OpenLineage

H3

PostGIS

Jobbeschreibung

Hoplite Solutions LLC in McLean, VA is seeking a Data and Software Engineer to join our team. The role focuses on building complex data flows for a custom application, leveraging Python and Spark in production pipelines.

Cloud, SQL/NoSQL, and data governance experience are essential. The candidate will work with a small team to design, deploy, and optimize data solutions, including ETL workflows, data lineage, and geospatial data handling.