Data & Software Engineer: End-to-End Data Pipelines

Bespoketechinc; McLean (VA); On-site; USD 90,000 - 120,000; Full time

Job summary

Bespoketechinc in McLean, VA is seeking a Data & Software Engineer to build complex data flows for a custom application. The ideal candidate must have at least 5 years of experience, with strong skills in Python and expertise in data security and compliance principles.

The position requires working fully on-site and active Poly clearance is essential. Responsibilities include designing solutions for data requirements and enhancing pipeline performance.

Qualifications

• Minimum 5 years of experience in data engineering.
• Strong problem-solving skills in data pipeline issues.
• Experience with large-scale data migration or modernization.

Responsibilities

• Work with stakeholders to understand data requirements.
• Debug data quality issues and pipeline failures.
• Contribute to data engineering documentation and best practices.

Skills

Advanced Python programming

Building end-to-end data pipelines

Using orchestration tools for data pipelines

Containerizing applications in cloud environments

MySQL and PostgreSQL

Bash scripting for automation

Integrating AI/ML services

Tools

Apache Spark

Docker

AWS S3

Apache Airflow

Terraform

Job description

Bespoketechinc in McLean, VA is seeking a Data & Software Engineer to build complex data flows for a custom application. The ideal candidate must have at least 5 years of experience, with strong skills in Python and expertise in data security and compliance principles.

The position requires working fully on-site and active Poly clearance is essential. Responsibilities include designing solutions for data requirements and enhancing pipeline performance.