Enterprise Data Engineer

Bespoke Technologies, Inc.; Herndon (VA); On-site; USD 90,000 - 120,000; Full time

Job summary

Bespoke Technologies, Inc. is seeking an Enterprise Data Engineer to build and maintain data pipelines using Python, SQL, and Palantir.

This mid-SME role focuses on ETL for structured and unstructured data from diverse sources, with a strong emphasis on data quality and performance. The ideal candidate will transform and validate data, collaborate with IT and analytics teams, and ensure Palantir tooling is leveraged effectively across projects.

Qualifications

• 3+ years of data engineering experience.
• Proficient in Python scripting.
• Excellent SQL querying and optimization.
• Experience integrating data from APIs, databases, and file systems.
• Strong analytical and problem-solving skills.
• Strong communication and teamwork.

Responsibilities

• Write Python and SQL scripts to automate data processing.
• Integrate data from databases, APIs, and files into centralized systems.
• Implement data transformations, enrichment, and modeling workflows.
• Optimize data structures for performance and scalability.
• Provide guidance on Palantir usage across teams.
• Implement data quality checks and monitoring.
• Ensure proper data transformation and curation to meet business needs.
• Maintain data quality and cleansing processes.

Skills

Python

SQL

ETL processes

Data integration

Analytical skills

Communication

Teamwork

Education

Bachelor’s degree in Computer Science, Data Engineering, or related field

Tools

Palantir

Airflow

Prefect

Job description

BT-334 – Enterprise Data Engineer

Skill Level: Mid-SME

Herndon, VA (fully on-site, no remote option)

• Please do NOT apply if you do not have an active Poly clearance. Those without a Poly will not be considered.

Bespoke Technologies is seeking a skilled and detail-oriented Data Engineer with expertise in utilizing Python, SQL, and Palantir (or other ETL platforms) to extract, transform, and load structured and unstructured data from various sources. The ideal candidate will have a strong background in data engineering and a deep understanding of ETL processes.

Key Responsibilities

• Write robust and efficient Python and SQL scripts to automate data processing tasks.
• Integrate data from diverse sources, such as databases, APIs, and flat files, into centralized systems.
• Implement data transformations, enrichment, and modeling workflows to ensure data quality and usability.
• Ensure data structures are optimized for performance and scalability.
• Provide technical guidance and support to ensure effective use of Palantir tools across teams.
• Implement data quality checks, validation, and monitoring mechanisms to ensure the accuracy and reliability of datasets.
• Integrate data from diverse sources, such as databases, APIs, and flat files, into centralized systems.
• Ensure proper data transformation and curation to meet business and analytics requirements.
• Maintain and improve data quality, consistency, and accuracy through validation and cleansing processes.

Required Skills

• 3+ years of experience in data engineering.
• Strong proficiency in scripting and programming with Python.
• Expertise in working with SQL for data querying, transformation, and optimization.
• Experience with data integration from diverse sources such as APIs, relational databases, and file systems.
• Strong analytical and problem‑solving skills with attention to detail.
• Excellent communication and teamwork skills to collaborate with technical and business teams.

Preferred Skills

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Hands‑on experience with Palantir.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Apache Spark, Hadoop).
• Familiarity with data orchestration tools such as Apache Airflow, Prefect, or similar.