Hybrid Data Engineer - AI/ML Pipelines

castaliasystems; Arlington (VA); Hybrid; USD 135,000 - 140,000; Full time

Job summary

Castalia Systems is seeking a Mid-Level Data Engineer to join our hybrid Arlington, VA team. You will design, build, and operate data pipelines and ETL processes to ingest, transform, and deliver mission-critical data for AI/ML applications supporting national security programs.

Close collaboration with Software Engineers and Data Scientists is essential. The ideal candidate has a BS degree, 3+ years experience, and hands-on Python, Databricks, and SQL skills.

Qualifications

• BS degree in a relevant field.
• 3+ years of professional data engineering experience.
• Proficient in Python for data manipulation.
• Experience with Databricks and ETL design.
• Experience with at least one relational database (PostgreSQL/MySQL/SQLite).

Responsibilities

• Develop, maintain, and enhance data pipelines and ETL processes.
• Ensure data availability, quality, reliability, and performance.
• Build data solutions using Python, Databricks, SQL, and relational databases.
• Collaborate with Software Engineers and Data Scientists to support AI/ML deployments.
• Follow cybersecurity and data management best practices for secure data integration.

Skills

Python

Databricks

ETL

Relational databases

Agile SCRUM

Education

BS Degree

Tools

NiFi

Qlik

NoSQL

Graph Databases

Job description

Castalia Systems is seeking a Mid-Level Data Engineer to join our hybrid Arlington, VA team. You will design, build, and operate data pipelines and ETL processes to ingest, transform, and deliver mission-critical data for AI/ML applications supporting national security programs.

Close collaboration with Software Engineers and Data Scientists is essential. The ideal candidate has a BS degree, 3+ years experience, and hands-on Python, Databricks, and SQL skills.