Mid Data Engineer - Hybrid, Data Pipelines & AI

Castalia Systems; Arlington (VA); Hybrid; USD 135,000 - 140,000; Full time

Benefits offered by this job

Medical

Dental

Vision coverage

401k matching

PTO

Paid holidays

Professional training opportunities

Pet insurance

Job summary

Castalia Systems is seeking a Mid-Level Data Engineer to join our team focused on national security missions. You will design, build, and optimize data pipelines (ETL) using Python, SQL, and Databricks, ensuring data availability and quality for AI/ML initiatives.

Requirements include a BS degree, 3+ years of experience, Python, SQL, Databricks, and Agile SCRUM. U.S. citizenship and an active Secret clearance are required. Onsite 3-5 days/week in a hybrid workplace in Virginia (Arlington area).

Qualifications

• BS degree required.
• 3+ years of professional experience.
• Proficient in Python for data manipulation and scripting.
• Experience with Databricks.
• Proficient in designing and implementing ETL data processes.
• Experience with at least one relational database (PostgreSQL/MySQL/SQLite).
• Experience with Agile SCRUM methodologies.

Responsibilities

• Develop, maintain, and enhance data pipelines and ETL processes to ingest, transform, integrate, and deliver mission-critical data from multiple sources.
• Support data availability, quality, reliability, and performance by monitoring data workflows and troubleshooting issues.
• Build and maintain data solutions using Python, Databricks, SQL, relational databases, and other modern data engineering technologies.
• Collaborate with Software Engineers, Data Scientists, and stakeholders to integrate data for AI/ML applications and data-driven analytics.
• Support secure data integration, data cleaning, organization, and transfer processes following cybersecurity and data management best practices.

Skills

Python

ETL

SQL

Relational databases

Agile SCRUM

Education

BS Degree

Tools

Databricks

Job description

Castalia Systems is seeking a Mid-Level Data Engineer to join our team focused on national security missions. You will design, build, and optimize data pipelines (ETL) using Python, SQL, and Databricks, ensuring data availability and quality for AI/ML initiatives.

Requirements include a BS degree, 3+ years of experience, Python, SQL, Databricks, and Agile SCRUM. U.S. citizenship and an active Secret clearance are required. Onsite 3-5 days/week in a hybrid workplace in Virginia (Arlington area).