A leading technology and services integrator in defense is seeking a Data Lake Engineer to develop and maintain scalable Data Lake architectures. The role involves optimizing data ingestion processes, ensuring compliance with security standards, and requires an active TS/SCI Clearance. Ideal candidates will have a Master's degree in a related field or extensive experience in managing data architecture projects, along with expertise in cloud platforms and various programming languages. This opportunity offers a unique chance to support mission-driven analytics for a DoD customer.
Qualifications
Active TS/SCI Clearance required.
Minimum of eleven years managing complex technical projects.
Proficiency in cloud security best practices.
Responsibilities
Design, implement, and maintain scalable Data Lake architectures.
Optimize ETL pipelines and manage data ingestion.
Confirm compliance with access policies quarterly.
Skills
Data Lake platform administration
ETL/ELT pipeline development
Cloud integration (AWS, Azure, GCP)
Python
Apache Spark
SQL/NoSQL
Terraform
Education
Master’s degree or higher in Computer Science or related field
Tools
Databricks
Git
Job description
A leading technology and services integrator in defense is seeking a Data Lake Engineer to develop and maintain scalable Data Lake architectures. The role involves optimizing data ingestion processes, ensuring compliance with security standards, and requires an active TS/SCI Clearance. Ideal candidates will have a Master's degree in a related field or extensive experience in managing data architecture projects, along with expertise in cloud platforms and various programming languages. This opportunity offers a unique chance to support mission-driven analytics for a DoD customer.