Data Lake Engineer with Security Clearance

Prescient Edge; Florida; On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive salary

Bonus opportunities

Healthcare benefits

Retirement plan

Career development

Positive work environment

Job summary

Prescient Edge in Doral, Florida seeks a senior Data Lake Architect/Engineer to design, implement, and maintain scalable Data Lake architectures supporting structured and unstructured data ingestion. You will configure integration with Stardog, manage SPARQL endpoints, enforce access policies, and ensure DoD IL-4/IL-5 compliance.

Ideal candidates have DoD data governance experience, cloud security expertise, and a strong background in ETL, Databricks, and Unity Catalog.

Qualifications

• Master’s degree or higher in CS/IT/SE or 11+ years experience in enterprise data architecture.
• Active TS/SCI clearance.
• Location: Doral, Florida.
• Experience with DoD data governance policies and security standards.

Responsibilities

• Design, implement, and maintain scalable Data Lake architectures for structured and unstructured data ingestion.
• Configure and manage integration between Data Lake and Stardog (SPARQL endpoint, metadata federation).
• Follow access control policies and ensure compliance with DoD governance requirements.
• Optimize ETL pipelines and manage Unity Catalog for secure data governance.

Skills

Data lake architecture

ETL pipelines

Python

SQL/NoSQL

Cloud platforms

Education

Master's degree or higher

Tools

Databricks

Stardog

Unity Catalog

Job description

Benefits

At Prescient Edge, we believe that acting with integrity and serving our employees is the key to everyone's success. To that end, we provide employees with a best-in-class benefits package that includes:

• A competitive salary with performance bonus opportunities.
• Comprehensive healthcare benefits, including medical, vision, dental, and orthodontia coverage.
• A substantial retirement plan with no vesting schedule.
• Career development opportunities, including on-the-job training, tuition reimbursement, and networking.
• A positive work environment where employees are respected, supported, and engaged.

Benefits

At Prescient Edge, we believe that acting with integrity and serving our employees is the key to everyone's success. To that end, we provide employees with a best-in-class benefits package that includes:

• A competitive salary with performance bonus opportunities.
• Comprehensive healthcare benefits, including medical, vision, dental, and orthodontia coverage.
• A substantial retirement plan with no vesting schedule.
• Career development opportunities, including on-the-job training, tuition reimbursement, and networking.
• A positive work environment where employees are respected, supported, and engaged.

Description

• Design, implement, and maintain scalable Data Lake architectures to support structured and unstructured data ingestion, ensuring efficient data access and retrieval.
• Configure and manage the integration interface between the Data Lake and the managed knowledge graph platform (Stardog), including SPARQL endpoint access, metadata federation, and catalog alignment.
• Follow access control policies and usage scope.
• Confirm compliance with access policies on a quarterly basis and document the results in the Data Governance & Compliance Report.
• Optimize ETL pipelines for high-volume data transformation, ensuring compliance with DoD IL-4/IL-5 security standards
• Implement storage tiering strategies and access controls, ensuring data is properly classified, retained, and accessed per DoD governance requirements.
• Submit the Data Lake Performance & Optimization Report, detailing ingestion efficiency, access control improvements, and storage utilization metrics. Experience:
• Possess the knowledge and capability to support Data Lake platform administration and enterprise data architecture for DoD data-driven projects.
• Skilled in Data Lake Platform administration, including workspace management, cluster optimization, and Unity Catalog integration for secure data governance.
• Proficient in ETL pipeline development, Delta Lake architecture, and Data Lakehouse optimization for DoD analytics and mission critical data workflows.
• Experienced in SysEngOps, DevSecOps, version control systems (Git), and CI/CD pipelines to streamline Data Lakedevelopment and deployment.
• Knowledgeable in identity and access management (IAM), role-based access control (RBAC), and cloud security best practices across AWS, Azure, and GCP.
• Hands-on expertise in Python, SQL/NoSQL, Apache Spark, Databricks SQL, Terraform, and cloud native data services for large-scale data processing and analytics.
• Has strong background in:
• Databricks platform administration, including workspace configuration, Unity Catalog, cluster performance tuning, and cloud integration.
• Data pipeline development (ETL/ELT), Delta Lake optimization, and AI/ML workflow integration.
• SysEngOps, DevSecOps, version control systems (Git), and CI/CD pipelines for automated deployment and governance.
• Cloud security, role-based access control (RBAC), and compliance with DoD data policies across AWS, Azure, and GCP. Education:
• A Master’s degree or higher (e.g. Ph.D.) in Computer Science, Information Technology, Systems Engineering, Data Science, Business Administration, Engineering Management, or a closely related field; or a minimum of 11+ years of experience managing complex technical projects in enterprise data architecture, Databricks administration, and cloud-based data platforms.
• Security clearance:
• Active TS/SCI clearance.
• Location:
• Doral, Florida. (USSOUTHCOM Headquarters)