Data Lake Engineer

Base-2 Solutions, LLC.; Northern (KY); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

AWS Certified Data Analytics - Special

Microsoft Certified: Azure Data Engine

ESRI ArcGIS Developer Certification

Job summary

Base-2 Solutions, LLC is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS. The role focuses on building data pipelines, API services, and front-end interfaces for geospatial visualization and analytics using Databricks, ESRI ArcGIS, and cloud databases.

Required qualifications include a BS in CS/Data Eng or 5+ years in full-stack data engineering, REST/GraphQL API experience, and Kubernetes CI/CD expertise. Active Top Secret/SCI clearance is required.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or related field or 5+ years of equivalent experience.
• Experience building and deploying full-stack apps for data visualization, dashboards, and analytics using ESRI GIS platforms, Unity Catalog, and cloud databases.
• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.
• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication.

Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack apps enabling data visualization, dashboards, and analytics in ESRI GIS, Unity Catalog, and cloud databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines and containerized deployments in Kubernetes with secure API authentication.
• Optimize database queries and indexing for large-scale geospatial and structured datasets.

Skills

Full-stack development

Data engineering

API development

CI/CD

Kubernetes

Geospatial data

Data visualization

Education

Bachelor's degree in CS or related

5+ years equivalent experience

Tools

Databricks

Kubernetes

ESRI ArcGIS

Unity Catalog

Cloud databases

Job description

Position Summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Essential Duties and Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Required Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.
• Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.
• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.
• Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Preferred Qualifications

• AWS Certified Data Analytics - Specialty.
• Microsoft Certified: Azure Data Engineer Associate.
• ESRI ArcGIS Developer Certification.

Required Education and Experience Equivalency

• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• OR 5 years of equivalent experience in full-stack development and data engineering.

Required Certifications

• None specified.

Required Security Clearance

• Active Top Secret/SCI

Equal Employment Opportunity

Base-2 Solutions is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy), national origin, age, sexual orientation, gender identity, genetic information, protected veteran status, or any other characteristic protected by law, and will not be discriminated against on the basis of disability. Learn more: base-2solutions.com/eeo