Data Lake Engineer

Base-2 Solutions, LLC; Miami (FL); On-site; USD 120,000 - 180,000; Full time

Job summary

Base-2 Solutions, LLC is seeking a Data Lake Engineer to support USSOUTHCOM J26 Enhanced Domain Awareness. You will develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for accessing geospatial and structured data.

The role requires expertise in Databricks, Kubernetes, ESRI ArcGIS, and Unity Catalog, with cloud-based data engineering. You will implement RESTful and GraphQL APIs, manage CI/CD pipelines, and optimize large-scale geospatial datasets for

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• 5 years of equivalent experience in full-stack development and data engineering.

Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization and analytics within ESRI ArcGIS and cloud-based databases.

Skills

Full-stack development

Data engineering

API development

Geospatial visualization

CI/CD

Kubernetes

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

Kubernetes

ESRI ArcGIS

Unity Catalog

Cloud databases

RESTful APIs

GraphQL APIs

Job description

Position Summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Essential Duties and Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.


• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.


• Build scalable, secure web applications with metadata-driven search and retrieval features.


• Integrate APIs for seamless data interoperability.


• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.


• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.


• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.


• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Required Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.


• Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.


• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.


• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.


• Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Preferred Qualifications

• AWS Certified Data Analytics – Specialty.


• Microsoft Certified: Azure Data Engineer Associate.


• ESRI ArcGIS Developer Certification.

Required Education and Experience Equivalency

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.


• OR 5 years of equivalent experience in full-stack development and data engineering.

Required Certifications

• None specified.

Required Security Clearance

• Active Top Secret/SCI