Data Lake Engineer

RPMGlobal; Miami (FL); On-site; USD 110,000 - 170,000; Full time

Job summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 Enhanced Domain Awareness task order. Develop, maintain, and optimize data pipelines, APIs, and front-end interfaces for geospatial and structured data visualization.

The role requires Databricks, Kubernetes, ESRI ArcGIS, and cloud-based data engineering experience to build scalable web apps, secure APIs, and dashboards within GIS platforms and Unity Catalog.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Experience building data visualization and dashboards for geospatial data.
• Proficient with RESTful and GraphQL APIs.
• Experience with CI/CD and Kubernetes deployments.
• Familiar with Databricks and ESRI ArcGIS environments.

Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Skills

Full-stack development

Data visualization

Geospatial data

API integration

CI/CD pipelines

Education

Bachelor's degree in Computer Science or related field

5 years of equivalent experience in full-stack development and data engineering

Tools

Databricks

Kubernetes

ESRI ArcGIS

Unity Catalog

Cloud-based databases

RESTful APIs

GraphQL

Job description

Position Summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Essential Duties and Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.


• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.


• Build scalable, secure web applications with metadata-driven search and retrieval features.


• Integrate APIs for seamless data interoperability.


• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.


• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.


• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.


• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Required Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.


• Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.


• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.


• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.


• Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Preferred Qualifications

• AWS Certified Data Analytics - Specialty.


• Microsoft Certified: Azure Data Engineer Associate.


• ESRI ArcGIS Developer Certification.

Required Education and Experience Equivalency

• Bachelor's degree in Computer Science, Data Engineering, or a related field.


• OR 5 years of equivalent experience in full-stack development and data engineering.

Required Certifications

• None specified.

Required Security Clearance

• Active Top Secret/SCI