Data Lake Engineer

Base-2 Solutions, LLC; Town of Florida (NY); On-site; USD 110,000 - 160,000; Full time

Job summary

Base-2 Solutions, LLC seeks a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS, developing and optimizing data integration pipelines, APIs, and visualization interfaces for geospatial and structured data.

The role covers Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering, with emphasis on secure, scalable full-stack solutions and metadata-driven search capabilities.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or related field or 5+ years in full-stack and data engineering.

Responsibilities

• Develop, maintain, and optimize data pipelines, APIs, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization, dashboards, and analytics within ESRI GIS platforms and cloud-based databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration.
• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.
• Optimize database queries and indexing for large-scale geospatial and structured datasets.

Skills

Data engineering

Full-stack development

RESTful APIs

GraphQL APIs

CI/CD pipelines

Kubernetes

Databricks

ESRI ArcGIS

Cloud databases

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Kubernetes

ESRI ArcGIS environments

Unity Catalog

Job description

Position Summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Essential Duties and Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.


• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.


• Build scalable, secure web applications with metadata-driven search and retrieval features.


• Integrate APIs for seamless data interoperability.


• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.


• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.


• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.


• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Required Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.


• Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.


• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.


• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.


• Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Preferred Qualifications

• AWS Certified Data Analytics – Specialty.


• Microsoft Certified: Azure Data Engineer Associate.


• ESRI ArcGIS Developer Certification.

Required Education and Experience Equivalency

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.


• OR 5 years of equivalent experience in full-stack development and data engineering.

Required Certifications

• None specified.

Required Security Clearance

• Active Top Secret/SCI