Data Lake Engineer

Base-2 Solutions; Town of Florida (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data.

The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field, or 5 years of equivalent experience.
• Experience building and deploying full-stack data visualization dashboards.
• Experience with RESTful and GraphQL APIs for data retrieval.
• Experience CI/CD pipelines and Kubernetes containerized deployments.
• Experience optimizing large geospatial and structured datasets.

Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Skills

Full-stack development

Data engineering

RESTful APIs

GraphQL APIs

CI/CD

Kubernetes

ESRI ArcGIS

Unity Catalog

Cloud data platforms

Data visualization dashboards

Education

Bachelor's degree in Computer Science, Data Engineering, or related field

Tools

Databricks

Kubernetes

Unity Catalog

ESRI ArcGIS

Cloud databases

Job description

Position Summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Essential Duties and Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Required Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.
• Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.
• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.
• Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Preferred Qualifications

• AWS Certified Data Analytics - Specialty.
• Microsoft Certified: Azure Data Engineer Associate.
• ESRI ArcGIS Developer Certification.

Required Education and Experience Equivalency

• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• OR 5 years of equivalent experience in full-stack development and data engineering.

Required Certifications

• None specified.

Required Security Clearance

• Active Top Secret/SCI