Data Lake Engineer

Base-2 Solutions, LLC.; Florida; Hybrid; USD 110,000 - 150,000; Full time

Job summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 Enhanced Domain Awareness by building, maintaining, and optimizing data pipelines, APIs, and front-end interfaces for geospatial and structured data.

The ideal candidate will work with Databricks, Kubernetes, ESRI ArcGIS, Unity Catalog, and cloud databases to deliver scalable, secure web applications and analytics, including metadata-driven search and dashboards.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field OR 5 years of equivalent experience in full-stack development and data engineering.
• Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.
• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.
• Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.
• Active Top Secret/SCI clearance.

Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Skills

Databricks

Kubernetes

ESRI ArcGIS

Unity Catalog

RESTful APIs

GraphQL APIs

CI/CD pipelines

API authentication

Geospatial data

Full-stack data engineering

Education

Bachelor's degree in Computer Science or Data Engineering

5 years equivalent experience in full-stack development and data engineering

Tools

AWS Certified Data Analytics - Specialty

Microsoft Certified: Azure Data Engineer Associate

ESRI ArcGIS Developer Certification

Job description

Position Summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Essential Duties and Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Required Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.
• Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.
• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.
• Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Preferred Qualifications

• AWS Certified Data Analytics - Specialty.
• Microsoft Certified: Azure Data Engineer Associate.
• ESRI ArcGIS Developer Certification.

Required Education and Experience Equivalency

• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• OR 5 years of equivalent experience in full-stack development and data engineering.

Required Certifications

• None specified.

Required Security Clearance

• Active Top Secret/SCI

Equal Employment Opportunity

Base-2 Solutions is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy), national origin, age, sexual orientation, gender identity, genetic information, protected veteran status, or any other characteristic protected by law, and will not be discriminated against on the basis of disability. Learn more: base-2solutions.com/eeo