Data Lake Engineer

Base-2 Solutions; Miami (FL); On-site; USD 120,000 - 160,000; Full time

Job summary

Base-2 Solutions in the United States is seeking a Data Lake Engineer to design, build, and optimize data integration pipelines and API services for geospatial data visualization. The role involves developing front-end interfaces and secure, scalable web applications within ESRI ArcGIS environments and cloud-based databases.

You will work with Databricks, Kubernetes, and Unity Catalog, deploying full-stack solutions that support dashboards, analytics, and data retrieval via RESTful and GraphQL

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• 5+ years of experience in full-stack development and data engineering.
• Experience building data visualization dashboards and analytics for geospatial data.
• Experience with RESTful and GraphQL API development.
• Experience deploying and managing CI/CD pipelines and Kubernetes containers.

Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization and analytics within ESRI GIS platforms, Unity Catalog, and cloud databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines and containerized deployments in Kubernetes with secure API authentication.
• Optimize database queries and indexing for large-scale geospatial and structured datasets.

Job description

Position Summary

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Essential Duties and Responsibilities

• Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
• Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
• Build scalable, secure web applications with metadata-driven search and retrieval features.
• Integrate APIs for seamless data interoperability.
• Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Required Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.
• Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Experience implementing RESTful and GraphQL APIs for data retrieval and integration.
• Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.
• Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Preferred Qualifications

• AWS Certified Data Analytics - Specialty.
• Microsoft Certified: Azure Data Engineer Associate.
• ESRI ArcGIS Developer Certification.

Required Education and Experience Equivalency

• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• OR 5 years of equivalent experience in full-stack development and data engineering.

Required Certifications

• None specified.

Required Security Clearance

• Active Top Secret/SCI