Senior Databricks & AWS Lakehouse Platform Engineer

ScolerTec Inc; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

ScolerTec Inc. has multiple openings for Senior Data Platform Engineers – Databricks & AWS to support a large-scale federal cloud modernization and data transformation program.

The successful candidates will be responsible for designing, building, administering, optimizing, configuring, maintaining, and governing an enterprise Databricks Lakehouse Platform that supports scalable data engineering, analytics, and governance capabilities.

Qualifications

• Databricks Lakehouse Platform expertise and administration.
• Unity Catalog, cluster management, SQL warehouses, and job/workflow orchestration experience.
• AWS-based or hybrid Databricks environments familiarity; strong Python and SQL skills.

Responsibilities

• Design, configure, administer, and maintain enterprise Databricks Lakehouse environments.
• Manage Databricks workspaces, Unity Catalog, clusters, SQL warehouses, and workloads.
• Develop and optimize data pipelines using Spark, Delta Lake, DLT, and Databricks Workflows.

Skills

Databricks Lakehouse Platform

Unity Catalog

Apache Spark

Delta Lake

ETL/ELT pipelines

AWS

Python

SQL

CI/CD

Security

Platform observability

Terraform

Databricks administration

Education

MS in Computer Science or related field

Tools

Jenkins

GitLab CI

GitHub Actions

Azure DevOps

Grafana

Prometheus

Datadog

CloudWatch

Elastic

Docker

Kubernetes

Job description

ScolerTec Inc. has multiple openings for Senior Data Platform Engineers – Databricks & AWS to support a large-scale federal cloud modernization and data transformation program.

The successful candidates will be responsible for designing, building, administering, optimizing, configuring, maintaining, and governing an enterprise Databricks Lakehouse Platform that supports scalable data engineering, analytics, and governance capabilities.