AWS Tech Lead with DataBricks

The Dignify Solutions, LLC; Raritan (NJ); On-site; USD 110,000 - 140,000; Full time

Job summary

A technology consulting firm is seeking a skilled professional to deploy AWS environments for Databricks. This role involves creating platforms, managing AWS components, and applying DevOps and MLOps practices. The ideal candidate has over 8 years of experience in AWS environments and strong expertise in using Databricks.

Qualifications

• 8+ years of experience in AWS environment deployment for Databricks.
• Expertise in creating platforms and deploying multiple environments in AWS.
• Hands-on experience with AWS components.

Responsibilities

• Deploy AWS environments for Databricks and support AWS as a platform.
• Create platforms and deploy multiple environments in AWS for Databricks.
• Work with AWS components and manage objects accordingly.

Skills

AWS environment deployment

DevOps practices

MLOps practices

Hands-on experience with AWS components

Tools

AWS

Databricks

Job description

Overview

This posting describes a role focused on AWS environment deployment for Databricks, with responsibilities spanning platform provisioning, environment deployment, and ongoing support for AWS and Databricks platforms.

Responsibilities

• Deploy AWS environments for Databricks and support AWS as a platform for Databricks.
• Create platforms and deploy multiple environments in AWS for Databricks.
• Work hands-on with AWS components including VPCs, subnets, PrivateLink, Security Groups, Kinesis, STS, API Gateway, Lambda, Storage configuration, Workspace Creation, S3, SCIM sync, Credential Configuration, Cross-account IAM roles, IAM policies, AD group configurations, Encryption Key Configuration, Storage Encryption, and EBS volumes; manage objects accordingly.
• Apply data technologies on cloud environments and implement DevOps and MLOps practices.
• Contribute to large-scale technology platform initiatives and collaboration across teams.

Qualifications

• 8+ years of experience in AWS environment deployment for Databricks.
• Expertise in creating platforms and deploying multiple environments in AWS for Databricks.
• Hands-on experience with AWS components including (VPC, Subnets, PrivateLink, Security Groups, Kinesis, STS, API Gateway, Lambda, Storage Configuration, Workspace Creation, S3, SCIM sync, Credential Configuration, Cross-account IAM roles, Policy, IAM policies, AD group configurations, Encryption Key Configuration, Storage Encryption, EBS volumes, object management).
• Hands-on experience with data technologies on cloud.
• Experience with DevOps and MLOps (Machine Learning) practices.
• Experience with large-scale technology platforms.
• Ability to support AWS as a platform and Databricks as a platform.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Other

Industries

• IT Services and IT Consulting

EEO Statement: Referrals increase your chances of interviewing. This posting contains standard job information and is inclusive of all qualified applicants.