Cloud Data Platform Engineer - Azure Databricks & Security

AAA Western and Central New York; Village of Williamsville (NY); On-site; USD 79,000 - 93,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Life and AD&D Insurance

Flexible work schedules

401(k) with company match

Health Spending Accounts

Company Paid Disability

Paid time off

Tuition reimbursement & training

AAA membership & travel discounts

Volunteer Time Off

Job summary

AAA Western and Central New York is seeking a Data Platform Engineer to administer Azure Databricks workspaces, monitor SQL warehouses, and ensure resilient data pipelines. The role emphasizes governance, cost-efficient compute, and secure access across cloud data services.

The ideal candidate will have experience with backups, data security, and cloud networking concepts, plus strong collaboration and communication skills to support a multi-disciplinary IT team.

Qualifications

• Backups, restores and recovery knowledge.
• Cloud compute and networking concepts understanding.
• Ownership mindset and impact awareness.
• Strong time-management and communication skills.
• Curiosity and eagerness to learn new technologies.
• Collaborative problem-solving in a team setting.
• Ability to follow standards and contribute to improvements.
• Clear written and verbal communication.

Responsibilities

• 25% Cloud Databricks data platform administration: manage workspaces, clusters, permissions, and policies; enable cost-efficient compute.
• 20% Data infrastructure reliability: monitor Databricks jobs, SQL warehouses, storage; tune clusters and pipelines.
• 15% Data backup, recovery and resilience: troubleshoot cluster performance and integration points.
• 15% Security: implement SQL roles, Azure RBAC, network rules and Unity Catalog privileges.
• 15% Troubleshooting and operational support: diagnose database issues with IT team.
• 10% Documentation and standards: maintain environments, architecture diagrams and cluster standards.

Job description

AAA Western and Central New York is seeking a Data Platform Engineer to administer Azure Databricks workspaces, monitor SQL warehouses, and ensure resilient data pipelines. The role emphasizes governance, cost-efficient compute, and secure access across cloud data services.

The ideal candidate will have experience with backups, data security, and cloud networking concepts, plus strong collaboration and communication skills to support a multi-disciplinary IT team.