Data Platform Engineer: Azure SQL, Databricks & Automation

Wilson Elser; New York (NY); On-site; USD 125,000 - 155,000; Full time

Benefits offered by this job

401(k) match

Generous PTO

Corporate discount plans

Job summary

Wilson Elser is seeking a Data Operations Engineer to manage and optimize enterprise data platforms across on-premises and cloud environments. You will focus on Microsoft SQL Server (On-Premises), Azure SQL, and Azure Databricks to ensure data platform availability, security, and operational excellence.

This role requires collaboration with data engineers, developers, and infrastructure teams to deliver reliable, scalable data services, maintain critical database infrastructure, automate tasks,

Qualifications

• Bachelor’s Degree in Computer Science, Information Technology or Engineering.
• 4+ years of experience administering Azure SQL and MS SQL Server environments.
• Experience administering Azure Databricks environments.
• Strong knowledge of T-SQL programming and query optimization.
• Experience with Azure Monitor, Log Analytics, and performance monitoring tools.
• Familiarity with PowerShell, Azure CLI, or Python scripting.
• Experience with Azure DevOps, GitHub, or CI/CD pipelines.
• Strong troubleshooting and analytical skills.
• Excellent communication and documentation skills.
• Ensure compliance with organizational governance and regulatory requirements.

Responsibilities

• Administer and maintain Microsoft SQL Server on-premises environments.
• Manage Azure SQL Database and Azure SQL Managed Instance environments.
• Monitor database health, performance, storage utilization, and capacity planning.
• Perform database installation, configuration, patching, upgrades, and migrations.
• Configure and manage high availability and disaster recovery solutions, including SQL Server Always On Availability Groups, failover clustering, backup, and recovery.
• Develop and maintain backup, restore, and disaster recovery procedures.
• Manage and monitor Azure SQL resources and Azure Databricks workspaces
• Monitor SQL cloud resource utilization and Databricks job scheduling.
• Coordinate data security access management with InfoSec and Infrastructure teams.
• Analyze and resolve database performance bottlenecks.
• Optimize SQL queries, indexes, execution plans, and database configurations.
• Monitor resource consumption and recommend performance improvements.
• Implement proactive monitoring and alerting for production systems.
• Automate operational tasks using PowerShell, T-SQL, Azure CLI, or Python.
• Support CI/CD pipelines for database deployments using Azure DevOps or GitHub Actions.
• Automate database maintenance, monitoring, and reporting processes.
• Monitor database environments using Azure Monitor, Log Analytics, SQL monitoring tools, and Databricks monitoring capabilities.
• Respond to production incidents, troubleshoot issues, and perform root cause analysis.
• Maintain operational runbooks and standard operating procedures.
• Participate in on-call support rotations when required.
• Implement database security best practices.
• Manage user access, encryption, auditing, and compliance controls.
• Perform vulnerability assessments and security remediation.

Skills

Troubleshooting

Analytical skills

Communication skills

Education

Bachelor’s Degree in Computer Science, IT or Engineering

Tools

Azure SQL

MS SQL Server

Azure Databricks

PowerShell

Azure CLI

Python

Azure DevOps

GitHub Actions

Job description

Wilson Elser is seeking a Data Operations Engineer to manage and optimize enterprise data platforms across on-premises and cloud environments. You will focus on Microsoft SQL Server (On-Premises), Azure SQL, and Azure Databricks to ensure data platform availability, security, and operational excellence.

This role requires collaboration with data engineers, developers, and infrastructure teams to deliver reliable, scalable data services, maintain critical database infrastructure, automate tasks,