Senior Azure Data Architect - Databricks & Lakehouse

Robotics Technologies LLC

Atlanta (GA)

On-site

USD 120,000 - 180,000

Full time

15 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Robotics Technologies LLC in the United States is seeking a senior data engineering professional to bridge IT and business units, delivering scalable data pipelines and governance. The role emphasizes designing solutions, coordinating with stakeholders, and aligning with IT strategy to enable data-driven decisions.

The ideal candidate has 12+ years of data engineering experience, strong Databricks and cloud skills, and a proven ability to lead complex data initiatives across platforms such as

Qualifications

  • Bachelor's degree in computer science, information systems, or a related field or an equivalent combination of education and experience.
  • 12 years of experience developing, implementing and maintaining enterprise policies, procedures and operating standards including preparing agendas, meeting minutes, and follow-up actions for meetings with management.
  • 10+ years of experience in data engineering, including design, application development, testing, and operational stability.
  • Advanced proficiency in data processing frameworks and tools, including Parquet, Iceberg, PySpark, Lambda, Databricks and Azure data services.
  • Proficiency in programming languages such as Python, Java, or Scala for data processing and application development.
  • Extensive hands-on experience with Databricks, including architecting and managing large-scale data pipelines, optimizing Spark jobs, implementing security and governance controls, and automating workflows.
  • Proficiency in automation and continuous delivery methods, utilizing CI/CD pipelines with tools like Git/Bitbucket, Jenkins, automated DAB deployments and version control.
  • Certification on Databricks Data Engineering Associate or Professional.
  • Azure Certifications.
  • Proficiency in relational databases (Oracle or SQL Server and ER Data Modeling).
  • Skilled in writing Oracle SQL queries utilizing DML, DDL, and

Responsibilities

  • Serves as an expert regarding the business units supported and has expert understanding of the Information Technology organization's systems and capabilities.
  • Analyzes business unit operations to understand strengths and weaknesses and to identify process and function automation opportunities.
  • Develops appropriate business models to represent business requirements and meet business needs.
  • Obtains and validates information requirements from stakeholders through various analysis techniques.
  • Translates high level business requirements into functional specifications for the Information Technology organization.
  • Manages requirements, approvals, changes, and traceability.
  • Assists with business process redesign and documentation as needed for new technology.
  • Ensures technology solutions are in compliance with and uphold organizational standards.
  • Develops business models to represent requirements, such as use cases, business process flows, and data flow diagrams.
  • Negotiates agreements and commitments.
  • Facilitates communication between business units and Information Technology from initial requirements to final implementation.
  • Provides input regarding buy versus build decisions.
  • Participates in planning sessions with business units to improve business processes.
  • Participates in defining and streamlining division level processes, procedures, and templates as needed to support the organization's process maturity goals and to ensure effective and efficient methods in accordance with best practices.
  • Provides business reporting and analytical support, particularly pertaining to departmental governance and performance, utilizing various data sources and analytical tools.
  • Performs analysis and provides reporting views with improvement recommendations.
  • Designs, develops, tests, and maintains various reports using SQL driven application table portlets and Business Objects.
  • Conducts systems analysis with a focus on business process models and use cases.
  • Performs system administration and maintenance as needed in support of departmental activities.
  • Performs audits to ensure compliance with division processes, procedures and standards.
  • Analyzes incidents related to the system/application to identify problem areas.
  • Works closely with the application business partner's product support team to identify and implement solutions.
  • Works on multiple projects evaluating and identifying project complexity, assumptions, constraints, and dependencies.
  • Conducts timely surveys to gauge effectiveness of delivery of technology solutions.
  • Performs a variety of tasks to improve on the existing operating processes, methodologies and standards.
  • Participates in the development of processes, procedures, and protocols for the department to ensure effective and efficient methods of providing support.
  • Coordinates the maintenance of all tools used to administer the processes as needed to ensure system currency.
  • Builds, maintains, and manages stakeholder relationships.
  • Educates the Information Technology organization on the direction of the business.
  • Communicates complex technical concepts simply and effectively to nontechnical team members.
  • Guides team members through the established operating process and elevate non-conformance as needed.
  • Maintains a current knowledge base and understanding of technological trends.
  • Uses Information Technology knowledge base to bring solutions to business units supported and enhances the enterprise's competitive edge.
  • Assists less experienced team members as needed.

Skills

Data engineering
Databricks
PySpark
Python/Java/Scala
Cloud services (Azure/AWS)
Parquet/Iceberg
SQL/ER data modeling
CI/CD pipelines

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks
Git/Bitbucket
Jenkins
Azure
AWS

Job description

Robotics Technologies LLC in the United States is seeking a senior data engineering professional to bridge IT and business units, delivering scalable data pipelines and governance. The role emphasizes designing solutions, coordinating with stakeholders, and aligning with IT strategy to enable data-driven decisions.

The ideal candidate has 12+ years of data engineering experience, strong Databricks and cloud skills, and a proven ability to lead complex data initiatives across platforms such as

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Architect: Data Warehousing, Databricks, BI Lead
Azure Data Architect: Data Warehousing, Databricks, BI Lead

Robotics Technologies LLC • Saint Paul (MN)

On-site
USD 120,000 - 180,000
Senior Azure Databricks & Lakehouse Engineer
Senior Azure Databricks & Lakehouse Engineer

Environmental and Safety Solutions, Inc. • Glendale (AZ)

On-site
USD 140,000 - 180,000
Azure Data Engineer – Databricks & Lakehouse Specialist
Azure Data Engineer – Databricks & Lakehouse Specialist

Robotics Technologies LLC • Cupertino (CA)

On-site
USD 120,000 - 160,000
Azure Data Engineer: ETL, Databricks & Data Lake Expert
Azure Data Engineer: ETL, Databricks & Data Lake Expert

Robotics Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 140,000
Azure Databricks Data Analytics Architect
Azure Databricks Data Analytics Architect

Robotic Technologies Automation • Dallas (TX)

On-site
USD 120,000 - 190,000
Azure Data Analytics Architect: Lead Databricks Solutions
Azure Data Analytics Architect: Lead Databricks Solutions

Robotic Technologies Automation • Houston (TX)

On-site
USD 130,000 - 190,000
Senior Azure Databricks Lakehouse Architect
Senior Azure Databricks Lakehouse Architect

Programmers.io • Minneapolis (MN)

On-site
USD 120,000 - 170,000
Senior Databricks Lakehouse Architect on AWS
Senior Databricks Lakehouse Architect on AWS

Robotics Technologies LLC • Atlanta (GA)

On-site
USD 140,000 - 210,000
Azure Databricks Lakehouse Architect & AI Leader
Azure Databricks Lakehouse Architect & AI Leader

Frame Data & AI • Houston (TX)

On-site
USD 130,000 - 210,000
Senior Databricks Engineer: Lakehouse, PySpark & Spark SQL
Senior Databricks Engineer: Lakehouse, PySpark & Spark SQL

Robotics Technologies LLC • Austin (TX)

On-site
USD 130,000 - 170,000