Databricks Architect

Tiger Analytics; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

An innovative analytics firm is looking for a seasoned Databricks Architect to join their dynamic team. This role involves designing and implementing robust data solutions to tackle complex business challenges for high-profile clients. With a focus on performance optimization and DevOps practices, you will have the opportunity to lead initiatives that enhance data ecosystems. The company offers a fast-paced, entrepreneurial environment where your contributions will have a significant impact. If you're passionate about leveraging data to drive business success, this is the perfect opportunity for you.

Benefits

Career development opportunities

Entrepreneurial environment

High degree of individual responsibility

Qualifications

• 12+ years of experience in architecture and data engineering development.
• Hands-on experience as a Databricks/DataOps Architect.

Responsibilities

• Design and architect scalable and secure Databricks solutions.
• Implement DevOps processes on the Databricks platform.

Skills

Databricks platform knowledge

Performance optimization

DevOps

Unity Catalog migration

Spark Streaming pipeline design

Tools

AWS

Git

Terraform

GitHub Actions

Jenkins

Hadoop

Job description

Description

Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce.

If you are passionate about working on business problems that can be solved using structured and unstructured data on a large scale, Tiger Analytics would like to talk to you. We are seeking an experienced and dynamic Databricks Architect to play a key role in designing and implementing robust data solutions that help in solving the client's complex business problems.

Requirements

• 12+ years of experience in architecture, design, and data engineering development of large-scale data ecosystems.
• Design and architect scalable and secure Databricks solutions platform, optimizing performance, cost, and reliability.
• Hands-on experience as a Databricks/DataOps Architect to help reduce consumption, improve performance, and build monitoring tools.
• Good exposure to AWS. Strong communication and leadership skills. Self-driven and able to work independently.
• Experience in performance initiatives and driving recommendations (identifying tuning opportunities, creating performance environments, etc.).
• Implement DevOps processes on the Databricks platform, including harmonizing and curating pipelines across all programs.
• Experience with Hadoop environment.
• Experience with DevOps tools and practices, including CI/CD pipeline setup using Git, Terraform, GitHub Actions, or Jenkins.

• Core skills: Databricks platform knowledge, performance optimization, DevOps, Unity Catalog migration, Spark Streaming pipeline design.

Benefits

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, fast-growing, challenging, and entrepreneurial environment, with a high degree of individual responsibility.