Databricks Architect - United States

Tiger Analytics, LLC; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

A leading company is seeking an experienced Databricks Architect to design and implement robust data solutions. This role involves optimizing Databricks platforms and collaborating on DevOps processes, offering significant career development opportunities in a fast-growing environment.

Qualifications

• 12+ years of experience in architecture, design, and data engineering development.
• Core skills in Databricks platform knowledge and Spark Streaming pipeline design.

Responsibilities

• Design and architect scalable Databricks solutions, optimizing performance.
• Collaborate to implement DevOps processes on the Databricks platform.
• Hands-on architect capable of reducing consumption and improving performance.

Skills

Communication

Leadership

Performance Tuning

Optimization

Job description

Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce.

If you are passionate about working on business problems that can be solved using structured and unstructured data on a large scale, Tiger Analytics would like to talk to you. We are seeking an experienced and dynamic Databricks Architect to play a key role in designing and implementing robust data solutions that help in solving the client's complex business problems.

Responsibilities:

1. Design and architect scalable and secure Databricks solutions platform, optimizing performance, cost, and reliability.
2. Hands-on Databricks/DataOps architect capable of reducing consumption and improving performance issues. Ability to help build monitoring tools.
3. Collaborate with teams to implement DevOps processes on the Databricks platform, harmonize, and curate pipelines across all programs.
4. Possess good exposure to AWS and experience with Hadoop environment.

Qualifications:

• 12+ years of experience in architecture, design, and data engineering development of large-scale data ecosystems.
• Core skills in Databricks platform knowledge, Unity Catalog migration implementation, Spark Streaming pipeline design.

Skills:

• Strong communication and leadership skills.
• Self-driven and able to work independently.
• Experience in performance tuning, optimization, and driving performance initiatives.

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, fast-growing, challenging, and entrepreneurial environment, with a high degree of individual responsibility.