Remote Databricks Architect: Scale Data & ML Workloads

Tiger Analytics

United States

Hybride

USD 130 000 - 160 000

Plein temps

14 jours+

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

A pioneering analytics company in the United States is seeking a skilled Databricks Architect. This role involves designing and implementing scalable data solutions on the Databricks platform for Fortune 100 companies. Candidates should have over 12 years of data engineering experience and strong knowledge of AWS and Databricks. This position offers significant career development opportunities in a fast-growing environment with high individual responsibility.

Qualifications

  • 12+ years of experience in architecture, design, and data engineering.
  • Hands-on experience with Databricks/DataOps architecture.
  • Strong communication and leadership skills, able to work independently.

Responsabilités

  • Design and implement scalable, end-to-end data solutions on the Databricks platform.
  • Provide technical leadership and strategic guidance on Databricks adoption.
  • Ensure optimal performance by tuning Spark jobs and resolving technical issues.

Connaissances

Databricks platform knowledge
AWS exposure
Spark Streaming pipeline design
Technical leadership
Self-driven

Description du poste

Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce.

If you have a passion for tackling business challenges through the use of both structured and unstructured data at scale, Tiger Analytics wants to connect with you. We are looking for a skilled and proactive Databricks Architect to take a pivotal role in designing and deploying resilient data solutions that address our clients' complex business issues.

Responsibilities

  • Design and implement scalable, end-to-end data solutions for ETL, real-time streaming, and machine learning workloads on the Databricks platform
  • Provide technical leadership and strategic guidance on Databricks adoption, including developing reference architectures and best practices.
  • Ensure optimal performance by tuning Spark jobs, optimizing data pipelines, and resolving complex technical issues.
  • Architect, develop, and debug PySpark jobs and data models, integrating Databricks with cloud services such as AWS S3, EMR, and Lambda
  • Implement and enforce data governance, security, and access control policies (e.g., encryption, auditing) on the Databricks environment
  • 12+ years of experience in Architecture, design and data engineering development of large-scale data ecosystems.
  • Databricks Design and Architecture: Design and architect scalable and secure Databricks solutions platform, optimizing performance, cost, and reliability.
  • Hands on Databricks/Dataops Architect that can help reduce consumption, and improve performance issues. Can help build monitoring tools.
  • Good exposure to AWS. Strong comm and leadership skills and Self driven and work independently.
  • Experience in Performance initiatives and drive recommendations (identify tuning opportunities, creation of performance environment etc.
  • Experience with hadoop environment.
  • Core Skills:-Databricks platform knowledge, Unity Catalog migration implementation exposure, Spark Streaming pipeline design exposure

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, fast-growing, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy,
national origin, ancestry, marital status, protected veteran status, disability
status, or any other basis as protected by federal, state, or local law.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Databricks Architect
Databricks Architect

Tiger Analytics • États-Unis

Hybride
USD 130 000 - 160 000
Senior Data & Analytics Architect — AWS & Databricks
Senior Data & Analytics Architect — AWS & Databricks

Tiger Analytics • Texas

Sur place
USD 180 000 - 240 000
Principal Data Architect - Databricks & Data Platform Lead
Principal Data Architect - Databricks & Data Platform Lead

Tiger Analytics • Texas

Sur place
USD 130 000 - 160 000
Databricks Tech Partner - Data & AI Transformation Leader
Databricks Tech Partner - Data & AI Transformation Leader

Tiger Analytics • Sunnyvale (CA)

Sur place
USD 180 000 - 260 000
Infra Solution Architect: Cloud Transformation & Databricks
Infra Solution Architect: Cloud Transformation & Databricks

Tiger Analytics • Texas

Sur place
USD 150 000 - 210 000
Principal Architect - Databricks
Principal Architect - Databricks

Tiger Analytics • Texas

Sur place
USD 130 000 - 160 000
Technology Partner - Databricks
Technology Partner - Databricks

Tiger Analytics • Sunnyvale (CA)

Sur place
USD 180 000 - 260 000
Senior Solution Architect
Senior Solution Architect

Tiger Analytics • Dallas (TX)

Sur place
USD 180 000 - 240 000
Senior Cloud Data Architect - Azure, Snowflake & Databricks
Senior Cloud Data Architect - Azure, Snowflake & Databricks

Tiger Analytics • Chicago (IL)

Sur place
USD 160 000 - 220 000
Senior Solution Architect
Senior Solution Architect

Tiger Analytics • Texas

Sur place
USD 180 000 - 240 000