Databricks Solutions Architect USA

Cogniify, Inc.

United States

À distance

USD 170 000 - 175 000

Plein temps

Il y a 47 heures
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Avantages offerts par ce poste

Unlimited PTO
Generous parental leave
Medical, dental, and vision coverage
Disability and life insurance
Mental health support
Employee Stock Purchase Plan (ESPP)
Yearly team-building experiences
Mentorship opportunities
Open communication with management

Résumé du poste

Cogniify, Inc. seeks a Databricks Solutions Architect USA to plan and lead Databricks lakehouse platforms, deciding how data is stored, cleaned, protected, and used, and guiding the team that builds it.

You will work with data engineers, product managers and business teams from design to live system, and lead the move from older warehouses to Databricks. This remote role requires travel for workshops and milestones.

Qualifications

  • Plan and lead Databricks lakehouse platforms and guide the build team.
  • Hands-on experience with Databricks, Spark, PySpark and SQL in production.
  • Cloud experience (AWS/Azure/GCP) with data governance and FinOps practices.

Responsabilités

  • Design lakehouse architectures on AWS, Azure or Google Cloud using Delta Lake and Unity Catalog.
  • Set data pipelines with Lakeflow, Spark, and Databricks SQL for consistent engineering practices.
  • Define governance, security, and cost controls to keep data safe and spend in check.
  • Lead migration from legacy data warehouses to Databricks and ensure consistency of metrics.

Connaissances

Databricks
Apache Spark
PySpark
Delta Lake
Unity Catalog
Lakeflow
Lakehouse architecture
AWS
Azure
Google Cloud (GCP)
data migration
CI/CD
data governance
FinOps
leadership
mentoring

Formation

Bachelor's degree or higher in CS/Engineering/IS

Outils

Databricks
Apache Spark
PySpark
Delta Lake
Unity Catalog
Lakeflow
Databricks SQL
Git
MLflow

Description du poste

Solution Architect · Data Science / Data Engineering

Databricks Solutions Architect USA

work Full-time distance Remote payments $170,000 – $175,000 / yr

The Role

Cogniify ishiring a Databricks Solutions Architect (Databricks Architect) to plan and leadour Databricks lakehouse platforms. You will decide how our data is stored,cleaned, protected and used, and guide the team that builds it.

You will workwith data engineers, product managers and business teams, from the first designto a live system. You will also lead the move from older data warehouses toDatabricks.

Much of ourdata work is in energy and utilities, such as smart meter, grid and outagedata. Experience with this kind of data helps.

This is aremote role based in the United States, with some travel for workshops and keymilestones.

Core skills forthis role include Databricks, Apache Spark, PySpark, Delta Lake, Unity Catalog,Lakeflow, lakehouse architecture, AWS, Azure, Google Cloud (GCP), datamigration, CI/CD, data governance and FinOps.

What You Will Do
  • Design lakehouse architectures onAWS, Azure or Google Cloud, using medallion layers, Delta Lake and UnityCatalog.
  • Set how data pipelines are builtwith Lakeflow, Apache Spark and Databricks SQL, so every engineer on the teambuilds in the same way.
  • Define data governance, securityand access control, along with cloud cost controls (FinOps), so data stays safeand spending stays in check.
  • Lead the move from older datawarehouses and ETL tools to Databricks, and make sure the new numbers match theold ones.
  • Set CI/CD and DataOps standards,including Git, Databricks Asset Bundles and automated testing, so releases aresafe and repeatable.
  • Advise on machine learning andgenerative AI use cases, using tools such as MLflow and Agent Bricks where theymake sense.
  • Mentor engineers, runarchitecture reviews, and explain designs and trade-offs to business leadersand other stakeholders in simple words.
  • Travel for workshops, planningsessions and key milestones when needed.
What We Are Looking For
  • A BS, MS or higher in ComputerScience, Engineering, Information Systems or a related field, or equivalentpractical experience.
  • At least 12 years of experiencein data engineering or data architecture, with at least 4 years of hands-onwork on Databricks and Apache Spark using PySpark and SQL.
  • At least 3 production Databricksimplementations that you took from design to go-live.
  • Strong experience on at least onemajor cloud, AWS, Azure or Google Cloud (GCP).
  • Deep knowledge of Delta Lake,Unity Catalog, performance tuning and cluster sizing.
  • Strong leadership andcommunication skills, with a record of leading technical teams and working withbusiness stakeholders in large, complex organizations.
  • Experience setting CI/CD andDataOps standards, including Git and automated testing.
  • Comfort working remotely andtraveling when the work needs it.
  • Databricks certifications such asData Engineer Professional, Machine Learning or Generative AI are a plus.
  • Databricks architect level orChampion level standing, or equivalent proven experience, is a plus.
  • Hands-on work with Lakebridgemigrations, Lakebase or Genie is a plus.
  • Experience with streaming andreal-time pipelines, and with data modeling, is a plus.
  • Experience with energy andutility data, such as smart meter, grid or outage data, is a plus.
  • Experience on large enterprisedata programs is a plus.
Perks and Benefits of WorkingWith Us
  • Unlimited PTO
  • Generous parental leave, wellabove industry standards
  • Medical, dental, and visioncoverage for employees
  • Disability and life insurance
  • Mental health and wellbeingsupport
  • Employee Stock Purchase Plan(ESPP)
  • Yearly team-building experiences
  • Mentorship and sponsorshipopportunities
  • Manager resources and support
  • Small teams where your work makesa real difference
  • Open communication withmanagement and company leadership
  • An entrepreneurial culture wheretaking initiative is part of everyday work

Cogniify is an equal opportunity employer. We celebratediversity and are committed to creating an inclusive environment for allemployees. All qualified applicants will receive consideration for employmentwithout regard to race, color, religion, sex, sexual orientation, genderidentity, national origin, disability, veteran status, or any other protectedcharacteristic.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Databricks Solutions Architect
Databricks Solutions Architect

Cogniify • États-Unis

À distance
USD 180 000 - 250 000
Unlimited PTO
Generous parental leave
Medical, dental, and vision coverage
+7
Solutions Architect - Digital Native Business (DNB)
Solutions Architect - Digital Native Business (DNB)

Databricks Inc. • États-Unis

À distance
USD 180 000 - 248 000
Solutions Architect - Communications, Media, Entertainment and Games
Solutions Architect - Communications, Media, Entertainment and Games

Databricks Inc. • Denver (CO)

Sur place
USD 140 000 - 210 000
Solutions Architect - Digital Native Business (Geo)
Solutions Architect - Digital Native Business (Geo)

Databricks Inc. • États-Unis

À distance
USD 180 000 - 248 000
AWS Databricks Data Engineer
AWS Databricks Data Engineer

Cognizant • Norfolk (VA)

À distance
USD 83 000 - 95 000
Medical/Dental/Vision/Life Insurance
Paid holidays plus PTO
401(k) plan and contributions
+3
Solutions Architect - Emerging Enterprise (Startups)
Solutions Architect - Emerging Enterprise (Startups)

WinsAbove • San Francisco (CA)

Hybride
USD 140 000 - 247 000
Solutions Architect: Emerging Enterprise & Startups
Solutions Architect: Emerging Enterprise & Startups

WinsAbove • États-Unis

Hybride
USD 140 000 - 247 000
Senior Solutions Architect — Big Data & AI (Remote)
Senior Solutions Architect — Big Data & AI (Remote)

WinsAbove • États-Unis

Hybride
USD 140 000 - 247 000
Delivery Solutions Architect - Oil & Gas
Delivery Solutions Architect - Oil & Gas

Databricks Inc. • États-Unis

À distance
USD 180 000 - 248 000
Solutions Architect - Communications, Media, Entertainment and Games
Solutions Architect - Communications, Media, Entertainment and Games

WinsAbove • New York (NY)

Hybride
USD 180 000 - 248 000