Senior Data & Analytics Platform Architect - AWS/Databricks

Cogniify, Inc.; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Unlimited PTO

Medical, dental and vision coverage

Disability and life insurance

Mental health support

Employer Stock Purchase Program (ESPP)

Yearly team-building experiences

Mentorship opportunities

Open communication with leadership

Job summary

Cogniify, Inc. is seeking a Senior Data & Analytics Platform Architect to design and build a cloud-based data platform on AWS and Databricks.

You will define the lakehouse architecture, automate cloud provisioning, and lead major initiatives with a hands-on, IC mindset. The role requires deep expertise in AWS, Databricks, Terraform, and modern data stack tooling, with a focus on scalable, secure, production-grade platforms in a fast-paced environment in San Francisco Bay Area (remote options not

Qualifications

• 11+ years of related experience (9+years with a Master’s degree).
• At least 10 years of experience in cloud infrastructure and/or enterprise data platforms in a highly available production environment.
• Bachelor’s degree in a relevant field, or an equivalent combination of education and experience. A relevant technical certification may be required.
• Advanced knowledge of AWS, especially data storage, data processing, analytics, security and compute services.
• Advanced knowledge of infrastructure as code, especially Terraform.
• Strong knowledge of Databricks, lakehouse architecture, governance, metadata and data quality.
• Strong working knowledge of Python, SQL, Spark and dbt.
• Intermediate knowledge of cloud and infrastructure automation, and of CI/CD practices.

Responsibilities

• Translate overall direction into plans for the data and analytics platform, working toward long-range goals with a clear understanding of key business processes.
• Define and design the cloud platform, including cloud automation tools and standards, CI/CD pipelines, DevOps tooling and AWS account provisioning automation.
• Lead large, complex projects and major initiatives, setting direction for others and taking many assignments on your own initiative.
• Refine end-to-end development processes, including CI/CD, security scanning and production monitoring.
• Solve unusually complex technical problems and act as the go-to technical expert on new technology direction.
• Communicate across all organizational levels, including influencing executives when needed, and serve as the spokesperson for advanced platform projects.
• Advise management and business stakeholders on technical research, and coordinate with senior external contacts on significant technical matters.
• Oversee documentation of infrastructure and work instructions for systems and applications.
• Develop approaches to prevent future incidents, make sure work delivers long-term value, and make decisions on access, permissions and security controls.
• Serve as the subject matter expert for general engineering and platform strategy, mentor engineers and track industry trends to plan for future platform needs.

Skills

Databricks Lakehouse

Python

SQL

Spark

dbt

Terraform

CI/CD practices

AWS services

Education

Bachelor’s degree in a relevant field

Master’s degree (advantage)

Tools

Databricks

AWS

Terraform

Job description

Cogniify, Inc. is seeking a Senior Data & Analytics Platform Architect to design and build a cloud-based data platform on AWS and Databricks.

You will define the lakehouse architecture, automate cloud provisioning, and lead major initiatives with a hands-on, IC mindset. The role requires deep expertise in AWS, Databricks, Terraform, and modern data stack tooling, with a focus on scalable, secure, production-grade platforms in a fast-paced environment in San Francisco Bay Area (remote options not