Databricks Cloud Architect

Tata Consultancy Services; Bellevue (WA); On-site; USD 100,000 - 150,000; Full time

Job summary

Tata Consultancy Services is looking for a Databricks Cloud Architect to lead architectural design and optimization of data pipelines. This role demands extensive experience in data engineering, particularly with Databricks and AWS services while engaging with C-level executives to drive success. Responsibilities entail guiding projects, improving platform scalability, and collaborating with cross-functional teams.

Benefits

Discretionary Annual Incentive

Comprehensive Medical Coverage

Family Support: Maternal & Parental Leaves

Legal Assistance and Financial Support

Qualifications

• 12+ years of experience with Databricks and Spark.
• Strong knowledge of AWS services such as S3, DMS, Lambda.
• Ability to optimize complex data workflows.

Responsibilities

• Accountable for the design and architecture of systems.
• Act as a technical lead for complex projects.
• Evaluate new tools and processes to improve efficiency.

Skills

Data engineering

Databricks

Spark

AWS

SQL

PySpark

CI/CD pipelines

Infrastructure as code

Analytical skills

Communication skills

Tools

Terraform

AWS CloudFormation

Gitlab

CodePipeline

Job description

Join to apply for the Databricks Cloud Architect role at Tata Consultancy Services

2 weeks ago Be among the first 25 applicants

Join to apply for the Databricks Cloud Architect role at Tata Consultancy Services

Get AI-powered advice on this job and more exclusive features.

• 12+ years of experience in data engineering with Databricks and Spark
• Strong knowledge of Databricks architecture, tools and capabilities
• Experience in Design, develop, and optimize ETL/ELT data pipelines using Databricks on AWS.
• Good understanding of AWS native services – S3, DataSync, DMS, Lambda, SNS, SQS.
• Deep understanding of distributed computing and how to use spark for data processing
• SQL and PySpark : strong command over querying databases and proficiency in PySpark.
• Experience with Delta Lake and building data lakes.
• Familiarity with CI/CD pipelines using tools such as Gitlab, or CodePipeline.
• Experience with infrastructure as code (IaC) tools like Terraform or AWS CloudFormation.
• Strong analytical and problem-solving skills, with the ability to optimize complex data workflows.
• Excellent communication skills and the ability to work in a fast-paced, collaborative environment
• Experienced in complex customer interactions
• Ability to drive technical and business conversations with C-level executives of financial institutions to develop relationships, orchestrate teams and influence outcomes to achieve long-term customer success.
• Skilled in identifying and prioritizing key use cases, resource allocations, and investment focus.
• Prior experience with coding in a core programming language (i.e., Python, Java, Scala) and willingness to learn a base level of Spark.
• Hands-on expertise with complex proofs-of-concept and public cloud platform(s).
• Know how to provide technical solutions for specialized customer needs and navigate a competitive landscape.
  
  
• Accountable for the design, development and architecture of new and current systems
• Participates in enterprise architecture reviews and provides recommendations and guidance to
• align with corporate systems
• Act as technical lead for medium to large complex project/feature enhancements
• Work with the Product Management team, Project Management, Business and User Experience teams
• to identify and prioritize initiatives and features
• Participate in all grooming and priority setting sessions and accountable for project sizing and estimation
• Evaluates new tools, technologies and processes to improve speed, efficiency and scalability of Datalake Platform
• Work closely with other development teams across organization to troubleshoot issues, performance
• tuning and identify opportunities for seamless integrations across systems
• Works closely with the Production Support team to train, guide and troubleshoot production issues
• Provides coaching and technical guidance for Software Engineers at different levels of experience
• Thrives on working in a fast-paced environment.
  
  

• 12+ years of experience in data engineering with Databricks and Spark
• Strong knowledge of Databricks architecture, tools and capabilities
• Experience in Design, develop, and optimize ETL/ELT data pipelines using Databricks on AWS.
• Good understanding of AWS native services – S3, DataSync, DMS, Lambda, SNS, SQS.
• Deep understanding of distributed computing and how to use spark for data processing
• SQL and PySpark : strong command over querying databases and proficiency in PySpark.
• Experience with Delta Lake and building data lakes.
• Familiarity with CI/CD pipelines using tools such as Gitlab, or CodePipeline.
• Experience with infrastructure as code (IaC) tools like Terraform or AWS CloudFormation.
• Strong analytical and problem-solving skills, with the ability to optimize complex data workflows.
• Excellent communication skills and the ability to work in a fast-paced, collaborative environment
• Experienced in complex customer interactions
• Ability to drive technical and business conversations with C-level executives of financial institutions to develop relationships, orchestrate teams and influence outcomes to achieve long-term customer success.
• Skilled in identifying and prioritizing key use cases, resource allocations, and investment focus.
• Prior experience with coding in a core programming language (i.e., Python, Java, Scala) and willingness to learn a base level of Spark.
• Hands-on expertise with complex proofs-of-concept and public cloud platform(s).
• Know how to provide technical solutions for specialized customer needs and navigate a competitive landscape.
  
  

Roles & Responsibilities

• Accountable for the design, development and architecture of new and current systems
• Participates in enterprise architecture reviews and provides recommendations and guidance to
• align with corporate systems
• Act as technical lead for medium to large complex project/feature enhancements
• Work with the Product Management team, Project Management, Business and User Experience teams
• to identify and prioritize initiatives and features
• Participate in all grooming and priority setting sessions and accountable for project sizing and estimation
• Evaluates new tools, technologies and processes to improve speed, efficiency and scalability of Datalake Platform
• Work closely with other development teams across organization to troubleshoot issues, performance
• tuning and identify opportunities for seamless integrations across systems
• Works closely with the Production Support team to train, guide and troubleshoot production issues
• Provides coaching and technical guidance for Software Engineers at different levels of experience
• Thrives on working in a fast-paced environment.
  
  

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medi cal Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
  
  

Salary Range-$100,000-$150,000 a year

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Tata Consultancy Services by 2x

Get notified about new Cloud Architect jobs in Bellevue, WA.

Seattle, WA $136,200.00-$180,000.00 2 weeks ago

Seattle, WA $7,950.00-$15,802.00 4 weeks ago

Chief Enterprise Architect (RISE) - Multiple Locations

Principal Solutions Architect - System level

Seattle, WA $224,000.00-$336,000.00 2 weeks ago

Solutions Architect - IT Global Sustainability

Seattle, WA $175,000.00-$230,000.00 1 week ago

Seattle, WA $272,000.00-$471,500.00 1 week ago

Solutions Architect - Cloud Providers and Hyperscale

Redmond, WA $272,000.00-$471,500.00 1 week ago

Greater Seattle Area $150,000.00-$180,000.00 5 days ago

Bellevue, WA $178,275.00-$330,750.00 21 hours ago

Solutions Architect, Amazon Web Services

Seattle, WA $118,200.00-$204,300.00 2 weeks ago

Solutions Architect, Amazon Web Services, US SLG & EDU

Bellevue, WA $165,000.00-$253,000.00 2 hours ago

Seattle, WA $165,000.00-$223,200.00 1 day ago

Seattle, WA $250,200.00-$271,800.00 20 hours ago

Sr. Startup Solution Architect, AWS Startups

Seattle, WA $138,200.00-$239,000.00 1 week ago

Solutions Architect, Networking - Cloud Service Providers

Seattle, WA $151,800.00-$189,750.00 2 hours ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.