Data Bricks Architect

Tata Consultancy Services

Canton (MS)

On-site

USD 90,000 - 110,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Comprehensive Medical Coverage

401K Plan

Discretionary Annual Incentive

Family Support

Time Off

Job summary

A leading company is seeking a Data Bricks Architect to design scalable data ingestion pipelines using Apache Spark and Azure Databricks. The role requires strong analytical skills, experience with data pipelines, and a focus on delivering high-quality data solutions to stakeholders. This full-time position offers comprehensive benefits and fosters a collaborative work environment.

Qualifications

Strong experience in Databricks - Primary Language - Scala.
Ability to analyze large datasets.
Healthcare Payer Experience.

Responsibilities

Design and implement data ingestion pipelines using Apache Spark and Azure Databricks.
Deliver proofs of concept to project stakeholders.
Work within an Agile delivery/DevOps methodology.

Skills

Data ingestion pipelines

Apache Spark

Azure Data Factory

Strong analytical skills

Customer Focus

Job description

Join to apply for the Data Bricks Architect role at Tata Consultancy Services

12 hours ago Be among the first 25 applicants

Join to apply for the Data Bricks Architect role at Tata Consultancy Services

Get AI-powered advice on this job and more exclusive features.

Strong experience in Databricks- Primary Language-Scala
Strong experience of building data piplines using Azure Data Factory and Apache Spark (Azure Databricks)
Ability to analyze large datasets
Strong analytical skills
Customer Focus | E3
Design and implement highly performant data ingestion pipelines from multiple sources using Apache Spark and Azure Databricks
Deliver and present proofs of concept to of key technology components to project stakeholders
Develop scalable and re-usable frameworks for ingesting of geospatial data sets
Integrate the end to end data pipleline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
Work with event based / streaming technologies to ingest and process data
Work with other members of the project team to support delivery of additional project components (API interfaces, Search)
Evaluate the performance and applicability of multiple tools against customer requirements
Work within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Must Have Technical/Functional Skills

Healthcare Payer Experience | E3
Strong experience in Databricks- Primary Language-Scala
Strong Big Data Skills | E3
Strong experience of building data piplines using Azure Data Factory and Apache Spark (Azure Databricks)
Ability to analyze large datasets
Strong analytical skills
Customer Focus | E3

Roles & Responsibilities

Design and implement highly performant data ingestion pipelines from multiple sources using Apache Spark and Azure Databricks
Deliver and present proofs of concept to of key technology components to project stakeholders
Develop scalable and re-usable frameworks for ingesting of geospatial data sets
Integrate the end to end data pipleline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
Work with event based / streaming technologies to ingest and process data
Work with other members of the project team to support delivery of additional project components (API interfaces, Search)
Evaluate the performance and applicability of multiple tools against customer requirements
Work within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Generic Managerial Skills, If any

Work in Onsite-Offshore Model
Team Player

Salary Range: $90,000 - $110,000 a Year

TCS Employee Benefits Summary

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Seniority level