Enable job alerts via email!

Data Engineer-Spark, Scala, Spark Streaming, Big data Hadoop, hive, Kafka, Cassandra - Developer

Tata Consultancy Services

Austin (TX)

On-site

USD 70,000 - 140,000

Full time

22 days ago

Boost your interview chances

Create a job specific, tailored resume for higher success rate.

Job summary

A leading company seeks a Data Engineer proficient in Spark and Scala to develop scalable solutions. Responsibilities include managing data pipelines, collaborating with stakeholders, and optimizing processes. Ideal candidates should have strong communication skills and familiarity with Agile methodologies.

Qualifications

  • Strong experience in Spark, Scala, SQL, Kafka, Cassandra, Spark Streaming.
  • Good to have AWS experience.
  • Knowledge of Python and Unix shell scripting.

Responsibilities

  • Developing scalable solutions using Spark, Scala, and Big Data Hadoop.
  • Managing system integrations and optimizing data pipelines.
  • Gathering business requirements and delivering user training.

Skills

Spark
Scala
SQL
Kafka
Cassandra
Spark Streaming
Python
Unix shell scripting
Communication
Problem Solving

Job description

Join to apply for the Data Engineer - Spark, Scala, Spark Streaming, Big Data Hadoop, Hive, Kafka, Cassandra - Developer role at Tata Consultancy Services.

Responsibilities include:

  1. Developing and implementing scalable solutions using technologies like Spark, Scala, and Big Data Hadoop.
  2. Managing system integrations, optimizing data pipelines, and providing technical support.
  3. Gathering business requirements, designing functional specifications, streamlining processes, conducting system testing, and delivering user training.
  4. Collaborating with stakeholders and technical teams to align business goals with technical solutions.

Skills & Qualifications:

  • Strong experience in Spark, Scala, SQL (basic and advanced), Kafka, Cassandra, Spark Streaming.
  • Good to have AWS experience.
  • Knowledge of Python and Unix shell scripting.
  • Expertise in business process mapping, requirements gathering, and creating functional specifications.
  • Excellent communication and problem-solving skills.
  • Familiarity with Agile methodologies.

Salary Range: $70,000 - $140,000 per year.

Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.

Similar jobs

Senior Backend Software Engineer - Data (REMOTE)

GEICO

Austin

Remote

USD 90,000 - 185,000

Today
Be an early applicant

Sr. Engineer, Web Development - Data (REMOTE)

GEICO

Austin

Remote

USD 90,000 - 215,000

Today
Be an early applicant

Senior Crypto Data Engineer (Global-Remote-Non-US)

Token Metrics

Austin

Remote

USD 110,000 - 150,000

6 days ago
Be an early applicant

Senior Staff Engineer - Legal Technology (REMOTE)

GEICO

Austin

Remote

USD 130,000 - 260,000

Today
Be an early applicant

Senior Software Engineer- Observability and Reliability Platform Engineering (REMOTE)

GEICO

Austin

Remote

USD 90,000 - 230,000

Today
Be an early applicant

Data Scientist

CommUnityCare

Austin

Remote

USD 80,000 - 120,000

2 days ago
Be an early applicant

Senior Backend Software Engineer - Data (REMOTE)

GEICO

Kansas City

Remote

USD 90,000 - 185,000

Today
Be an early applicant

Sr Data Engineer - Remote

Quality Control Specialist - Pest Control

Little Rock

Remote

USD 89,000 - 177,000

2 days ago
Be an early applicant

Data Analyst - Growth (25-26)

IDEA Public Schools

Austin

Remote

USD 74,000 - 88,000

2 days ago
Be an early applicant