Senior Big Data Engineer - Spark/AWS Platform

State Farm Insurance; Seattle (WA); On-site; USD 9,351 - 15,585; Full time

Job summary

Clarivate Analytics is seeking a Software Engineer for its IMS Team in Bangalore to work on Big Data technologies involved in content ingestion, curation, transformation. The role requires 2+ years of experience with Spark, Java/Scala, Hive, and AWS EMR.

You will participate in planning, design, development and testing of large-scale initiatives and coordinate with global teams, contributing to the platform that handles content transformation and enrichment.

Qualifications

• At least 2+ years’ experience in Big Data projects involved in content ingestion, curation, transformation
• Technical Skill: Spark, Java, Scala, Hive, SQL, AWS EMR, S3, SQS, Hive
• Education: Bachelor's degree in computer science, mechanical engineering, or related degree or at least 4 years of equivalent relevant experience

Responsibilities

• Active role in planning, estimation, design, development and testing of large-scale, enterprise-wide initiatives to build or enhance a platform or custom applications that will be used for the acquisition, transformation, entity extraction, mining of content on behalf of business units across Clarivate Analytics
• Troubleshooting and addressing production issues within the given SLA
• Coordination with global representatives and teams

Skills

Spark

Java

Scala

Hive

SQL

AWS EMR

S3

SQS

XSLT

Databricks

Education

Bachelor's degree in Computer Science

Tools

Databricks

Job description

Clarivate Analytics is seeking a Software Engineer for its IMS Team in Bangalore to work on Big Data technologies involved in content ingestion, curation, transformation. The role requires 2+ years of experience with Spark, Java/Scala, Hive, and AWS EMR.

You will participate in planning, design, development and testing of large-scale initiatives and coordinate with global teams, contributing to the platform that handles content transformation and enrichment.