Remote Big Data Architect: Spark, Databricks & AWS

Mogi I/O : OTT/Podcast/Short Video Apps for you; United States; Remote; USD 150,000 - 200,000; Full time

Benefits offered by this job

Bonus based on performance

Job summary

A global consulting and technology services organization is looking for a Big Data / Spark Principal Architect to lead the design and implementation of large-scale data systems. This role requires deep expertise in Spark and consulting within the Media & Entertainment domain. The successful candidate will architect data pipelines and guide technical teams. Compensation is between USD 150,000 and 200,000, based on experience and performance. This position is remote and full-time.

Qualifications

• 10–18 years of experience in Big Data Architecture, Engineering, and Consulting.
• Strong hands-on expertise in Apache Spark and Databricks.
• Proven track record in solutioning and consulting as an SME in Big Data.

Responsibilities

• Define and implement scalable big data architectures using Spark and Databricks.
• Lead solution design engagements acting as SME for big data technologies.
• Build and optimize batch and streaming data pipelines leveraging Spark.

Skills

Apache Spark (DataFrame, SQL, PySpark/Scala Spark)

Databricks

AWS Glue

Kafka

ETL design

Data governance

Streaming technologies

Job description

A global consulting and technology services organization is looking for a Big Data / Spark Principal Architect to lead the design and implementation of large-scale data systems. This role requires deep expertise in Spark and consulting within the Media & Entertainment domain. The successful candidate will architect data pipelines and guide technical teams. Compensation is between USD 150,000 and 200,000, based on experience and performance. This position is remote and full-time.