Senior Software Engineer — Scalable Data Ingestion

Adobe Inc.; San Jose (CA); On-site; USD 170,500 - 320,000; Full time

Job summary

An established industry player is seeking a seasoned engineer to tackle complex challenges in data ingestion and management. This role involves collaborating with a talented team to build high-performance data pipelines and storage solutions that handle petabytes of customer profile data. You'll leverage cutting-edge technologies and methodologies to design resilient systems while adapting to evolving priorities. If you thrive in a dynamic environment and are passionate about creating impactful solutions, this opportunity is perfect for you.

Qualifications

• 15+ years of industry experience preferred.
• Strong programming skills in Java or Scala.
• Experience building resilient data pipelines at scale.

Responsibilities

• Collaborate on high-performance data ingestion pipelines.
• Design and implement components for petabyte data.
• Deploy and improve production services based on feedback.

Skills

Distributed processing systems

Data Lake cloud storages

Java

Scala

Data pipelines

Excellent communication

Education

M.S. in Computer Science

Tools

Apache Spark

Hadoop Stack

Apache Kafka

Azure Data Lake Storage

AWS S3

Apache Parquet

Databricks Delta

Apache Iceberg

Apache Hudi

NoSQL databases

Job description

An established industry player is seeking a seasoned engineer to tackle complex challenges in data ingestion and management. This role involves collaborating with a talented team to build high-performance data pipelines and storage solutions that handle petabytes of customer profile data. You'll leverage cutting-edge technologies and methodologies to design resilient systems while adapting to evolving priorities. If you thrive in a dynamic environment and are passionate about creating impactful solutions, this opportunity is perfect for you.