Senior Software Engineer

Adobe Inc.; California, San Jose (MO, CA); On-site; USD 170,000 - 320,000; Full time

Job summary

An established industry player is seeking a seasoned engineer to tackle complex challenges in data ingestion and management. This role involves collaborating with a talented team to build high-performance data pipelines and storage solutions that handle petabytes of customer profile data. You'll leverage cutting-edge technologies and methodologies to design resilient systems while adapting to evolving priorities. If you thrive in a dynamic environment and are passionate about creating impactful solutions, this opportunity is perfect for you.

Qualifications

• 15+ years of industry experience preferred.
• Strong programming skills in Java or Scala.
• Experience building resilient data pipelines at scale.

Responsibilities

• Collaborate on high-performance data ingestion pipelines.
• Design and implement components for petabyte data.
• Deploy and improve production services based on feedback.

Skills

Distributed processing systems

Data Lake cloud storages

Java

Scala

Data pipelines

Excellent communication

Education

M.S. in Computer Science

Tools

Apache Spark

Hadoop Stack

Apache Kafka

Azure Data Lake Storage

AWS S3

Apache Parquet

Databricks Delta

Apache Iceberg

Apache Hudi

NoSQL databases

Job description

Our Company

Changing the world through digital experiences is what Adobe's all about. We give everyone-from emerging artists to global brands-everything they need to design and deliver exceptional digital experiences! We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.

We're on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!

The Opportunity

Adobe Experience Platform (AEP) enables businesses to deliver the right experience at the right time to their customers. The Profile Stores layer is one of the key AEP services built as a multi-cloud multi-tenant service to support 1000s of customers, providing the ability to manage a high volume data pipeline and storage layer for real-time customer profiles.

Customer profiles are built on complex data models spanning both record structures supporting upserts at scale as well as timeseries analytics event like data that is ingested at very high volumes. With the need to support to support 1000s of customers ingesting and storing PBs of data, resiliency, data correctness, scalability and efficiency are paramount. This is a great opportunity for engineers to solve extremely interesting challenges of scale and build core services that are used by all Adobe Digital Experience solutions. As part of building these services, you will work with an exceptionally talented and collaborative team, tackle complex data challenges and build highly performant services on various open-source technologies.

***This role is senior in scope and is best suited for candidates with 15+ years of industry background.

What you'll Do

• Collaborate with a team of engineers & product managers in building high-performance data ingestion pipelines and data store to serve the use cases of Segmentation and Activation.
• Own responsibility for design and implementation of key components of ingesting and maintaining petabyte of Profile data
• Develop systems to support high volume data ingestion pipelines handling both streaming and batch processing.
• Leverage popular file and table formats to design storage models to support the required ingestion volumes and data access patterns.
• Explore tradeoffs across different formats and schema layouts driven by workload and application characteristics
• Deploy production services and iteratively improve them based on customer feedback
• Follow Agile methodologies using industry leading CI/CD pipelines
• Participate in architecture, design & code reviews

What you need to succeed

• M.S. in Computer Science or a related field or equivalent experiences required
• Experience with Distributed processing systems like Apache Spark, Hadoop Stack, or Apache Kafka;
• Experience with Data Lake cloud storages like Azure Data Lake Storage or AWS (Amazon Web Services) S3
• Understanding of file formats like Apache Parquet and table formats such as Databricks Delta, Apache Iceberg or Apache Hudi is preferred.
• Understanding of NoSQL databaseslike Apache HBase, Cassandra, Mongo, or Azure Cosmos DB is a plus;
• Practical experience in building resilient data pipelines at scale is preferred
• Strong programming skills with extensive experience in Java or Scala
• Leadership skills to collaborate and drive cross-team efforts
• Excellent communication skills
• Adaptable to evolving priorities, accepting challenges outside one's comfort zone,
  learning new technologies, and delivering viable solutions within defined time
  boundaries.
• Ability to think through solutions from a short term and long-term lens in an iterative development cycle.

Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this positionis $170,500 -- $320,000 annually. Paywithin this range varies by work locationand may also depend on job-related knowledge, skills,and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.

At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).

In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.

State-Specific Notices:

California:

Fair Chance Ordinances

Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and "fair chance" ordinances.

Colorado:

Application Window Notice

There is no deadline to apply to this job posting because Adobe accepts applications for this role on an ongoing basis. The posting will remain open based on hiring needs and position availability.

Massachusetts:

Massachusetts Legal Notice

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Adobe is proud to be anEqual Employment Opportunityemployer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law.Learn more.

Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, [e-mail] call [phone].