Data Engineer

Adobe; Bengaluru; On-site; INR 800,000 - 1,500,000; Full time

Job summary

Join a forward-thinking company as a Mid-Senior level Software Engineer, where you will leverage your expertise in Big Data and Cloud technologies to create custom solutions for a leading Experience Cloud platform. In this role, you will develop and deliver technology solutions, ensuring compliance with both functional and non-functional requirements. You will also maintain existing frameworks and work independently while participating in agile scrum events. This is an exciting opportunity to contribute to innovative projects and enhance your skills in a dynamic environment.

Qualifications

• 6+ years of software engineering experience focused on big data and cloud technologies.
• Proficiency in developing ETL pipelines and data processing applications.

Responsibilities

• Develop low level designs and technology deliverables as per specifications.
• Maintain and support existing solutions and frameworks.

Skills

ETL pipelines

PySpark

AWS

SQL

NoSQL databases

Python

ReST APIs

Kubernetes

Data Science

Machine Learning

Job description

Experienced software engineer utilizing Big Data & Cloud technologies to program for custom solutions for Adobe Experience Cloud customers and frameworks.

What you’ll do

1. Develop low level design as per approved Tech Specification or equivalent inputs provided.
2. Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs.
3. Build and deliver technology deliverables compliant with functional requirements.
4. Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability.
5. Process technology deliverables through full development lifecycle.
6. Maintain and support existing solutions and technology frameworks.
7. Attend regular scrum events of equivalent and provide updates.
8. Work independently with none or minimum supervision.

Requirements

1. 6+ years of professional software engineering mostly focused on the following:
2. Developing ETL pipelines involving big data.
3. Developing data processing/analytics applications primarily using PySpark.
4. Experience of developing applications on cloud (AWS) mostly using services related to storage, compute, ETL, DWH, Analytics, and streaming.
5. Clear understanding and ability to implement distributed storage, processing, and scalable applications.
6. Experience of working with SQL and NoSQL databases.
7. Ability to write and analyze SQL, HQL, and other query languages for NoSQL databases.
8. Proficiency in writing distributed & scalable data processing code using PySpark, Python, and related libraries.
9. Experience of developing applications that consume the services exposed as ReST APIs.

Special Consideration given for

1. Experience of working with Container-orchestration systems like Kubernetes.
2. Experience of working with any enterprise-grade ETL tools.
3. Experience & knowledge with Adobe Experience Cloud solutions.
4. Experience & knowledge with Web Analytics or Digital Marketing.
5. Experience & knowledge with Google Cloud platforms.
6. Experience & knowledge with Data Science, ML/AI, R, or Jupyter.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Software Development, IT System Custom Software Development, and IT Services and IT Consulting