Data Engineering and Cloud

Robert Bosch Group; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Robert Bosch Group's Bosch Global Software Technologies in Bengaluru is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines for autonomous driving research.

You will work with Python, Spark, Hadoop, Kafka, and Airflow, applying data warehousing and lake concepts, and collaborate with data scientists and engineers while mentoring junior team members in a cloud-centric environment.

Qualifications

• Strong proficiency in Python or another programming language used in data engineering.
• Expertise in data engineering tools and frameworks such as Spark, Hadoop, Kafka, and Airflow.
• Deep understanding of data warehousing and data lake concepts.
• Experience with cloud platforms (Azure) and cloud-based data services.
• Knowledge of SQL and NoSQL databases.
• Excellent problem-solving and analytical skills.
• Ability to work independently and as part of a cross-functional team.
• Strong communication and documentation skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines and infrastructure to support autonomous driving R&D.
• Extract, transform, and load data from various sources including sensors, simulations, and databases.
• Collaborate with data scientists, researchers, and engineers to translate data requirements into technical solutions.
• Develop and optimize data storage and retrieval strategies, ensuring data quality and integrity.
• Implement data governance and security measures to protect sensitive data.
• Monitor and troubleshoot data pipelines and systems to resolve issues promptly.
• Continuously explore and evaluate new data technologies and tools to improve processing efficiency and scalability.
• Mentor and guide junior data engineers in their professional development.

Skills

Python

SQL/NoSQL

Problem solving

Communication

Independent

Team collaboration

Education

Master's degree in Computer Science or related field

Ph.D. (nice to have)

Tools

Apache Spark

Hadoop

Kafka

Airflow

Azure

Job description

• Legal Entity: Bosch Global Software Technologies Private Limited

Company Description

Bosch Global Software Technologies Private Limitedis a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 28,200+ associates, it’s the largest software development center of Bosch, outside Germany, indicating that it is the Technology Powerhouse of Bosch in India with a global footprint and presence in the US, Europe and the Asia Pacific region.

Job Description

Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines and infrastructure to support autonomous driving research and development.
• Extract, transform, and load (ETL) data from various sources, including sensors, simulations, and databases.
• Collaborate with data scientists, researchers, and engineers to understand data requirements and translate them into technical solutions.
• Develop and optimize data storage and retrieval strategies, ensuring data quality and integrity.
• Implement data governance and security measures to protect sensitive data.
• Monitor and troubleshoot data pipelines and systems to identify and resolve issues promptly.
• Continuously explore and evaluate new data technologies and tools to improve data processing efficiency and scalability.
• Mentor and guide junior data engineers in their professional development.

Mandatory Core Skills & Competencies:

• Strong proficiency in Python or another programming language commonly used in data engineering.
• Expertise in data engineering tools and frameworks, such as Apache Spark, Hadoop, Kafka, and Airflow.
• Deep understanding of data warehousing and data lake concepts.
• Experience with cloud platform (Azure) and cloud-based data services.
• Knowledge of SQL and NoSQL databases.
• Excellent problem-solving and analytical skills.
• Ability to work independently and as part of a cross-functional team.
• Strong communication and documentation skills.

Nice to Have Skills:

• Experience with machine learning and deep learning frameworks (TensorFlow, PyTorch).
• Familiarity with autonomous driving technologies and concepts.
• Knowledge of data visualization tools (e.g., Tableau, Matplotlib).
• Experience with real-time data processing and streaming technologies.
• Understanding of data quality and validation techniques.
• Experience with containerization technologies (Docker, Kubernetes).
• Familiarity with CI/CD pipelines and DevOps practices.
• Experience with data governance and compliance frameworks (e.g., GDPR, CCPA).
• Ph.D. or Master's degree in Computer Science, Data Engineering, or a related field.
• Publications in relevant conferences or journals.

Qualifications

Additional Information

6+ years