AI/ML Data Engineer

Hewlett Packard Enterprise Development LP; Bengaluru; Hybrid; INR 2,400,000 - 4,000,000; Full time

Job summary

Hewlett Packard Enterprise Development LP in Bengaluru offers an AI/ML Data Engineer role in a hybrid setup, blending office days with remote work. You will build and optimize data pipelines and a Feature Store to enable scalable data solutions across the organization.

The role requires 5+ years in data analysis and engineering, a relevant bachelor's degree, and hands-on experience with API/stream data extraction and web crawling, Python, SQL, and AWS/Snowflake ecosystems.

Qualifications

• 5+ years of data analysis and engineering experience.
• Bachelor’s degree in CS, Statistics, Informatics, Information Systems or another quantitative field.
• Experience with API or Stream-based data extraction and web crawling.

Responsibilities

• Develop, maintain, and optimize data pipelines and Feature Store to ensure seamless data ingestion and transformation as a scalable data solution.
• Design, develop, implement, and architect Data Engineering pipelines, considering performance & scalability including data storage and processing.
• Implement advanced data transformations and quality checks to ensure data accuracy, completeness, security and consistency of data.
• Seamlessly integrate data from diverse sources, for data ingestion, transformation and storage, leveraging AWS S3 Storage and possibly Snowflake as a SQL Data Warehouse.
• Create and implement advanced data models and schemas and ensure data governance and data management best practices.

Skills

Data analysis

Data engineering

Web crawling

Python

SQL

Pyspark

API integration

Education

Bachelor’s degree in CS/Statistics/ Informatics or related field

Tools

Snowflake

AWS S3

AWS Glue

AWS EMR

Kafka

Spark

Databricks

Job description

AI/ML Data Engineer

This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office.

Who We Are:

Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today’s complex world. Our culture thrives on finding new and better ways to accelerate what’s next. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE.

Job Description:

At HPE Networking, the Digital Experience & Automation (DEA) team is reimagining how people experience support and services in a digital-first world - setting new standards for the future of networking. We enable customers, partners, and employees through AI-driven tools and modern platforms, transforming support into a unified, efficient, and simple experience that drives measurable value. Our mission is grounded in innovation with purpose: applying automation, AI, and data-driven insights to simplify journeys, reduce friction, and create meaningful outcomes at every touchpoint. DEA’s charter is to discover, evaluate, and scale solutions that embed intelligent technology into every interaction - delivering proactive and predictive experiences that shorten resolution times and accelerate task completion. By modernizing processes and accelerating self-service, we help shift support from reactive to truly anticipatory. We partner closely with technology providers, engineering, and business teams to deliver seamless omnichannel experiences and enable business transformation through data engineering, process optimization, and automation. Our work is fueled by a passion for self-service, intelligent automation, and building digital experiences that are intuitive, scalable, and human-centric.

What you’ll do:

Responsibilities:

• Develop, maintain, and optimize data pipelines and workflows and Feature Store to ensure seamless data ingestion and transformation as a scalable data solution.
• Design, develop, implement, and architect Data Engineering pipelines, considering performance & scalability including data storage and processing.
• Implement advanced data transformations and quality checks to ensure data accuracy, completeness, security and consistency of data.
• Seamlessly integrate data from diverse sources, for data ingestion, transformation and storage, leveraging AWS S3 Storage and possibly Snowflake as a SQL Data Warehouse.
• Create and implement advanced data models and schemas and ensure data governance and data management best practices.

What you need to bring:

Qualification and Desired Experiences:

• 5+ years of data analysis and engineering experience
• Bachelor’s degree in computer science, Statistics, Informatics, Information Systems or another quantitative field.
• Working knowledge of API or Stream-based data extraction processes like Salesforce API and Bulk API and have hands-on experience in web crawling.

Primary Tech skills:

• Advanced Web-crawling & scraping methods and tools
• Building end-end Data Engineering pipelines for Semi and unstructured data (Text, all kinds of simple/complex table structures, images, video and audio data)
• Python, Pyspark, SQL, RDBMS Data Transformation (ETL/ELT) activities
• SQL Data warehouse (e.g. Snowflake) working / preferably administration

Secondary Tech skills:

• Databricks
• Familiarity with AWS services : S3, Glue, EMR, EC2, RDS, monitoring and IAM
• Kafka, Spark & Kafka Streaming Workflow automation (e.g. using Github actions) Performing RCA

Personal Skills:

• Ability to collaborate cross-functionally and build sound working relationships within all levels of the organization
• Ability to handle sensitive information with keen attention to detail and accuracy. Passion for data handling ethics.
• Effective time management skills and ability to solve complex technical problems with creative solutions while anticipating stakeholder needs and helping meet or exceed expectations
• Comfortable with ambiguity and uncertainty of change when assessing needs for stakeholders
• Self-motivated and innovative; confident when working independently, but an excellent team player with a growth-oriented personality

Accessibility

HPE is committed to creating an inclusive and accessible workplace and encourages applications from all qualified individuals, including those with disabilities. If you believe you require accommodation during any stage of the application or interview process, please submit your request by completing our secure form linked here. Note: This option is reserved for applicants needing assistance/reasonable accommodation related to a disability.

What We Can Offer You:

Health & Wellbeing

We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.

Personal & Professional Development

We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have - whether you want to become a knowledge expert in your field or apply your skills to another division.

Unconditional Inclusion

We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.

Let's Stay Connected:

Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE. #india #networking

Job:

Engineering Job Level: TCP_03 HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT employer. We do not discriminate on the basis of race, gender, or any other protected category, and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together.

Equal Employment Opportunity. Hewlett Packard Enterprise is EEO Protected Veteran/ Individual with Disabilities. HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories.

Equal Employment Opportunity (EEO) Hewlett Packard Enterprise provides equal employment opportunity to any employee or applicant without regard to sex, gender, color, race, ethnicity, religion, creed, national origin, ancestry, citizenship, age, marital status, sexual orientation, gender identity and expression, physical or mental disability, medical condition, pregnancy, protected veteran status, uniformed service status, familial status, genetic information, political affiliation, or any other characteristic protected by federal, state, or local law. If you’d like more information about your EEO right as an applicant under the law, please click here: Know Your Rights.

Equal Opportunity Employer (EEO) Hewlett Packard Enterprise provides equal employment opportunity to any employee or applicant without regard to sex, gender, color, race, ethnicity, religion, creed, national origin, ancestry, citizenship, age, marital status, sexual orientation, gender identity and expression, physical or mental disability, medical condition, pregnancy, protected veteran status, uniformed service status, familial status, genetic information, political affiliation, or any other characteristic protected by federal, state, or local law.

Equal Employment Opportunity is the Law Equal Employment Opportunity is the Law - Supplement E-Verify (US & PR only) HPE is an E-Verify employer. E-Verify is an Internet-based system that compares information from an employee's Form I-9, Employment Eligibility Verification, to data from U.S. Department of Homeland Security and Social Security Administration records to confirm the employment eligibility of all newly hired employees. For more information click here.

Accessibility HPE is committed to creating an inclusive and accessible workplace and encourages applications from all qualified individuals, including those with disabilities. If you believe you require accommodation during any stage of the application or interview process, please submit your request by completing our secure form linked here. Note: This option is reserved for applicants needing assistance/reasonable accommodation related to a disability.

Disclosure of Sensitive Personal Data Please ensure the resume you submit to us does not include any sensitive personal data. Sensitive personal data includes data revealing information about your racial or ethnic origin, political opinions, religious or philosophical beliefs, trade union membership, health, sex life or sexual orientation. To the extent the resume you submit does contain this type of personal data, you consent to the storing and processing of this data by HPE for the purpose of reviewing and managing your application.