Data Engineer

HP

Bengaluru

On-site

INR 1,500,000 - 2,200,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

HP Bengaluru is seeking a Data Engineer to design and optimize data architectures and pipelines for machine learning and analytics. The role emphasizes data quality, governance, and performant data flows across primary and secondary data stores.

You will lead data engineering activities, collaborate with cross-functional teams, and mentor junior engineers while implementing scalable solutions using Hadoop, Spark, Kafka, and cloud platforms such as AWS/Azure.

Qualifications

  • Four-year or graduate degree in CS/IT/Software Eng or commensurate work experience.
  • Typically 4–7 years of work experience in data analytics/engineering.
  • Programming with SQL and Python; AI solutions experience preferred.

Responsibilities

  • Design secure and performant data architectures and pipelines.
  • Analyze design and determine coding, integration activities for data products.
  • Write and execute testing plans and debug data systems.
  • Lead a project team of data engineers to deliver high-quality solutions.
  • Collaborate with cross-functional teams and communicate progress.
  • Identify data inaccuracies and develop automated data quality improvements.
  • Research data issues and interpret trends in complex datasets.
  • Work with other departments to define report deliverables.
  • Represent data engineering in larger development projects.
  • Provide guidance and mentoring to staff.

Skills

Agile Methodology
AWS
Apache Hadoop
Apache Kafka
Apache Spark
Big Data
Data Analysis
Data Engineering
Data Modeling
Data Pipelines
Data Warehousing
ETL
Java
Machine Learning
Python
SQL
Scala
Azure

Education

Bachelor's degree in Computer Science / Information Technology / Software Engineering

Tools

Apache Hadoop
Apache Kafka
Apache Spark
AWS
Microsoft Azure

Job description

Data Engineer

Description
Job Summary

This role is responsible for data collection procedures, including accurate and relevant data for machine learning models, extracting and analyzing data from the primary and secondary database. The role ensures data integrity and compliance by performing data cleansing and data validations. The role performs root-cause analysis and recommends or executes corrective actions by implementing auto detect, auto dragonize and auto correct when data from related system problems occur. The role applies subject matter knowledge to solve complex business issues within established guidelines and recommends appropriate alternatives.

Responsibilities
  • Designs and establishes secure and performant data architectures, enhancements, updates, and programming changes for portions and subsystems of data pipelines, repositories or models for structured/unstructured data.
  • Analyzes design and determines coding, programming, and integration activities required based on general objectives and knowledge of overall architecture of product or solution.
  • Writes and executes complete testing plans, protocols, and documentation for assigned portion of data system or component; identifies and debugs, and creates solutions for issues with code and integration into data system architecture.
  • Leads a project team of other data engineers to develop reliable, cost effective and high-quality solutions for assigned data system, model, or component.
  • Collaborates and communicates with project team regarding project progress and issue resolution.
  • Analyzes data inaccuracies, identifies opportunities and supports the development of automated solutions to enhance overall quality of the enterprise data.
  • Identifies problematic areas and conducts research to determine the best course of action to correct the data; identifies, analyzes and interprets trends and patterns in complex datasets.
  • Works cross-functionally with different departments to assess, define, and develop report deliverables.
  • Represents the software data engineering team for all phases of larger and more-complex development projects.
  • Provides guidance and mentoring to less experienced staff members.
Education & Experience Recommended
  • Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, Statistics/ Mathematics, or any other related discipline or commensurate work experience or demonstrated competence.
  • Typically has 4-7 years of work experience, preferably in data analytics, data engineering, data modeling, or a related field or an advanced degree with 3-5 years of work experience.
Preferred Certifications
  • Programming Language/s Certification (SQL, Python, or similar) and experience in implementing AI solutions to solve complex data quality problems
Knowledge & Skills
  • Agile Methodology
  • Amazon Web Services
  • Apache Hadoop
  • Apache Kafka
  • Apache Spark
  • Big Data
  • Computer Science
  • Data Analysis
  • Data Engineering
  • Data Modeling
  • Data Pipelines
  • Data Warehousing
  • Extract Transform Load (ETL)
  • Java (Programming Language)
  • Machine Learning
  • Microsoft Azure
  • Python (Programming Language)
  • Scala (Programming Language)
  • Scalability
  • SQL (Programming Language)
Cross-Org Skills
  • Effective Communication
  • Results Orientation
  • Learning Agility
  • Digital Fluency
  • Customer Centricity
Impact & Scope
  • Impacts multiple teams and may act as a team or project leader providing direction to team activities and facilitates information validation and team decision making process.
Complexity
  • Responds to moderately complex issues within established guidelines.
Disclaimer
  • This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management.

Job -

Data & Information Technology

Schedule -

Full time

Shift -

No shift premium (India)

Relocation -

No

Equal Opportunity Employer (EEO) -

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

For more information, review HP's EEO Policy or read about your rights as an applicant under the law here: Know Your Rights: Workplace Discrimination is Illegal.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data and UI Engineer
Data and UI Engineer

HP • Mumbai

On-site
INR 3,500,000 - 5,500,000
Data Engineer
Data Engineer

HP • India

On-site
INR 1,200,000 - 2,000,000
Data Engineer
Data Engineer

HP Inc. • Bengaluru

On-site
INR 900,000 - 1,500,000
Data and UI Engineer
Data and UI Engineer

HP • Mumbai Suburban

On-site
INR 1,500,000 - 3,000,000
Senior Data Engineer
Senior Data Engineer

HP • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Data and UI Engineer
Data and UI Engineer

Hewlett Packard Co. • Mumbai

On-site
INR 600,000 - 1,000,000
Senior Data Engineer
Senior Data Engineer

HP • Bengaluru

On-site
INR 2,500,000 - 4,500,000
Senior Data Engineer
Senior Data Engineer

HP • India

On-site
INR 3,600,000 - 6,000,000
Data Engineer
Data Engineer

TalentD • Bengaluru

On-site
INR 600,000 - 900,000
Data Scientist - AI Developer
Data Scientist - AI Developer

Hp • Bengaluru

On-site
INR 2,400,000 - 3,600,000