Data Engineer

Pipeline AI

Bengaluru

On-site

INR 900,000 - 1,500,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Pipeline AI in Bengaluru is seeking a Data Engineer to design, develop, and maintain data pipelines and infrastructure. You will collect, transform, and store large datasets from diverse sources to enable analytics and informed decision-making.

The role requires strong coding skills (Python, SQL, Java) and hands-on experience with Spark, Hadoop, and cloud platforms (AWS/Azure/GCP), plus data warehousing and ETL/ELT expertise.

Qualifications

  • BE/B.Tech in Computer Science, IT, or related fields.
  • B.Sc./M.Sc. in Computer Science or relevant qualifications.
  • Strong programming skills in Python, SQL, and Java.

Responsibilities

  • Design and maintain data pipelines.
  • Collect, clean, and transform large datasets.
  • Develop and manage databases and data warehouses.
  • Work with structured and unstructured data.
  • Ensure data quality, accuracy, and security.
  • Optimize data processing and storage systems.
  • Collaborate with data scientists, analysts, and software developers.

Skills

Python
SQL
Java
Data pipelines

Education

BE/B.Tech CS
BSc/MSc CS

Tools

Apache Spark
Hadoop
ETL/ELT
AWS
Azure
GCP
Snowflake
Databricks
BigQuery

Job description

Job Description A Data Engineer is responsible for designing, developing, building, and maintaining data pipelines and data infrastructure. They collect, process, transform, and store large amounts of data from different sources to make it available for analysis and business decision-making.

Key Responsibilities:
  • Design and maintain data pipelines.
  • Collect, clean, and transform large datasets.
  • Develop and manage databases and data warehouses.
  • Work with structured and unstructured data.
  • Ensure data quality, accuracy, and security.
  • Optimize data processing and storage systems.
  • Collaborate with data scientists, analysts, and software developers.
Required Skills:
  • Python, SQL, and Java.
  • Apache Spark and Hadoop.
  • ETL/ELT processes.
  • AWS, Microsoft Azure, or Google Cloud.
  • Snowflake, Databricks, or BigQuery.
  • Database management and data warehousing.
Educational Qualification:
  • B.E./B.Tech in Computer Science, IT, or related fields.
  • B.Sc./M.Sc. in Computer Science or relevant qualifications.
Job Category:
  • Information Technology (IT)
  • Software Development
  • Data Engineering & Analytics
  • Big Data & Cloud Computing
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Coltigent Technology Services Pvt Ltd • Pune District

On-site
INR 800,000 - 1,200,000
Data Engineer
Data Engineer

Imagevision • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Bdreamz Global Solutions • Chennai

Hybrid
INR 1,200,000 - 2,200,000
Data Engineer
Data Engineer

Wenger & Watson • Nagpur District

On-site
INR 900,000 - 1,500,000
Data Engineer
Data Engineer

Cloneifypro • Coimbatore

On-site
INR 600,000 - 900,000
Data Engineer
Data Engineer

DataPhi • Pune District

On-site
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Impronics Technologies • Bengaluru

On-site
INR 700,000 - 1,200,000
Competitive compensation and benefits package
Opportunities for professional growth
Collaborative and innovative work environment
Data Engineer
Data Engineer

Mployee.me • Bengaluru

On-site
INR 1,800,000 - 2,800,000
Data Engineer
Data Engineer

TEKSALT Solutions • Dadri

On-site
INR 800,000 - 1,200,000
Data Engineer
Data Engineer

Appsierra Group • Maharashtra

On-site
INR 1,200,000 - 2,100,000