SENIOR SOFTWARE ENGINEER - Python

Happiest Minds Technologies; Dadri; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

Happiest Minds Technologies in Bengaluru is seeking a highly skilled Data Engineer with 8+ years of experience to design and maintain scalable data pipelines and architectures. You will work with data scientists and analysts to ensure reliable data for analysis and reporting.

The role requires expertise in Python, SQL, ETL, data warehousing, and cloud platforms (AWS/Azure/GCP). Familiarity with Hadoop or Spark and data visualization tools is a plus.

Qualifications

• 8+ years of experience in data engineering or related roles.
• Proficiency in Python for data manipulation and pipeline development.
• Strong SQL skills and experience with relational databases.
• Hands-on ETL, data warehousing, and data modeling knowledge.
• Familiarity with Hadoop, Spark or similar big data frameworks.
• Experience with cloud platforms (AWS, Azure or GCP).

Responsibilities

• Design, develop, and maintain robust data pipelines for ingestion, transformation, and storage.
• Collaborate with data scientists and analysts to meet data requirements.
• Implement data models and architectures supporting BI and analytics.
• Optimize data processing workflows for performance and scale.
• Monitor, troubleshoot, and ensure data quality and integrity.
• Document data engineering processes and best practices.
• Stay updated with industry trends and new technologies.

Skills

Python

SQL

ETL

Data Warehousing

Hadoop

Spark

AWS

Azure

GCP

Education

Bachelor's degree in Computer Science/Engineering

Tools

Tableau

Power BI

MongoDB

Cassandra

Docker

Kubernetes

Job description

Location: SMILES 1-Bengaluru-Bengaluru, CUSTOMER-Bengaluru-Bengaluru

Years of Experience: 8+ years

Job Summary: We are seeking a highly skilled Data Engineer with over 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on building and maintaining scalable data pipelines and architectures. You will work closely with data scientists and analysts to ensure the availability and reliability of data for analysis and reporting.

Responsibilities:

• Design, develop, and maintain robust data pipelines to support data ingestion, transformation, and storage.
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
• Implement data models and architectures that support business intelligence and analytics initiatives.
• Optimize data processing workflows for performance and scalability.
• Monitor and troubleshoot data pipeline issues, ensuring data quality and integrity.
• Document data engineering processes and maintain best practices for data management.
• Stay updated with industry trends and emerging technologies in data engineering.

Mandatory Skills:

• Proficiency in Python for data manipulation and pipeline development.
• Strong experience with SQL and relational databases.
• Hands-on experience with data warehousing solutions and ETL processes.
• Familiarity with big data technologies such as Hadoop, Spark, or similar frameworks.
• Experience with cloud platforms (AWS, Azure, or Google Cloud) for data storage and processing.

Preferred Skills:

• Knowledge of data visualization tools (Tableau, Power BI, etc.).
• Experience with NoSQL databases (MongoDB, Cassandra, etc.).
• Understanding of machine learning concepts and frameworks.
• Familiarity with containerization technologies (Docker, Kubernetes).

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 8+ years of experience in data engineering or related roles.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.