Data Engineer (AWS)

Objectways; Bengaluru; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Objectways in Bengaluru is seeking a highly skilled Data Engineer with strong AWS cloud expertise to design, build, and maintain scalable data pipelines and platforms. You will work with large-scale datasets and cloud-based data solutions.

Responsibilities include ETL/ELT development, data lakes and warehouses, data governance, and collaborating with analysts and data scientists to deliver reliable data products for analytics and reporting.

Qualifications

• 4+ years of experience in Data Engineering.
• Proficiency in SQL and data modeling concepts.
• Strong programming skills in Python or PySpark.
• Experience building and managing ETL/ELT pipelines.
• Hands-on experience with big data technologies such as Spark, Hadoop, or Databricks.
• Experience with workflow orchestration tools such as Apache Airflow.
• Strong understanding of data warehousing and data lake architectures.
• Experience with version control systems such as Git.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• AWS Certification (Data Engineer / Solutions Architect) preferred.
• Experience with Snowflake, Databricks, Kafka/Kinesis, CI/CD, DevOps, Agile/Scrum is a plus.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Build and optimize data solutions on AWS cloud platforms.
• Develop and manage data lakes and data warehouses for analytics and reporting.
• Integrate data from multiple sources, ensuring data quality, consistency, and reliability.
• Implement data modeling, transformation, and validation processes.
• Optimize data processing jobs for performance, scalability, and cost efficiency.
• Collaborate with business stakeholders, analysts, and data scientists to understand data requirements.
• Monitor, troubleshoot, and resolve data pipeline and infrastructure issues.
• Ensure data governance, security, and compliance standards are followed.
• Create and maintain technical documentation for data architecture and processes.

Skills

SQL & Data Modeling

Python / PySpark

ETL / ELT pipelines

Big data technologies

Airflow

Git

Data warehousing concepts

Education

Bachelor's degree in CS/IT/Engineering

Tools

AWS (S3, Glue, Redshift, EMR, Lambda, Athena, IAM, RDS)

Snowflake / Databricks / Kafka / Kinesis

Job description

We are looking for a highly skilled Data Engineer with strong AWS cloud expertise to design, build, and maintain scalable data pipelines and data platforms. The ideal candidate will have experience working with large-scale datasets, cloud-based data solutions, ETL/ELT processes, and modern data engineering technologies.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Build and optimize data solutions on AWS cloud platforms.
• Develop and manage data lakes and data warehouses for analytics and reporting.
• Integrate data from multiple sources, ensuring data quality, consistency, and reliability.
• Implement data modeling, transformation, and validation processes.
• Optimize data processing jobs for performance, scalability, and cost efficiency.
• Collaborate with business stakeholders, analysts, and data scientists to understand data requirements.
• Monitor, troubleshoot, and resolve data pipeline and infrastructure issues.
• Ensure data governance, security, and compliance standards are followed.
• Create and maintain technical documentation for data architecture and processes.

Required Skills & Qualifications

• 4+ years of experience in Data Engineering.
• Strong hands-on experience with AWS services such as S3, Glue, Redshift, EMR, Lambda, Athena, IAM, and RDS.
• Proficiency in SQL and data modeling concepts.
• Strong programming skills in Python or PySpark.
• Experience building and managing ETL/ELT pipelines.
• Hands-on experience with big data technologies such as Spark, Hadoop, or Databricks.
• Experience with workflow orchestration tools such as Apache Airflow.
• Strong understanding of data warehousing and data lake architectures.
• Experience with version control systems such as Git.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field

Preferred Qualifications

• AWS Certified Data Engineer, Solutions Architect, or related AWS certification.
• Experience with Snowflake, Databricks, or similar cloud data platforms.
• Knowledge of real-time data processing frameworks such as Kafka or Kinesis.
• Experience working with CI/CD pipelines and DevOps practices.
• Exposure to machine learning data pipelines and analytics platforms.
• Experience working in Agile/Scrum environments.