AWS Engineer

Fractal; Bengaluru; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Fractal in Bengaluru is seeking a Data Engineer with 3–4 years of hands-on AWS Databricks experience. You will design and maintain scalable data pipelines, collaborating with data scientists and analysts to enable reporting and analytics on the AWS cloud.

You will optimize Spark workloads, implement Delta Lake, and contribute to CI/CD and data governance practices while working with diverse data sources and stakeholders.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 3–4 years of hands-on Data Engineering experience.
• Strong experience with AWS Databricks and PySpark for large-scale processing.
• Proficient in SQL for data processing and analytics.
• Experience with Delta Lake and lakehouse concepts.
• Familiar with AWS services: S3, RDS, Glue, Lambda, Redshift.
• Knowledge of batch and streaming architectures and CI/CD practices.
• Understanding of data governance, metadata management, and security.

Responsibilities

• Design, develop, test, and deploy scalable ETL/ELT pipelines with AWS Databricks, PySpark, and SQL.
• Build data pipelines ingesting data from S3, RDS, APIs, and external platforms.
• Implement Delta Lake solutions supporting batch and streaming data.
• Optimize Spark workloads for performance and cost efficiency.
• Ensure data quality and integrity with validations, monitoring, and reconciliation.
• Collaborate with data analysts, modelers, and stakeholders to enable reporting.
• Support orchestration with Airflow, Glue Workflows, or Step Functions.
• Participate in CI/CD using Git, CodePipeline, and CodeBuild.
• Apply data governance and security best practices.
• Assist production issue resolution and continuous platform improvement.

Skills

PySpark

SQL

Data pipelines

Data governance

Analytical skills

Communication skills

Cost optimization

Education

Bachelor's degree in CS/IS/Engineering

Tools

AWS Databricks

Delta Lake

S3

RDS

Glue

Lambda

Redshift

Airflow

Job description

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Job Description

Role Summary

We are looking for a highly motivated Data Engineer with 3–4 years of hands-on experience in AWS Databricks to join our data platform team. The role involves working closely with data scientists, analysts, architects, and business stakeholders to design, build, and maintain scalable, high-performance data pipelines and data solutions within the AWS cloud environment.

Key Responsibilities

• Design, develop, test, and deploy scalable ETL/ELT pipelines using AWS Databricks, PySpark, and SQL.
• Build and maintain robust data pipelines for ingesting and processing structured and unstructured data from multiple sources such as Amazon S3, Amazon RDS, APIs, and external platforms.
• Implement and manage Delta Lake solutions to support both batch and streaming data processing.
• Optimize Spark workloads for performance, scalability, and cost efficiency.
• Ensure data quality, consistency, reliability, and integrity through validations, monitoring, exception handling, and reconciliation checks.
• Collaborate with cross-functional teams including data analysts, data modelers, architects, and business stakeholders to support reporting, analytics, and downstream consumption.
• Support orchestration and scheduling of pipelines using tools such as AWS Glue Workflows, Apache Airflow, or AWS Step Functions.
• Participate in CI/CD implementation and code deployment processes using Git, AWS CodePipeline, and CodeBuild.
• Apply best practices related to data governance, metadata management, security, and access control.
• Support production issue resolution, ad hoc data requests, and continuous improvement of the data platform.

Required Skills And Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related discipline.
• 3–4 years of experience in Data Engineering or a similar role.
• Strong hands-on experience with AWS Databricks.
• Good proficiency in PySpark and SQL for large-scale data processing.
• Experience working with Delta Lake and modern lakehouse concepts.
• Familiarity with AWS services such as Amazon S3, Amazon RDS, AWS Glue, AWS Lambda, and Amazon Redshift.
• Knowledge of batch and streaming data architectures.
• Experience with workflow orchestration, monitoring, and debugging of pipelines.
• Understanding of version control and CI/CD practices.
• Awareness of data security, governance, and metadata management principles.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience in building data pipelines in enterprise-scale cloud data platforms.
• Familiarity with real-time / streaming frameworks and event-driven architectures.
• Exposure to data quality frameworks, reconciliation processes, and operational monitoring.
• Working knowledge of infrastructure automation and cloud deployment best practices.
• Experience collaborating in agile delivery environments.

Key Competencies

• Strong problem-solving orientation
• Attention to detail and focus on data quality
• Ability to work in a fast-paced, collaborative environment
• Good stakeholder communication and coordination skillsOwnership mindset with a focus on delivery excellence

Nice to Have

• Experience with data modeling and analytics enablement
• Exposure to DevOps and platform engineering practices
• Certification in AWS or Databricks technologies

Why Join Us

This role offers the opportunity to work at the forefront of cloud-based data engineering, partnering with talented data scientists, analysts, and architects to build scalable, high-impact data solutions on AWS Databricks. If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!