Senior Software Design Engineer – Databricks and AWS

Winwire Technologies; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Winwire Technologies is seeking a Senior Software Design Engineer with expertise in Databricks and AWS for their Bengaluru office. The candidate should have 5 to 8 years of experience in Data Engineering, focusing on building efficient data pipelines and optimizing cloud resource utilization.

The role involves using Databricks and AWS Glue to manage data ingestion and transformation, ensuring performance and security. A strong background in Terraform/CloudFormation is preferred.

Qualifications

• 5+ years of experience in Data Engineering, Big Data, or Cloud Data Platforms.
• 4+ years hands-on experience with Databricks (PySpark/Scala, Delta Lake).
• 3+ years’ experience in AWS Glue and Athena.

Responsibilities

• Design data ingestion and transformation pipelines using Spark frameworks.
• Develop optimized Spark jobs with performance tuning.
• Integrate data from multiple sources into ADLS/S3.

Skills

Data Engineering

Databricks

AWS Glue

Tools

Terraform

CloudFormation

Job description

Senior Software Design Engineer – Databricks and AWS

Location: Hyderabad or Bangalore

Experience: 5 to 8 Years

Job Responsibilities

• 4+ years of experience in Data Engineering, Big Data, or Cloud Data Platforms
• 4+ years hands-on experience with Databricks (PySpark/Scala, Delta Lake, Lakehouse architecture)
• 4+ years’ experience with Databricks (RBAC, ACLs, hierarchical namespaces)
• 3+ years’ experience designing data ingestion and transformation pipelines using Spark-based frameworks.
• 3+ years’ experience in AWS Glue (Glue ETL jobs, Workflows, Crawlers, Glue Catalog).
• 3+ years’ experience in Athena, spark and python scripts.
• Develop optimized Spark jobs (PySpark/Scala) with strong performance tuning practices.
• Implement ETL/ELT pipelines using Databricks notebooks, Workflows, and Glue Jobs.
• Integrate data from multiple sources into ADLS / S3 with appropriate security and metadata management.
• Work with Terraform/CloudFormation for infrastructure automation (preferred).
• Monitor cloud resource utilization and optimize cost.

Key Skills

• Data Engineering, Big Data, or Cloud Data Platforms
• Databricks
• AWS Glue