Sr Technical Lead – AWS Cloud Engineering
Location – Hyderabad/Bangalore
Job Description
- 10+ years of experience in Data Engineering / Big Data / Cloud Data Platforms
- 5+ years of hands‑on experience with Databricks
- Strong expertise in PySpark / Scala
- Experience with Delta Lake and Lakehouse Architecture
- 5+ years of experience with Azure ADLS Gen2
- RBAC, ACLs, hierarchical namespace
- 4+ years of experience in AWS Glue
- Glue ETL Jobs, Workflows, Crawlers, Glue Data Catalog
- 3+ years of experience designing data ingestion and transformation pipelines using Spark-based frameworks
- Lead design and development of scalable data platforms and pipelines
- Architect Lakehouse solutions using Databricks, Delta Lake, and Medallion architecture
- Build and optimize Spark-based ETL/ELT pipelines using PySpark/Scala and AWS Glue
- Integrate and manage data across ADLS Gen2 and S3 with proper governance and security
- Ensure data quality, performance tuning, and cost optimization
- Implement IAM, RBAC, and access control for secure data operations
- Establish coding standards, conduct code reviews, and mentor team members
- Collaborate with stakeholders to translate business requirements into technical solutions
- Work with DevOps teams to enable CI/CD and smooth deployments
Key Skills
AWS, Databricks, Azure, AWS Glue, Pyspark, S3, ADLsGen2, Lamda.