Data Engineer III-Amazon Web Services

Deloitte Development LLC; Bengaluru; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Deloitte Development LLC seeks a Data Engineer III to design, develop, and deploy enterprise-scale data solutions. Lead robust data pipelines, manage deployments, and mentor junior engineers across global teams.

You will drive architecture, deliverables, and metrics throughout the project lifecycle in a Cloud-first environment. You will collaborate with analysts and engineers to translate business needs into scalable data platforms, leveraging AWS services and modern DevOps practices, while

Qualifications

• 6-10 years of technology consulting experience.
• 3+ years of experience in Cloud Operations.
• Strong knowledge of AWS services (lambda, GLUE, S3, Redshift, SNS, SQS).
• Strong Python scripting and SQL skills.
• Experience with CI/CD/DevOps is a plus.
• Proven experience with agile methodologies in Cloud projects.
• Ability to translate requirements into technical design.
• End-to-end project delivery experience with Cloud projects.
• Strong UNIX and shell scripting knowledge.
• Experience with ML/NLP, clustering and analytics.
• Design and deploy cloud-based applications.

Responsibilities

• Lead discussions with analysts to understand requirements and assess integration impacts.
• Prepare technical architecture and design, clarify requirements and resolve ambiguities.
• Develop solutions in line with designs, standards and templates.
• Create and enforce design templates, guides and standards.
• Facilitate daily scrum, manage deliverables, and prepare status reports.
• Mentor team members and provide technical guidance.
• Collaborate with onsite clients and cross-functional teams.
• Design scripts or templates to automate routine tasks.

Skills

Cloud Operations

Python scripting

SQL

CI/CD

AWS

Unix

Data pipelines

Cloud architecture

Agile

Education

BE/B.Tech/MCA/MSc

Tools

Snowflake

Lambda

S3

Redshift

Job description

Artificial Intelligence & Engineering

AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations.

Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You’ll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical to businesses.

Position Summary

Data Engineer III

As a Data Engineer III at Deloitte Consulting, you will design, develop, and deploy enterprise-scale software solutions, lead the creation of robust pipelines and manage code deployment across environments. You will collaborate with cross-functional, global teams to translate functional requirements into effective deliverables, independently guiding and mentoring junior team members. Your role spans the full project lifecycle, including estimation, planning, execution, and tracking key metrics for analysis, ensuring high-quality and timely delivery of solutions.

Work you’ll do:

Lead discussions with business and functional analysts to understand requirements and assess integration impacts on business architecture. Prepare technical architecture and design, clarify requirements, and resolve ambiguities. Develop solutions in line with established technical designs, integration standards, and quality processes. Create and enforce technical design and development guides, templates, and standards. Facilitate daily scrum meetings, manage deliverables, and prepare weekly status reports for leadership review. Conduct detailed deliverable reviews and provide technical guidance to team members. Collaborate with onsite clients, coordinators, analysts, and cross-functional teams. Design templates or scripts to automate routine development or operational tasks.

The team:

AI & Data offers a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offering helps clients innovate, and enhance their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.

AI & Data professionals will work with our clients to:

• Design and modernize large-scale data and analytics platforms including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud, edge and AI/ML technologies, platforms and methodologies for storage, processing
• Leverage automation, cognitive and AI based solutions to manage data, predict scenarios and prescribe actions
• Drive operational efficiency by managing and upgrading their data ecosystems and application platforms, utilizing analytics expertise and providing As-a-Service models to ensure continuous insights and enhancements.

Qualifications

Required Skills/Project Experience/Certifications:

• 6-10 Years of technology Consulting experience
• A minimum of 3 Years of experience in Cloud Operations
• High degree of knowledge using AWS services like lambda, GLUE, S3, Redshift, SNS, SQS and more.
• Strong scripting experience with python and ability to write SQL queries and string analytical skills.
• Experience working on CICD/DevOps is nice to have.
• Proven experience with agile/iterative methodologies implementing Cloud projects.
• Ability to translate business requirements and technical requirements into technical design.
• Good knowledge of end to end project delivery methodology implementing Cloud projects.
• Strong UNIX operating system concepts and shell scripting knowledge
• Experience with algorithm development, including statistical and probabilistic analysis, clustering, recommendation systems, natural language processing, and performance analysis.
• Planning, designing and developing cloud-based applications
• Work in tandem with engineering team to identify and implement the most optimal cloud-based solutions
• Design and deploy enterprise-wide scalable operations on Cloud Platforms
• Deploy and debug cloud applications in accordance with best practices throughout the development lifecycle
• Provides administration for cloud deployments and assures the environments are appropriately configured and maintained.
• Monitors the environment stability and responds to any issues or service requests for the environment.
• Educate teams on the implementation of new cloud-based initiatives, providing associated training as required
• Exceptional problem-solving skills, with the ability to see and solve issues
• Building and designing web services in the cloud, along with implementing the set-up of geographically redundant services.
• Orchestrating and automating cloud-based platforms
• Continuously monitor the system effectiveness and performance and identify the areas for improvement, collaborating with key stakeholders
• Provide guidance and coaching to the team members as required and also contribute to documenting cloud operations playbook and providing thought leadership in development automation, CI/CD
• Involve in providing insights for optimization of cloud computing costs

Preferred Skills/Project Experience/Certifications:

• Good knowledge of cloud computing technologies and current computing trends.
• Effective communication skills (written and verbal) to properly articulate complicated cloud reports to management and other IT development partners.
• Ability to operate independently with clear focus on schedule and outcomes.
• Exposure to data migration from on-premise data warehouse to the Snowflake Cloud Platform.

Education:

• BE/B.Tech/M.C.A./M.Sc degree or equivalent from accredited university

#AI&DATAROLESSEPTEMBER29

#AIE2027