ML Engineer II

UST; Bengaluru; On-site; INR 1,500,000 - 2,400,000; Full time

Job summary

UST in Bengaluru invites a Cloud Data Engineer with hands-on data engineering, cloud tech, Python, Spark, SQL, and AWS. You will design scalable data pipelines and cloud-based data solutions, with exposure to Generative AI, LLMs, RAG, FastAPI, and REST APIs.

You'll work on Big Data, Snowflake, and data warehousing, collaborating with engineers and data scientists to deliver end-to-end solutions in an agile environment. Knowledge of containerization and CI/CD is a plus.

Qualifications

• 3+ years of professional Data Engineering with cloud focus.
• Strong Python, Spark, SQL, and big data tech experience.
• Design and develop scalable data pipelines and architectures.
• Hands-on AWS cloud experience and data warehousing with Snowflake.
• Experience with REST APIs and microservices in Python.
• Proficient in Unix/Linux, scripting, and data processing.
• English communication skills.

Responsibilities

• Design, develop, and maintain scalable data architectures on cloud platforms.
• Build and optimize big data pipelines for ingestion, transformation, and delivery.
• Develop data pipelines using Python, Spark, SQL, and related tech.
• Integrate Snowflake for data warehousing and analytics.
• Develop REST APIs and microservices with FastAPI or Flask.
• Collaborate with data scientists and stakeholders; support SDLC.

Skills

Python

Spark

SQL

ETL/ELT

Data Pipelines

AWS

Snowflake

REST APIs

FastAPI/Flask

Unix/Linux

Big Data

GenAI/LLMs

Problem Solving

Education

Bachelor's degree in CS/IT/Engineering

Cloud Certifications (AWS/Azure/GCP)

Tools

Snowflake

Jupyter Notebook

IntelliJ

Anaconda

Flask

FastAPI

AWS Console

Kubernetes

Job description

Role Description

Who we are We help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at UST.com.

Summary

UST is looking for a Cloud Data Engineer with strong experience in Data Engineering, Cloud Technologies, Python, Spark, SQL, and AWS. The ideal candidate will have hands-on experience designing and developing scalable data pipelines and cloud-based data solutions, along with exposure to Generative AI, Agentic AI, LLMs, RAG, FastAPI, and REST APIs. The candidate should have strong programming skills and experience working with Big Data technologies, cloud platforms, databases, APIs, and microservices.

What you need

Required Skills

• 3+ years of professional experience in Data Engineering with a strong focus on Cloud Technologies.
• Strong hands-on experience with Python, Spark, Scala, SQL, and Big Data technologies.
• Experience designing and developing scalable data pipelines and data architectures.
• Hands-on experience with AWS Cloud and cloud computing fundamentals.
• Strong experience with Apache Spark and Big Data processing.
• Experience with Snowflake and Data Warehouse concepts.
• Strong programming expertise in Python / Scala / Java.
• Experience with Python Flask / FastAPI for backend development and API services.
• Hands-on experience developing REST APIs and microservices.
• Good understanding of SQL and NoSQL databases.
• Experience with Unix/Linux environments and scripting.
• Strong understanding of Data Engineering fundamentals, ETL/ELT, data pipelines, and data processing.
• Hands-on experience with development environments such as Jupyter Notebook, IntelliJ, and Anaconda.
• Strong testing, validation, debugging, and problem-solving skills.
• Good written and verbal communication skills in English.

Desired Skills

• Exposure to Generative AI (GenAI), Large Language Models (LLMs), Agentic AI, and Retrieval-Augmented Generation (RAG).
• Experience integrating LLM/GenAI capabilities with data engineering platforms and applications.
• Experience with FastAPI for AI/ML and microservice-based applications.
• Knowledge of AI/ML data pipelines and data preparation workflows.
• Experience with additional cloud platforms such as Azure or GCP.
• Knowledge of cloud-native data engineering services and architectures.
• Experience with containerization, CI/CD, and DevOps practices.
• Additional certifications or programs in AWS, Azure, or GCP are preferred.

Qualification

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• B.E./B.Tech in Computer Science, IT, Engineering, or equivalent qualification preferred.
• Additional certifications/programs in Cloud Technologies (AWS/Azure/GCP) are an advantage.

Key Roles & Responsibilities

• Design, develop, implement, and maintain scalable data architectures and data solutions on cloud platforms.
• Build, maintain, and optimize Big Data Engineering pipelines for data ingestion, transformation, processing, and delivery.
• Perform hands-on development, programming, testing, and validation of data engineering pipelines.
• Develop scalable data pipelines using Python, Scala, Spark, SQL, and other Big Data technologies.
• Implement cloud-based data engineering solutions using AWS and other cloud technologies.
• Work with Snowflake for data warehousing, data processing, and analytics requirements.
• Design and optimize data workflows to ensure scalability, reliability, performance, and data quality.
• Work with SQL and NoSQL databases for data storage, processing, and integration.
• Develop and integrate REST APIs and microservices using Python frameworks such as FastAPI or Flask.
• Apply data engineering best practices for data ingestion, transformation, validation, reconciliation, and error handling.
• Work with Unix/Linux environments and scripting as required for data engineering activities.
• Leverage Jupyter Notebook, IntelliJ, and Anaconda environments for development, testing, and data analysis.
• Support implementation and integration of Generative AI, LLM, Agentic AI, and RAG capabilities within data engineering solutions.
• Develop or integrate AI-enabled services and APIs using Python and FastAPI.
• Collaborate with data scientists, AI/ML engineers, application developers, and business stakeholders to deliver end-to-end solutions.
• Participate in code reviews, testing, debugging, performance optimization, and production support.
• Follow Agile/SDLC processes, coding standards, documentation practices, and engineering best practices.
• Stay current with emerging cloud, Big Data, AI/ML, and data engineering technologies.

Cloud Data Engineering | Python | Spark | Scala | Java | AWS | Snowflake | SQL | NoSQL | Big Data | Data Pipelines | Data Architecture | ETL/ELT | FastAPI | Flask | REST APIs | Microservices | Unix/Linux | Data Warehousing | Generative AI | GenAI | LLM | Agentic AI | RAG | Jupyter Notebook | IntelliJ | Anaconda | Cloud Computing

What we believe

UST values Humility, Humanity, and Integrity. We believe in creating an environment where people can collaborate, innovate, learn, and deliver meaningful impact for our clients and communities.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We are committed to providing equal employment opportunities to all qualified individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other legally protected status. We believe diversity and inclusion strengthen our organization and enable us to deliver better outcomes for our clients.

Skills

Agentic AI, LLMs, Generative AI, Python, FastAPI, RAG, Cloud Infrastructure, Scala, Data Engineering, AWS