Lead I - Data Engineering

UST; Hyderabad; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

UST is seeking a Senior .NET Developer to build modern enterprise apps using .NET technologies and AWS services. The role emphasizes technical leadership and hands-on cloud development.

You will work with Java, Spark, Python, Scala, and big data tools to integrate data sources, design scalable data replication, and own features from development to production. Strong OO design and communication skills are essential.

Qualifications

• BS degree in CS/CE or equivalent.
• 5–6 years delivering enterprise software.
• Proficient in Java, Spark, Scala, Python, Azure Cloud.
• 3+ years with Hadoop/Spark stack (Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala).
• Flair for data, schema, data model, how to bring efficiency in big data related life cycle.
• Must be able to quickly understand technical and business requirements and can translate them into technical implementations.
• Experience with Agile Development methodologies.
• Experience with data ingestion and transformation.
• Solid understanding of secure application development methodologies.
• Experience with Airflow will be preferred.
• Understanding of automated QA needs related to Big data.
• Strong object-oriented design and analysis skills.
• Excellent written and verbal communication skills.

Responsibilities

• Utilize your software engineering skills including Java, Spark, Python, Scala to analyse disparate, complex systems and collaboratively design new products and services.
• Integrate new data sources and tools.
• Implement scalable and reliable distributed data replication strategies.
• Ability to mentor and provide direction in architecture and design to onsite/offshore developers.
• Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases.
• Perform analysis of large data sets using components from the Hadoop ecosystem.
• Own product features from the development, testing through to production deployment.
• Evaluate big data technologies and prototype solutions to improve our data processing architecture.
• Automate everything.

Skills

Java

Python

Scala

Spark

Azure Cloud

Agile Development

OO Design

Education

BS degree in CS/CE or equivalent

Tools

Hadoop

MapReduce

HDFS

HBase

Hive

Flume

Sqoop

Kafka

Airflow

Azure Cloud Services

Job description

Who we are: At UST, we help the world's best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact - touching billions of lives in the process. Visit us at UST.com.

Role Description

Who we are: At UST, we help the world's best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact - touching billions of lives in the process. Visit us at UST.com.

Summary

We are looking for a Senior .NET Developer with extensive experience in developing modern enterprise applications using .NET technologies and AWS cloud services. The candidate should possess strong technical leadership capabilities and hands-on cloud development expertise.

Key Responsibilities

• Utilize your software engineering skills including Java, Spark, Python, Scala to Analyse disparate, complex systems and collaboratively design new products and services
• Integrate new data sources and tools
• Implement scalable and reliable distributed data replication strategies
• Ability to mentor and provide direction in architecture and design to onsite/offshore developers
• Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases
• Perform analysis of large data sets using components from the Hadoop ecosystem
• Own product features from the development, testing through to production deployment
• Evaluate big data technologies and prototype solutions to improve our data processing architecture
• Automate everything

Required Qualifications

• BS degree in computer science, computer engineering or equivalent
• 5 - 6 years of experience delivering enterprise software solutions
• Proficient in Java, Spark, Scala, Python, Azure Cloud technologies
• 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala
• Flair for data, schema, data model, how to bring efficiency in big data related life cycle
• Must be able to quickly understand technical and business requirements and can translate them into technical implementations
• Experience with Agile Development methodologies
• Experience with data ingestion and transformation
• Solid understanding of secure application development methodologies
• Experience with Airflow will be preferred
• Understanding of automated QA needs related to Big data
• Strong object-oriented design and analysis skills
• Excellent written and verbal communication skills

What We Believe

We're proud to embrace the same values that have shaped UST since the beginning. Since day one, we've been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity

Through business, we will better the lives of those less fortunate than ourselves.

Integrity

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

• To support and promote the values of UST.
• Comply with all Company policies and procedures

Skills

Agile, Apache Flume, Apache Airflow, Apache HBase, Apache Hive, Apache Kafka, Design Patterns, Data Modeling, Application Security, Apache Sqoop, Apache Spark