Senior Data Engineer

Unisys; Hyderabad; On-site; INR 2,800,000 - 4,200,000; Full time

Job summary

Unisys is seeking a Senior Data Engineer to design, build, and maintain scalable data platforms and pipelines in a cloud-native environment. The role emphasizes Python, PySpark, AWS, DynamoDB, and OpenSearch, with exposure to Java to broaden capabilities.

You will own end-to-end data ingestion, modeling, and governance, collaborate with product teams, and mentor junior engineers. A strong background in large-scale data processing, data lake/ lakehouse concepts, and cost optimization is expected.

Qualifications

• Experience designing scalable data platforms and pipelines.
• Proficient in Python for data processing and PySpark workloads.
• Hands-on experience with AWS services (EMR, Glue, S3, Redshift).
• Experience with NoSQL databases, especially DynamoDB.
• Knowledge of OpenSearch/ Elasticsearch and search schemas.

Responsibilities

• Design, develop, and maintain large-scale data pipelines using Python and PySpark.
• Build and optimize batch and near real-time data processing solutions.
• Design scalable data architectures on AWS.
• Develop ETL/ELT workflows for ingesting and transforming datasets.
• Work with structured and semi-structured data from multiple sources.
• Design and maintain DynamoDB NoSQL databases.
• Implement OpenSearch for search and analytics.

Skills

Python

PySpark

AWS

DynamoDB

OpenSearch

Java

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Docker

Kubernetes

Airflow

Terraform

Databricks Delta Lake

Snowflake

Job description

What success looks like in this role:

We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data platforms and data processing pipelines. The ideal candidate will have strong expertise in Python, PySpark, AWS, DynamoDB, and OpenSearch, along with exposure to Java. This role requires hands-on experience building cloud-native big data solutions, optimizing large-scale data processing workloads, and enabling data-driven decision-making across the organization.

Key Responsibilities

• Design, develop, and maintain large-scale data pipelines using Python and PySpark.
• Build and optimize batch and near real-time data processing solutions.
• Design scalable data architectures on AWS.
• Develop ETL/ELT workflows for ingesting, transforming, and publishing datasets.
• Work with structured and semi-structured data from multiple sources.
• Design and maintain NoSQL database solutions using DynamoDB.
• Implement search and analytics solutions using OpenSearch.
• Optimize data processing jobs for performance, scalability, and cost efficiency.
• Collaborate with product teams, architects, and software engineers to define data requirements.
• Monitor, troubleshoot, and resolve data platform and pipeline issues.
• Implement data quality, governance, security, and observability best practices.
• Participate in code reviews and mentor junior engineers.

Required Technical Skills

Data Engineering

• Strong expertise in Python.
• Extensive experience with PySpark and distributed data processing.
• Hands-on experience building data lakes and modern data platforms.
• Strong understanding of ETL/ELT frameworks and data modeling.
• Experience processing large datasets efficiently.

AWS Cloud

• Expert-level knowledge of AWS services such as: EMR
• Glue
• Lambda
• S3
• Athena
• Redshift
• ECS/EKS
• Step Functions
• EventBridge
• IAM
• CloudWatch
• SNS/SQS

Databases

• Strong SQL skills and query optimization experience.
• Experience with NoSQL databases, particularly DynamoDB.
• Understanding of partitioning, indexing, and data access patterns.

Search & Analytics

• Hands-on experience with OpenSearch / Elasticsearch.
• Experience designing indexes and search schemas.
• Knowledge of query optimization and search performance tuning.
• Experience implementing analytics and monitoring dashboards.

Programming

• Strong Python development skills.
• Working knowledge of Java.
• Understanding of object-oriented programming and software engineering best practices.

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 8+ years of experience in Data Engineering.
• Experience with streaming platforms such as Kafka or Kinesis.
• Experience with Airflow or other workflow orchestration tools.
• Experience with Docker and Kubernetes.
• Exposure to Data Lake and Lakehouse architecture.
• Experience in Agile/Scrum development environments.
• Good to Have Apache Kafka.
• Apache Airflow.
• Terraform.
• Databricks Delta Lake.
• Snowflake.
• CI/CD pipelines.
• Machine Learning data pipelines.

Key Competencies

• Strong problem-solving and analytical skills.
• Ability to work in a fast-paced, cloud-native environment.
• Excellent communication and stakeholder management skills.
• Strong ownership and accountability mindset.
• Ability to mentor and guide team members.

You will be successful in this role if you have:

• BA/BS degree and 8-10 years’ relevant experience OR equivalent combination of education and experience.

Unisys is proud to be an equal opportunity employer that considers all qualified applicants without regard to age, blood type, caste, citizenship, color, disability, family medical history, family status, ethnicity, gender, gender expression, gender identity, genetic information, marital status, national origin, parental status, pregnancy, race, religion, sex, sexual orientation, transgender status, veteran status or any other category protected by law. Local employment practices and rights may vary by jurisdiction and are subject to applicable local laws. This commitment includes our efforts to provide for all those who seek to express interest in employment the opportunity to participate without barriers. U.S. job seekers can find more information about Unisys’ EEO commitment here.

Unisys is a global technology solutions company that powers breakthroughs for the world’s leading organizations. Our solutions – cloud, AI, digital workplace, logistics and enterprise computing – help our clients challenge the status quo and unlock their full potential. To learn how we have been helping clients push what’s possible for more than 150 years, visit unisys.com and follow us on LinkedIn.

Notice for U.S. Applicants: Unisys is an Equal Opportunity Employer – Minorities/ Females/ Veterans/ Individuals with Disabilities/ Sexual Orientation/ Gender Identity