Data Engineer

Alignity Solutions; Hyderabad; Hybrid; INR 1,200,000 - 2,500,000; Full time

Job summary

Alignity Solutions in Hyderabad, India invites an experienced Senior Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions in a hybrid, contract-to-hire role. You will work with AWS data services, Python, and SQL to ingest, transform, and analyze large datasets, ensuring data quality and secure handling for business intelligence.

Collaborate with BI developers to deliver analytics-ready datasets and semantic models while supporting modern data warehousing

Qualifications

• Experience designing, developing and maintaining scalable data pipelines.
• Strong Python programming and SQL skills.
• Exposure to AWS data services and data engineering patterns.
• Knowledge of data quality controls and security best practices.

Responsibilities

• Design, develop, test, and maintain scalable batch and event-driven data pipelines.
• Build end-to-end ETL/ELT workflows using Python, SQL, and AWS data services.
• Develop reusable Python components for data ingestion, transformation, validation, reconciliation, and automation.
• Write and optimize complex SQL queries, stored procedures, views, functions, and data-transformation logic.
• Integrate data from databases, APIs, enterprise applications, flat files, and cloud storage.
• Work with datasets in CSV, JSON, XML, Parquet, and Excel formats.
• Collaborate with BI developers to deliver analytics-ready datasets and semantic models.

Skills

Python

OOP

Java

Pandas

PySpark

Boto3

SQLAlchemy

Tools

Amazon S3

AWS Glue

AWS Lambda

AWS Step Functions

Amazon Redshift

Amazon RDS

AWS IAM

Job description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a Data Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long-term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Work Mode: Hybrid

Type: Contract to Hire

Notice Period:Immediate Joiners

Requirements

Job Description – Senior Data Engineer

Role Summary

We are looking for an experienced and hands-on Data Engineer to design,develop, and maintain scalable data pipelines and analytics solutions. Thesuccessful candidate will have strong programming capabilities in Python,advanced SQL expertise, and practical experience working with AWS-based dataengineering services. The role involves integrating data from multiple structured and unstructuredsources, transforming and organizing large datasets, implementing data-qualitycontrols, and preparing reliable data layers for analytics, reporting, andbusiness intelligence solutions.

Key Responsibilities

• Design, develop, test, and maintain scalable batch andevent-driven data pipelines.
• Build end-to-end ETL/ELT workflows using Python, SQL, andAWS data services.
• Develop reusable Python components for data ingestion,transformation, validation, reconciliation, and automation.
• Write and optimize complex SQL queries, stored procedures,views, functions, and data-transformation logic.
• Integrate data from databases, APIs, enterpriseapplications, flat files, and cloud-based file systems.
• Work with file-based datasets in formats such as CSV, JSON,XML, Parquet, and Excel.
• Query and analyse data stored in databases.
• Work with relational databases hosted on Amazon RDS, AzureSynapse, including Microsoft SQL Server or PostgreSQL.
• Implement incremental data loads, change-data-capturepatterns, error-handling mechanisms, restartability, and audit controls.
• Perform data validation, reconciliation, profiling,cleansing, and quality monitoring.
• Apply appropriate security controls, including IAM-basedaccess, encryption, logging, and secure handling of sensitive data.
• Collaborate with Power BI or Tableau developers to deliveranalytics-ready datasets and semantic models.

Mandatory Technical Skills

Programming

• Strong hands-on programming experience in Python.
• Good understanding of object-oriented programming, modulardevelopment, exception handling, logging, and reusable coding practices.
• Prior exposure to another programming language, preferablyJava, is desirable.
• Experience using Python libraries for data processing anddatabase integration, such as Pandas, PySpark, Boto3, SQLAlchemy, or equivalentlibraries.

SQL and Databases

• Strong proficiency in writing and optimizing advanced SQLqueries.
• Sound knowledge of relational database concepts,normalization, denormalization, indexing, and database performance.
• Hands-on experience with Complex joins and subqueries, Windowand analytical functions, Stored procedures, functions, and views, Query-performanceoptimization & Dimensional and relational data modelling
• Hands-on experience with several of the following services:

• Amazon S3
• AWS Glue
• AWS Lambda
• AWS Step Functions
• Amazon Redshift
• Amazon RDS
• AWS IAM

Preferred Skills

• Hands-on experience or working knowledge of Microsoft Azuredata services, including:
• Microsoft Fabric
• Exposure to business intelligence and reporting tools,particularly Microsoft Power BI or Tableau