Data Engineer

Nisum; Hyderabad; Hybrid; INR 2,400,000 - 3,600,000; Full time

Benefits offered by this job

Continuous Learning

Certifications

Parental Medical Insurance

Team building activities

Free meals

Job summary

Nisum in Hyderabad is seeking a Data Engineer with 6-9 years of ETL and data engineering experience to join our team in Hitech City. You will develop scalable data pipelines, build API integrations, and collaborate with analytics to improve data models.

This role combines individual contribution with leadership of the data team, focusing on data governance, Azure data services, and end-to-end data solutions.

Qualifications

• Bachelor's degree in computer science, information systems, engineering, or related fields.

Responsibilities

• Develop and maintain scalable data pipelines and build out new API integrations to support data volume and complexity.
• Collaborate with analytics and business teams to improve data models feeding BI tools and enable data-driven decisions.
• Drive timely and quality solutions as part of the data team's delivery.
• Write unit/integration tests and maintain engineering documentation.
• Troubleshoot data-related issues and assist in resolution.
• Define data models and jobs (Spark, Spark SQL, Hive SQL) to populate data assets.
• Work with business units and engineering to design long-term data platform architecture.
• Design end-to-end data-oriented solutions using best practices and governance.

Job description

Position: Data Engineer
Experience: 6-9 Yrs
Location: Hitech City, Hyderabad
Work Mode: Work from Office / Hybrid

Job Description:

What you will do

• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity. Working as an individual contributor while leading the data team
• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organization.
• Drive the team to deliver solutions on time and quality that is committed.
• Write unit/integration tests, contribute to engineering wiki, and documents work.
• Performing data analysis requires to troubleshoot data-related issues and assist in the resolution of data issues.
• Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
• Work closely with all business units and engineering teams to develop a strategy for long-term data engineering platform architecture
• Design of data-oriented solutions (end to end) using design patterns and best market practices.
• Define and implement governance, access and security policies
• Ensure optimal use of resources both in cost and performance
• Ensure that non-functional requirements are taken care
• Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

What you know

• Required above 6 years of ETL and Data Engineering experience.
• Experience in senior data engineer roles, in the design of data-intensive solutions (streaming, batch, migrations)
• Experience in modern data ingestion processes (datalake, datawarehouse, lakehouse)
• Experience in data governance models
• Experience with relational SQL and NoSQL databases.
• Experience with Azure cloud Data services
• More than 4 years of experience in Data Engineering & ETL Tools (like Teradata, Ab Initio) and Azure
• Data Engineer with Azure functions and Azure Data Factory, Databricks and PySpark
• Experience with object-oriented/object function scripting languages: Python, Scala, etc.
• Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.

Education:

Bachelors degree in computer science, Information Systems, Engineering, Computer Applications, or related fields.

Benefits:

• Continuous Learning - Year-round training sessions are offered as part of skill enhancement
• Certifications sponsored by the company on an as-need basis. We support our team to excel in their field.
• Parental Medical Insurance - Nisum believes our team is the heart of our business, and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
• Activities -From the Nisum Premier League&39;s cricket tournaments to host Hack-a-thon, Nisum employees can participate in a variety of team building activities such as skits, dance performances in addition to festival celebrations.
• Free Meals and dinner is provided daily, in addition to subsidized lunch.