Specialist - Business Intelligence

Gus Education (India) Llp; India; On-site; INR 2,000,000 - 3,200,000; Full time

Benefits offered by this job

Comprehensive medical insurance

Night shift allowance

Company cab facility

Generous leave policy (45 days/year)

Job summary

GUS Education India (GEI) is seeking a Data Engineer to join the Data Platform Team. The role focuses on building, maintaining, and optimizing data pipelines and infrastructure within the AWS cloud, leveraging Redshift, Athena, and Step Functions to enable a unified view of business data.

You'll transform raw data with Python and SQL, ingest into data warehouses and data lakes, and collaborate with data scientists, software engineers, and analysts to support decision-making and product

Qualifications

• Bachelor's degree in a related field
• At least 3 years of experience in a similar role
• Experience in higher education or a related domain is preferred

Responsibilities

• Design and implement data pipelines using AWS Redshift, Athena, and Step Functions
• Transform and ingest data from multiple sources using Python and SQL
• Collaborate with data scientists, analysts, and engineers across the company
• Develop and maintain infrastructure as code to ensure scalable cloud infrastructure

Skills

Communication

Teamwork

Problem solving

Multitasking

Education

Bachelor's degree in a related field

Tools

JIRA

Job description

• GUS Education India (GEI) is the education arm of Global University Systems, a leading Global Education conglomerate. Established in 2017, GEI boasts a portfolio of over 35 Institutions and collaborates with prestigious universities and institutions worldwide, offering educational services that enhance their operations and impact.

Nature of the Job

• AWS Data Engineer role is highly technical, focusing on building, maintaining, and optimizing data pipelines and infrastructure within the AWS cloud environment.
• it involves leveraging AWS technologies to ensure smooth data processing and infrastructure management, requiring problem-solving and analytical skills, as well as collaboration across teams.

JOBPURPOSE

Data Engineers work as part of the Data Platform Team, collaborating closely with data scientists, software engineers, and analysts across the company. They assist in building and maintaining the tooling and infrastructure that support decision-making processes and enable product enhancements by ensuring a reliable and unified view of business data. Under the guidance of senior team members, they help prioritize tasks to ensure key features are developed in the proper sequence. They also contribute to the balance between supporting the immediate needs of strategic teams and Data Analysts while participating in the ongoing development of the company's data infrastructure.

Our tech stack consists of a core ETL process written in Python and SQL, which is being managed by AWS Services like Redshift, Athena, Step Functions, CloudFormation (Infrastructure as Code - IaC) having provided data from multiple sources like salesforce, application logs, and other operational data sources. We use v ersion control as GIT and CI/CD pipelines with AWS Code commit, Code pipeline and code build.

PRINCIPAL RESPONSIBILITIES

RESPONSIBILITIES

ACTIONS

This Data Engineer supports our Senior Data Engineers and will be responsible for utilizing expertise and knowledge of AWS services to transform raw data and ingest it into data warehouses and data lakes. You will work closely with the development team and would be responsible for providing quality code.
Reading data from multiple sources, transform and ingest data into Redshift using Python and SQL Working with different business units to understand requirements and collaborating with them to deliver data pipelines Design, develop, and execute data analysis plans using AWS services like Amazon Redshift and Amazon Athena Maintaining and creating new data pipelines using AWS Step functions Build and maintain infrastructure as code (IaC) in the cloud that is resilient and can scale when needed.

Above all, we are looking for people who are curious, think critically, are eager to learn and keen to use their experience to help and support others. You will need to be able to communicate and explain things clearly and work well in a collaborative environment as well as autonomously.

KRA’s

KPI’s

Data Pipeline Development and Maintenance

• Design, build, and maintain efficient data pipelines using AWS services such as AWS Glue, Lambda, and Step Functions.
• Ensure scalability, reliability, and efficiency of pipelines to support large datasets.
• % of successful data pipeline executions vs. failures.
• Uptime percentage for critical data pipelines.

Data Processing Time

• Average time taken to process data from ingestion to loading into the final storage.
• Latency for real-time data pipelines.

Automation Coverage

• % of data engineering tasks that are automated (e.g., pipeline monitoring, scaling).
• Reduction in manual intervention for routine tasks.

ETL/ELT Processes

• Implement Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) processes using AWS Glue, Athena, or Redshift.

Data Availability

• Time taken to make new data available for consumption (batch processing time, real-time data latency).
• Frequency of data availability to business users.

Automation and Optimization

• Automate routine data engineering tasks, such as data pipeline monitoring and alerting.
• Optimize resource utilization to reduce costs on AWS infrastructure.

Data Security Compliance

• % compliance with data security standards (e.g., encryption, access policies).
• Number of security incidents or breaches related to data pipelines.

Monitoring and Troubleshooting

• Ensure monitoring, logging, and debugging of data pipelines using AWS CloudWatch, AWS X-Ray, or third-party tools.
• Manage incidents and outages, ensuring quick recovery.

Stakeholder Satisfaction

• Feedback from business users, analysts, and other stakeholders on data delivery and quality.
• Turnaround time for addressing data-related issues or requests.

The Key Result Areas (KRAs) and Key Performance Indicators (KPIs)should be assessed biannually to ensure that the person carrying out the job is consistent performance aligned with Potential challenges in measuring performance due to complexities in organizational processes that hinder target achievement need to be considered.

DESIREDPROFILE

QUALIFICATION

• Bachelor's degree in a related field
• At least 3 years of experience in a similar role.
• Experience in higher education or a related domain is preferred

SKILLS

• Strong interpersonal and communication skills
• Ability to work independently and as part of a team
• Strong problem-solving and decision-making skills
• Proficient in Product/Project life cycle management tools like JIRA
• Ability to multitask and meet the work deadlines

RELEVANTEXPERIENCE

4+ years of relevant experience

OTHER

• Thisroleisafull-timepositionwithcompetitivesalaryandbenefitspackage.
• There is an expectation that employee will maintain the values ofthe Group and will comply with the code of conduct as well asequalityanddiversity,healthandsafetyandsafeguardingpolicies.

BENEFITS

• AtGUSEducationIndia,GEIwewantemployeestofeelcomfortable,bringingtheirpassion,creativity, and individuality to work. We truly believe that diverse culture, backgrounds, andexperiencesdriveinnovation.
• The company offers comprehensive medical insurance to its employees, which includehospitalization,accidentalinsurance,terminsurance andGratuity,whichisoverandabovethecompensation. Considering that this role is for night shift, we provide additional competitivenightshiftallowanceforalldays worked.
• Tomakethedailycommuteeasier,safe,andlessstressful,companyprovidescabfacilitiestoits employees to and from the workplace within the Greater Hyderabad Municipal Corporationlimits.
• Companyacknowledgesthe importance ofmentalandphysicalwell-being and theneed forrest and relaxation. Work days are Monday to Friday and a comprehensive leave package foret employeewell-beingis offered,which include10daysofmedicalleave,6daysofcasualleave,18 days of earned leave, 1 day of Happiness Leave, apart from 10 days of statutory leave,totalling to45days’timeoffin ayear.