Data Engineer

1203 Barclays Global Serv. Cent; Pune District; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

1203 Barclays Global Serv. Cent is seeking a Data Engineer based in Pune to enable data-driven decision making through advanced analytics and data insights. Candidates should have hands-on experience with PySpark and AWS technologies.

The role includes designing data pipelines, creating interactive dashboards, and leading a team to produce actionable business recommendations. This position demands collaboration with stakeholders and strong analytical skills.

Qualifications

• Hands-on experience in PySpark with strong knowledge of DataFrames and SparkSQL.
• Strong knowledge of AWS Data Analytics technology stack: Glue, S3, Lambda, Lake Formation, and Athena.
• Ability to engage with stakeholders and translate requirements into ETL components.

Responsibilities

• Design and create interactive dashboards and visual reports, and automate reporting processes.
• Investigate and analyse data quality, lineage, controls and source identification issues.
• Lead a team of complex tasks and set performance objectives.

Skills

PySpark

AWS Cloud

SQL

Data Governance

Snowflake

Tools

Apache Airflow

DBT

Ab Initio ETL

Job description

Job Description

To enable data‑driven strategic and operational decision making through extracting actionable insights from large datasets, performing statistical and advanced analytics to uncover trends and patterns, and presenting findings through clear visualisations and reports.

Accountabilities

• Investigate and analyse data issues related to quality, lineage, controls and authoritative source identification, documenting data sources, methodologies and quality findings with recommendations for improvement.
• Design and build data pipelines to automate data movement and processing.
• Apply advanced analytical techniques to large datasets to uncover trends and correlations, develop validated logical data models and translate insights into actionable business recommendations that drive operational and process improvements, leveraging machine learning and AI.
• Design and create interactive dashboards and visual reports using applicable tools, and automate reporting processes for regular and ad‑hoc stakeholder needs.
• Lead a team performing complex tasks, using well‑developed professional knowledge and skills to deliver on work that impacts the whole business function.
• Consult on complex issues; provide advice to People Leaders to support the resolution of escalated issues.
• Identify ways to mitigate risk and develop new policies and procedures in support of the control and governance agenda.
• Take ownership for managing risk and strengthening controls in relation to the work performed.
• Collaborate with other areas of work to keep up to speed with business activity and the business strategy.
• Engage in complex analysis of data from multiple sources, both internal and external, to solve problems creatively and effectively, and communicate complex information to stakeholders.

Assistant Vice President Expectations

• Advise and influence decision making, contribute to policy development and take responsibility for operational effectiveness.
• Collaborate closely with other functions and business divisions.
• Set objectives and coach employees in pursuit of those objectives, appraise performance relative to objectives, and determine reward outcomes.
• Demonstrate clear leadership behaviours: Listen and be authentic, Energise and inspire, Align across the enterprise, Develop others.

Data Engineer – Responsibilities

• Design and build data pipelines to automate data movement and processing.
• Investigate and analyse data quality, lineage, controls and source identification issues.
• Apply advanced analytical techniques to large datasets to uncover trends, correlations and actionable business recommendations.
• Design and create interactive dashboards and visual reports, and automate reporting processes for regular and ad‑hoc stakeholder needs.
• Lead a team of complex tasks, coach employees and set performance objectives.
• Consult on complex issues, provide advice to People Leaders and support resolution of escalated issues.
• Identify ways to mitigate risk, develop new policies and procedures, and strengthen controls.

Data Engineer – Technical Qualifications

• Hands‑on experience in PySpark with strong knowledge of DataFrames, RDDs and SparkSQL.
• Experience developing, testing and maintaining applications on AWS Cloud.
• Strong knowledge of AWS Data Analytics technology stack: Glue, S3, Lambda, Lake Formation and Athena.
• Design and implement scalable, efficient data transformation and storage solutions using Snowflake.
• Experience ingesting data into Snowflake from formats such as Parquet, Iceberg, JSON and CSV.
• Experience using DBT with Snowflake for ELT pipeline development.
• Proficient in writing advanced SQL and PL/SQL programs.
• Experience building reusable components using Snowflake and AWS tools and technology.
• Completed at least two major project implementations.
• Exposure to data governance or lineage tools such as Immuta and Alation is an added advantage.
• Experience with orchestration tools such as Apache Airflow or Snowflake Tasks is an added advantage.
• Knowledge of Ab Initio ETL tool is a plus.
• Ability to engage with stakeholders, elicit requirements, and translate them into ETL components.
• Good knowledge of Data Marts and Data Warehousing concepts.
• Strong analytical and interpersonal skills.

Location

The role is based out of Pune.