Data Engineer

Citi; Maharashtra; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Citi in Maharashtra, India is seeking an Applications Development Intermediate Programmer Analyst to contribute to new and revised application systems, coordinating with the Technology team to deliver robust software solutions.

The role emphasizes Python/Scala development, Big Data tooling, real-time data processing with Kafka, and adherence to SDLC practices. You will optimize performance, collaborate with global teams, and translate requirements into scalable designs.

Qualifications

• 4+ years of experience with Python or Scala in Big Data projects.
• Experience with Hadoop ecosystem: HDFS, MapReduce, YARN, Spark, Hive.
• Experience with data formats: Avro, Parquet, CSV, JSON.
• Strong SDLC knowledge including unit testing.
• Unix/Linux experience and shell scripting.
• SQL and database fundamentals.
• Experience in real-time data processing with Kafka.
• Agile/Scrum experience.
• GIT and JIRA familiarity.
• Experience with NoSQL databases.
• Build tools like Maven and CI like Jenkins/TeamCity.
• Cloud and container technologies familiarity.
• Experience real time data processing - Kafka.

Responsibilities

• Translate storyboards and use cases into functional applications.
• Design, build, and maintain efficient, reusable, and reliable Python/Scala code.
• Ensure the best possible performance, quality, and responsiveness of the applications.
• Identify bottlenecks and bugs, and devise solutions to these problems.
• Develop high performance & low latency components to run Spark clusters.
• Interpreting functional requirements into design approaches those can be served through Big Data platform.
• Collaborate and partner with Global Teams based across different locations.
• Be able to propose best practices and standards.
• Perform the testing of software prototypes and transfer to the operational team.
• Processing of data using Hive, Impala & HBASE.
• Performing analysis of large data sets and derive insights.

Skills

Python/Scala

Big Data analytics

UNIX/Linux

SQL

Real-time data processing

Spark/Hive

Problem solving

Agile/Scrum

Git/Jira

Tools

Git

Jira

Maven

Jenkins/TeamCity

Job description

• Experience real time data processing - Kafka.

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Strong experience with one or more programming languages (Python/Spark) with 4+ years of experience.

• Demonstrated analytical and problem-solving skills. Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain.


• Comfortable working with large data volumes and be able to demonstrate a firm understanding of logical data structures and analysis techniques.


• Experience in Big data technologies like HDFS, Map Reduce, YARN, Apache Spark, Hive.


• Familiarity with data formats like Avro, Parquet, CSV, JSON.


• Strong systems analysis, design and architecture fundamentals, Unit Testing and other SDLC activities.


• Understanding fundamental design principles behind a scalable application.


• Experience in working with UNIX/LINUX and shell scripting.


• Good knowledge of database principles, practices with SQL.


• Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. Good to Have:


• Agile/Scrum methodology experience is required.


• Experience in SCMs like GIT and tools like JIRA.


• Experience in No SQL databases.


• Familiarity with build tools such as Maven and continuous integration like Jenkins/Team City.


• Familiarity with cloud and container technologies.


• Experience real time data processing - Kafka.

Responsibilities

• Translate application storyboards and use cases into functional applications.


• Design, build, and maintain efficient, reusable, and reliable Python/Scala code.


• Ensure the best possible performance, quality, and responsiveness of the applications.


• Identify bottlenecks and bugs, and devise solutions to these problems.


• Develop high performance & low latency components to run Spark clusters.


• Interpreting functional requirements into design approaches those can be served through Big Data platform.


• Collaborate and partner with Global Teams based across different locations.


• Be able to propose best practices and standards.


• Perform the testing of software prototypes and transfer to the operational team.


• Processing of data using Hive, Impala & HBASE.


• Performing analysis of large data sets and derive insights.

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Job Family Group

Job Family

Time Type

Most Relevant Skills

Please see the requirements listed above.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, nationality, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.