Senior ETL Developer & AVP — Data Lake & Risk

2755 Barclays Services Corpor; Hanover Township (NJ); Hybrid; USD 189,592 - 195,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

401(k)

Life insurance

Paid leave

Job summary

Barclays in Whippany, NJ seeks a Sr. ETL Developer, Assistant Vice President to design, develop and operate ETL analytics platforms using Python, Spark, Hadoop, and AbInitio. You will create data maps, lead a small team, and partner with business users to onboard data for Market Risk platforms.

The role requires strong coding, testing practices, and mentoring skills, with optional telecommuting. Salary aligns with Barcays standards and includes comprehensive benefits.

Qualifications

• Experience with Python, Apache Spark, Hadoop ecosystem, AbInitio products, SQL, Hive, Pig, and data pipeline development.
• Knowledge of Kafka and messaging queues.
• Ability to lead and mentor junior developers.
• Strong communication and analytical skills.
• Experience in risk or financial domain (e.g., Market Risk) beneficial.
• Secure coding and unit testing practices required.

Responsibilities

• Design, develop and operate a data lake platform using Python, Apache Spark, Hadoop, Sqoop, Hive, Pig, and SQL to build ETL analytics, data quality and risk control components.
• Create high-level design documents and exhaustive data maps to translate requirements to AbInitio Graph or Plan.
• Partner with business users, analysts and technology teams to comprehend data onboarding requirements for loading data into Market Risk Strategic Platforms.
• Develop AbInitio Graph, Plan and Unix shell scripts.
• Support system integration testing, user acceptance testing, and troubleshoot various problems during project development life cycles.
• Utilize knowledge of AbInitio products (Continuous Flow, Express It, Query It, Metadata Hub, Control Center) and concepts of Hadoop, Kafka, and messaging queues.
• Engage with users, explain existing functionality, and offer solutions.
• Manage a team of three junior and mid-level software developers.
• May telecommute.

Skills

Python

Apache Spark

Hadoop

SQL

Hive

Pig

Kafka

Data pipelines

Mentoring juniors

Communication skills

Analytical skills

Tools

AbInitio

Unix shell scripting

Job description

Barclays in Whippany, NJ seeks a Sr. ETL Developer, Assistant Vice President to design, develop and operate ETL analytics platforms using Python, Spark, Hadoop, and AbInitio. You will create data maps, lead a small team, and partner with business users to onboard data for Market Risk platforms.

The role requires strong coding, testing practices, and mentoring skills, with optional telecommuting. Salary aligns with Barcays standards and includes comprehensive benefits.