Software Engineer III - Data Engineering (PostgreSQL, Python, AWS)

United States Digital Space LLC; Maharashtra; Hybrid; INR 800,000 - 1,200,000; Full time

Job summary

United States Digital Space LLC is seeking a Software Engineer III - Data Engineer to build high-performance cloud-based data solutions. You will collaborate on research data platforms, supporting quantitative research capabilities with your strong SQL and Python expertise.

The ideal candidate will have a Bachelor's degree, 3+ years of software engineering experience, and familiarity with AWS technologies. Excellent communication skills and the ability to work in an Agile environment are also essential.

Qualifications

• 3+ years applied experience in software engineering.
• Expertise in SQL and AWS Cloud technologies.
• Strong experience in Python and data engineering.

Responsibilities

• Build cloud-based data solutions for quantitative research.
• Implement and oversee ETL and ELT processes.
• Collaborate with technical teams to design data solutions.

Skills

SQL

AWS Cloud services

Python

Pandas/Polars

Numpy

ETL processes

Agile Scrum

Database technologies

Airflow

Data Lakes

Spark

EMR

CI/CD tools

Education

Bachelor's degree in information systems, information technology, computer science, or similar

Tools

DuckDB

PostgreSQL

Jira

Linux

Docker

Job description

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III - Data Engineer at JPMorgan Chase within the Asset and Wealth Management Technology and 55ip team, your role involves taking part in building its research data platform. You are responsible in implementing effective large-scale data solutions in a cloud-based environment.

Job responsibilities

• Build high-performance cloud-based data solutions to support quantitative research capabilities: back testing, simulations, machine learning, and other advanced analytics & algorithms
• Implement, schedule, and oversee ETL, ELT, and monitoring processes
• Oversee the loading of data from vendor and internal data sources
• Implement and support automation solutions to improve platform scalability
• Monitor the system performance by performing regular tests, troubleshooting, and integrating new features
• Provide L2 support for data systems to stakeholder teams
• Collaborate with technical teams to design and implement data solutions
• Recommend solutions to improve new and existing data systems

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience
• Bachelor's degree in information systems, information technology, computer science, or similar.
• Expertise in Structured Query Language (SQL), with strong Experience with AWS Cloud services/technologies, such as RDS, S3, Lambda, Secrets Manager
• Strong Experience in Python, Pandas/Polars, and Numpy, and clear understanding of OOP and software design constructs within a Python context
• Strong Experience in all aspects of software development lifecycle, especially Agile Scrum, along with experience in implementing and monitoring ETL processes
• Strong Experience with database technologies, architecture, performance tuning, and scaling
• Strong Experience in database design and modeling, experience with Airflow or similar orchestration tools
• Experience working with Data Lakes (Iceberg/Delta Table) and experience working with Spark and EMR
• Experience working with CI/CD tools for application and database development
• Excellent communication (written and oral) and presentation skills, with agility: able to shift gears and react quickly to timely requests
• Ability to work with quant researchers & developers to understand requirements, strong attention to detail, pride in delivering high quality work and willingness to learn

Preferred qualifications, capabilities, and skills

• Experience working with DuckDB is a plus
• Experience with PostgreSQL specifically is a plus
• Experience supporting development of AI/ML models
• Exposure to financial capital markets data and trading applications, working with investment data
• AWS certifications are a plus
• Experience with project workflow tools such as Jira in an Agile-Scrum environment
• Knowledge of Linux and knowledge of Docker