Senior Engineer, Webscraping

Balyasny Asset Management L.P.; Warszawa; On-site; PLN 1,000,000 - 1,260,000; Full time

Job summary

Balyasny Asset Management L.P. seeks a Senior Engineer for our Webscraping team to build high-capacity data collection systems feeding investment researchers and quants. You will lead a team of developers, design agentic data extraction, and collaborate with portfolio managers to turn data into actionable insights.

Strong Python, SQL, Airflow, Kafka, and cloud experience (AWS) required. Experience with HTML/JS APIs and container tech (Docker/Kubernetes) preferred.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Mathematics or a related field.
• 7–10+ years of software development experience.
• Proven experience managing software or data engineering teams.
• Strong proficiency in Python (including pandas) and SQL/Database skills.
• Experience with agentic coding (e.g., Claude Code, MCPs, skills, subagents).
• Experience with data pipelines (Airflow, Kafka).
• Experience with web technologies (HTML/JS, APIs) and networking.
• Strong understanding of data structures, algorithms, and statistical methods.
• Excellent verbal and written communication skills.

Responsibilities

• Team leadership: Manage a team of developers to optimize impact and potential.
• Tool Development: Design, develop, and deploy Agentic applications for data collection and standardization.
• Process Improvements: Apply AI/ML to improve accuracy, speed, and efficiency.

Skills

Python

SQL

Data pipelines

Airflow

Kafka

HTML/JS

APIs

Algorithms

Communication

Education

Bachelor's or Master's in Computer Science/Engineering/Math

Tools

Docker

Kubernetes

AWS

Job description

We are seeking a technically proficient, creative, and detail-oriented Senior Engineer within our Webscraping team. With thousands of novel and unstructured datasets being used on a daily basis in our investment strategies, this role is crucial in helping our portfolio managers find a competitive advantage. You will manage and work alongside a team of data engineers to build advanced collection systems for BAM's proprietary data efforts, drawing upon your passion of AI / ML to create high capacity, low latency systems that enable our researchers and analysts to gain deeper insights. From webscraping, to audio, to video, your work will be a direct input to our firm's investment decisions.

Team's Key Responsibilities

• Team leadership: Manage a team of talented, ambitious developers to optimize their impact and potential.
• Tool Development: Design, develop, and deploy Agentic applications to extract to collect and standardize unique data for our investment researchers and quants.
• Process Improvements: Analyze existing processes and identify areas where AI/ML can be applied to improve accuracy, speed, and efficiency.
• Technology Infrastructure: Work with technology and data teams to build and maintain robust technology infrastructure that supports these efforts.
• Performance Optimization: Continuously evaluate and refine models and algorithms to ensure optimal performance and alignment with business goals.
• Offshore Management: Partner with the firm's offshore resources to scale human in the loop data validation and collection.
• Collaboration: Partner with portfolio managers, analysts, and other stakeholders to understand business needs and translate them into technical solutions.
• Research and Innovation: Stay abreast of the latest developments in technologies and identify innovative approaches to enhance our competitive edge.

Minimum Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Mathematics or a related field, preferably within tech company.
• 7-10+ years of software development experience.
• Proven experience managing software or data engineering teams.
• Strong proficiency in Python (including pandas) and SQL/Database skills.
• Experience with agentic coding (e.g., Claude Code, MCPs, skills, subagents).
• Experience with data pipelines (Airflow, Kafka).
• Experience with web technologies (HTML/JS, APIs) and networking.
• Strong understanding of data structures, algorithms, and statistical methods.
• Excellent verbal and written communication skills.

Preferred Qualifications

• Prior experience in multi-strategy hedge funds or similarly complex investment organizations.
• Experience designing infrastructure, data products, and tools for Analysts, Quants, and Data Scientists.
• Proficiency in containerizing workloads with Docker (Kubernetes experience is a plus).
• Familiarity with cloud technologies, particularly AWS.

Soft Skills:

• People leadership and coaching skills.
• Strong problem-solving and analytical skills.
• Excellent communication and interpersonal skills.
• Ability to work independently and as part of a team.
• Demonstrated ability to manage multiple projects and meet deadlines.