Senior Data Engineer

Bain Capital; Boston (MA); Vor Ort; USD 150.000 - 170.000; Vollzeit

Benefits dieser Stelle

Competitive benefits package

Zusammenfassung

Bain Capital is seeking a Senior Data Engineer to join the Private Markets Data Team. This role designs, implements, and maintains data engineering systems and governance, delivering scalable data solutions to support investment decisions.

The candidate will work with cross-functional teams, lead data initiatives, and contribute to the development of next-generation data platforms in a fast-paced environment.

Qualifikationen

• 7+ years of professional software or data engineering experience.
• BS or MS in Computer Science, Engineering, or related field.
• Strong communication, analytical and problem-solving skills.
• Experience with Big Data and streaming technologies preferred.
• Demonstrated ownership mindset and ability to drive projects.
• Ability to translate complex business requirements into scalable data solutions.

Aufgaben

• Design, develop, and maintain on-premises and cloud data ingestion and processing pipelines.
• Administer and extend data engineering tools including Airflow, DBT Cloud, Snowflake, and Python.
• Support and enhance the Data Governance process.
• Develop production-quality code and data solutions supporting key business initiatives.
• Conduct architecture and code reviews to ensure security, scalability, and quality.
• Collaborate with cloud migration, information security, and business analysis teams to deploy new applications and migrate systems to Airflow and cloud-native technologies.
• Provide technical leadership and mentorship to onshore and offshore team members.
• Define and execute a technical roadmap, identifying opportunities to improve processes, efficiency, and data quality.
• Optimize data pipeline performance and improve runtime of jobs.

Kenntnisse

Python

SQL

Airflow

Snowflake

AWS

Data modeling

Docker

Kubernetes

ETL pipelines

Ausbildung

BS/MS in CS/Engineering

Tools

Terraform

GitHub Actions

ECR

Datadog

Grafana

DBT Cloud

Airflow

Jobbeschreibung

BAIN CAPITAL OVERVIEW

With approximately $225 billion of assets under management, Bain Capital is one of the world’s leading private investment firms. We create lasting impact for our investors, teams, businesses, and the communities in which we live. Over four decades we have strategically grown our platform to focus on Private Equity, Growth & Venture, Capital Solutions, Credit, and Real Assets. Today, our team includes 1,985+ employees in 24 offices on four continents. We partner differently to help people and companies embrace possibility and realize potential. Founded as a private partnership in 1984, we have fostered a culture of innovation, entrepreneurialism, and agility, empowering our people to define and own their career trajectories. Today, our partnership approach enables us to pursue strategic growth, build enduring relationships with a robust external network, and collaborate across our integrated platform to connect the deep and diverse expertise that unlocks breakthrough insights. Our people are the heart of our advantage. Colleagues at all levels have a seat at the table as they tackle business challenges with a principal investor mindset. By asking incisive questions, respectfully challenging one another, and remaining intellectually agile, we work together to achieve exceptional outcomes. For more information visit: Bain Capital

ABOUT THE ROLE

We are seeking a highly motivated Senior Data Engineer to join our Private Markets Data Team. This role will be responsible for the design, implementation, and maintenance of data engineering systems and governance processes, while contributing to the development of next-generation data solutions.

The ideal candidate is a well-rounded technologist with strong data engineering skills, hands-on programming experience, and a passion for building scalable, high-performance data systems. You should be comfortable working in a fast-paced environment, collaborating with cross-functional teams, and communicating complex technical concepts clearly to both technical and non-technical audiences. This position offers the opportunity to work closely with data product managers, business analysts, and business stakeholders, gaining exposure to the investment management process and contributing to systems that provide a competitive edge to our investment teams.

RESPONSIBILITIES

• Design, develop, and maintain on-premises and cloud-based data ingestion and processing pipelines.
• Administer and extend data engineering tools including Airflow, DBT Cloud, Snowflake, and Python.
• Support and enhance the Data Governance process.
• Develop production-quality code and data solutions supporting key business initiatives.
• Conduct architecture and code reviews to ensure security, scalability, and quality across deliverables.
• Collaborate with cloud migration, information security, and business analysis teams to design and deploy new applications and migrate existing systems to Airflow and cloud-native technologies.
• Provide technical leadership and mentorship to onshore and offshore team members.
• Define and execute on a technical roadmap, identifying opportunities to improve processes, efficiency, and data quality.
• Optimize data pipeline performance and improve overall runtime of jobs.

TECHNOLOGY EXPERIENCE

• Proven experience building and maintaining on-premises and cloud-based data solutions.
• Hands-on experience supporting SaaS, business-facing applications.
• Comfortable using large language models (e.g., Claude, ChatGPT) day-to-day for data analysis and automation; working knowledge of prompt engineering and agentic / workflow-automation frameworks.
• Familiarity with AI-assisted coding tools (Claude Code, OpenAI Codex, or AI-native IDEs such as Cursor or Windsurf) and with extending AI through the Model Context Protocol (MCP) and reusable skills is a plus.
• Exposure to vector databases and retrieval-augmented generation (RAG) pipelines (e.g., Pinecone, pgvector, or Snowflake Cortex Search) for LLM-powered applications is a plus.
• Experience working within cloud-native AWS serverless data and integration products.
• Experience with containerization and orchestration tools such as Docker and Kubernetes.
• Expertise in Python for data processing, automation, and production-grade development.
• Strong knowledge of SQL, data modeling, and data warehouse design (e.g., One Big Table, Kimball/star schema).
• Experience building, deploying, and optimizing Snowflake Cortex AI using best practices.
• Experience with deployment tools such as Terraform, GitHub Actions, and ECR.
• Experience with infrastructure monitoring and observability tools such as Datadog, Grafana, or Amazon CloudWatch.
• Understanding of Power BI, Tableau, or similar BI/reporting tools.
• Familiarity with data pipeline technologies and orchestration tools (e.g., Airflow, DBT Cloud).
• Experience with Snowflake, Redshift, BigQuery, or Athena.
• Familiarity with modern lakehouse table formats such as Delta Lake, Apache Iceberg, or Apache Hudi is a plus.
• Understanding of data governance, data quality, and metadata management frameworks.
• Hands-on experience with data quality/observability tooling (e.g., Great Expectations, Monte Carlo, or Soda) and data catalog/lineage platforms (e.g., Alation, Collibra, or Unity Catalog) is a plus.
• Exposure to streaming and real-time data processing tools such as Kafka, Flink, or Spark Streaming is a plus.
• Familiarity with web scraping, APIs, and data integration best practices.
• Experience working in an Agile development environment.

QUALIFICATIONS

• BS or MS in Computer Science, Engineering, or a related technical field.
• 7+ years of professional software or data engineering experience.
• Strong foundation in software design and architectural patterns.
• Excellent communication, analytical, and problem-solving skills.
• Proven ability to translate complex business requirements into scalable data solutions.
• Experience with Big Data and streaming technologies preferred.
• Demonstrated ownership mindset and ability to drive projects from concept to completion.
• Highly collaborative team player who thrives in a fast-paced, dynamic environment.
• Self-starter with a commitment to continuous learning and innovation.

WHY JOIN US

At Bain Capital, you’ll have the opportunity to work with cutting-edge technologies in a collaborative environment that values innovation and excellence. You’ll be part of a high-performing team that leverages data to drive strategic decisions and investment insights across global markets.

COMPENSATION

Expected Annual Base Salary $150,000 - $170,000; Actual base salary will be determined by a wide range of factors including but not limited to role, function, level, experience and qualifications and geographic location. In addition to a competitive base salary, this position may be eligible for a discretionary annual bonus based upon factors such as individual impact, team and firm performance.

BENEFITS

Bain Capital offers a competitive benefits package designed to support employees’ health, financial security, family needs, and overall well-being.

EQUAL OPPORTUNITY STATEMENT

Bain Capital is an equal opportunity employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.

ADDITIONAL INFORMATION

Founded in 1984, Bain Capital is one of the world’s leading private investment firms. We are committed to creating lasting impact for our investors, teams, businesses, and the communities in which we live. As a private partnership, we lead with conviction and a culture of collaboration, advantages that enable us to innovate investment approaches, unlock opportunities, and create exceptional outcomes. Our global platform invests across five focus areas: Private Equity, Growth & Venture, Capital Solutions, Credit, and Real Assets. In these focus areas, we bring deep sector expertise and wide-ranging capabilities. We have 24 offices on four continents, more than 2,000 employees, and approximately $225 billion in assets under management. To learn more, visit www.baincapital.com. Follow @BainCapital on LinkedIn and X (Twitter).

TRANSPARENCY IN COVERAGE – MRF REQUIREMENT

All personal data will be processed in accordance with the Bain Capital EEA and UK Data Protection Notice. For more information.

For job applicants in the United States, Bain Capital participates in the E-Verify program and if hired will use E-Verify to confirm your work authorization. For more information on E-Verify, please refer to the E-Verify Participation and Right to Work Notices.