Senior Data Engineer

Beam Impact; United States; Remote; USD 160,000 - 180,000; Full time

Benefits offered by this job

Annual bonus based on performance

Stock options

401k match

Wellness stipend

Professional development budget

Job summary

A social impact organization is seeking a Senior Data Engineer to develop and enhance the data platform crucial for their mission. This role demands expertise in Python, SQL, and data systems, offering a collaborative environment aiming for high impact in nonprofit sectors. The position is remote-first with an attractive compensation package, including stock options and workspace flexibility in New York. Candidates with strong communication and team collaboration skills will thrive in this role.

Qualifications

• 4+ years as a Data Engineer or Senior Data Engineer using Python and SQL.
• Experience with production-level data systems in a collaborative environment.
• Familiarity with cloud infrastructure, CI, and automated testing.

Responsibilities

• Design and plan data solutions through collaboration.
• Execute high-quality software with the team.
• Develop subject matter expertise in Beam's data ecosystem.

Skills

Data-intensive applications development

Collaboration in a team environment

Python proficiency

SQL proficiency

PostgreSQL knowledge

Apache Airflow experience

Business Intelligence tool expertise

Understanding of distributed computing

Strong communication skills

Education

Bachelor’s degree in Computer Science or related field

Tools

Apache Spark

Tableau

Kubernetes

Job description

Are you looking to join a highly motivated team working for social impact? At Beam we’re on a mission to shift $10 Billion to high-impact nonprofits.

About the role

As a Senior Data Engineer on our Engineering team with a focus on data development, you will be working with a team of talented developers responsible for helping create and maintain the data platform, infrastructure, and processes that power the internal and external facing business intelligence that drives Beam’s mission. Our data platform processes more than 7TB of data every 90 minutes, delivering complex analytics to our partners and actionable data to our internal stakeholders. You will have the opportunity to work with a wide range of open source data technologies, building new features, supporting existing functionality through bug fixing and enhancements, and will have a significant impact on a core part of our business.

We’re a highly collaborative team motivated by impact and our high growth environment. This is an opportunity for someone excited to have a high level of impact on Beam’s continued success.

Our Data tech stack

• Apache Spark running pyspark
• Kubernetes running on EKS; managed using k9s, Helm and eksctl
• Apache Airflow as our workflow orchestrator
• Testing automation via pytest
• uv as our Python package manager
• Snowflake as our data warehouse
• S3 as our distributed object storage / data lake

What you’ll do

• Design and plan new platform data solutions through collaboration with our Staff Data Engineer, product team, and internal stakeholders using RFC and Tech Spec documents
• Collaborate with your peers to execute and implement high-quality software
• Collaborate with your peers to assist in planning and execution of new software features, bringing a focus on data platform requirements
• Drive the execution of your work from spec document to delivery through our SDLC
• Grow your skillset and be a force multiplier by sharing knowledge through code reviews, pair programming, 1-1 conversations, and broader team trainings
• Develop subject matter expertise in the Beam data ecosystem and our reporting platform through code development, directly supporting our Client Strategy team, Business Operations, and our partners
• Understand and strive to balance tech debt with practicality while designing solutions
• Gain knowledge of the nonprofit giving and e-commerce enablement spaces
• Foster a team culture around Beam’s values of community, inclusivity, care, accountability and support
• Strive for continuous improvement through goal setting, feedback, and other growth opportunities

What we’re looking for

• 4+ years as a Data Engineer or Senior Data Engineer utilizing Python and SQL to develop data intensive applications or insights, or 5+ years of experience as a Software Engineer using Python and SQL, working in a primarily Python codebase
• Experience working on production-level data systems in a collaborative team environment
• Proficient with Python and SQL
• Proficient with relational databases, particularly PostgreSQL
• Experience with Apache Airflow for task orchestration
• Experience using a Business Intelligence tool, like Tableau
• Familiar with fundamental development principles and processes such as observability, performance optimization, continuous integration, automated testing, and cloud infrastructure
• Familiar with distributed computing architecture, data warehouse and data lake storage patterns
• Strong communication skills with the ability to explain and advocate for technical projects to non-technical roles

Nice to haves

• Experience in an early startup
• Experience with setting up and administrating a Business Intelligence tool, like Tableau
• Experience with Apache Spark
• Experience with managing a Kubernetes cluster
• Bachelor’s degree in Computer Science or related technical or analytical field (or equivalent training, fellowship, or work experience)

Compensation and perks

• Expected annual compensation range: $176,000-198,000 USD
• Base salary $160,000-180,000 USD
• Up to 10% annual bonus based entirely on individual performance
• Stock options
• 50% match on 401k contributions of up to 6% of base salary
• $100 monthly wellness stipend
• $750 annual professional development budget
• See a full list of perks at https://beamimpact.com/careers

Location - Remote

We are a remote-first company, so our team works from wherever they are. We also have office space in New York, currently in Hearst Tower, where you’re free to come work from as well. We have no plans to require in-office work.