Lead Software Engineer (Data Platform)

Massachusetts Bay Transportation Authority; Boston (MA); Presencial; USD 140.000 - 190.000; Jornada completa

Descripción de la vacante

Massachusetts Bay Transportation Authority (MBTA) seeks a Lead Software Engineer for its Data Platform. You will drive design, architect critical subsystems, and mentor engineers while ensuring reliability.

You will collaborate with UX/PM teams and influence roadmaps, policies, and best practices across MBTA data infrastructure and production systems.

Formación

• Bachelor’s degree required; substitutions allowed as described.
• Six years of professional software engineering experience with leadership.
• Proven ability to lead end-to-end delivery of complex projects.
• Proficiency in at least two programming languages from the TIobe top 20.
• Experience resolving production incidents and monitoring system health, including on-call.
• Experience with CI/CD and code review processes.
• Experience with logging, monitoring, observability, and cloud-hosted production systems.
• AS part of selection, candidates may complete a software design diagramming or coding exercise.

Responsabilidades

• Lead technical design for subsystem components and services.
• Architect complex systems and guide team members through implementation.
• Reduce systemic reliability risks within team boundaries.
• Mentor junior engineers and drive technical decisions for team-owned systems.
• Collaborate with UX, PMs and others to shape team roadmap and technical strategy.
• Participate in team and incident retrospectives to improve delivery.
• Ensure best practices and compliance across team operations.
• Debug cloud-hosted production systems using observability tools.
• Review code for correctness, performance and reliability.
• Participate in on-call rotation as needed.
• Contribute to organization-wide infrastructure and ways of work.
• Perform other duties and projects as assigned.

Conocimientos

Distributed systems

Elixir

Python

Programming languages (TIobe top 20)

Educación

Bachelor’s degree

High school diploma + 7 years related experience

Associate’s degree + 3 years related experience

Master’s degree substitutes for two years

Certification substitutes for one year

Herramientas

Snowflake

Databricks

Airflow

dbt

Terraform

Pulumi

Descripción del empleo

The Lead Software Engineer collaborates closely with partner teams to solve user and business challenges. The role upholds software engineering excellence in civic technology operating within the specific constraints of the MBTA. The Lead Software Engineer provides technical guidance for other members of the team, leads work on complex or ambiguous components, and helps simplify complexity across team-owned systems. This role elevates team productivity, mentors engineers, and takes ownership of team-level architecture, system reliability, and software engineering best practices.

The Data Platform specialization focuses on building, operating, and improving MBTA’s data ingestion, storage, transformation, and serving systems. Engineers create and maintain the data lake infrastructure and data pipeline automation that supports analytics workloads and ensures reliability, observability, and data integrity across MBTA’s data infrastructure.

• Lead technical design for subsystem-level components and services for the team.
• Architect complex systems and guide team members through implementation.
• Reduce systemic reliability risks within team boundaries.
• Mentor junior engineers and drive technical decisions for team-owned systems.
• Collaborate with applicable User Experience (UX), Product Managers (PM) and other team members to contribute toward shaping the team roadmap and team processes as well as contribute to technical strategy decisions.
• Participate in team and incident retrospectives to improve how the team delivers.
• Ensure implementation of software engineering best practices and adherence to organizational policies, compliance requirements, and cross-functional standards impacting team operations.
• Debug cloud-hosted production systems using observability tools.
• Collaborate with team members to review code for correctness, performance, and reliability.
• Participate in on-call rotation of technology systems and services as needed.
• Contribute to organization-wide infrastructure (e.g. continuous integration pipelines, shared applications) and ways of work (e.g. hiring, cross-team collaboration).
• Perform all other duties and projects that may be assigned.

Additional responsibilities may include focus on one or more departments or locations. See applicable addendum for department or location specific functions.

Supervision

• No direct reports.

• Bachelor’s degree from an accredited institution.
• Six (6) years of relevant professional experience in modern software engineering practices, including technical leadership, system architecture, and designing subsystem-level components and services.
• Experience leading end-to-end delivery of complex projects requiring ingenuity and creativity, often requiring multiple team members to execute.
• Demonstrated proficiency in at least two (2) programming languages from the TIOBE top 20 (https://www.tiobe.com/tiobe-index/)
• Experience resolving production incidents and monitoring system health, including on-call, incident response.
• Experience with CI/CD and code review processes.
• Experience with logging, monitoring, observability, and cloud-hosted production systems.
• Ability to participate in on-call rotation of technology systems and services as needed.
• As part of the selection process, candidates will be asked to complete and pass job-related technical assessments, which may include a software design diagramming exercise and/or a timed coding exercise.

Substitutions

• A high school diploma or GED with an additional seven (7) years of directly related experience substitutes for the bachelor’s degree requirement.
• An associate’s degree from an accredited institution and an additional three (3) years of directly related experience substitutes for the bachelor’s degree requirement.
• A master’s degree in a related subject substitutes for two (2) years of general experience.
• A nationally recognized certification, or statewide/professional certification in a related field substitutes for one (1) year of experience.

• Strong understanding of distributed systems or high-reliability systems.
• Experience with Elixir.
• Experience with AWS.
• Experience with Application Programming Interfaces (API) / microservices / Service-Oriented Architecture (SOA).
• Experience developing code as part of an open-source project.
• Experience in public sector, transportation agency, and/or civic technology team.
• Familiarity with MBTA transit data standards (GTFS, GTFS-RT, TODS, TIDES).
• Experience operating or developing data platforms (e.g., Snowflake, Databricks).
• Experience with orchestrators (Airflow, data build tool (dbt)).
• Strong understanding of data structures and formats for analytical workloads.
• Experience building data ingestion, transformation, or orchestration pipelines.
• Experience with Python in data engineering contexts.
• Experience with Infrastructure-as-Code tools (Terraform, Pulumi) for data infrastructure.