Data Engineer

Shift5 is the observability platform for onboard operational technology (OT). We’re a rapidly growing scale-up that specializes in cybersecurity, predictive maintenance, and compliance for operational technology (OT) systems across defense, aerospace, and rail. We are a collaborative, passionate, and driven cadre of dynamic, multidisciplinary experts and we’re focused on helping our customer’s fleets run smarter and safer by accessing and democratizing the volumes of onboard OT data generated by transportation and freight fleets, and defense fleets and weapon systems. Come join us.

Our Values:

• Embrace Truth and Integrity: Base decisions on data, foster open dialogue, and uphold unwavering integrity.
• User-Centric Focus: Prioritize user needs to guide our actions and resource allocation.
• Collaborative & Adaptable: Collaborate for excellence, learning from failures and driving iterative improvements, recognizing every decision's significance.

Shift5 is seeking a Data Engineer to join our growing team. In this role, your primary responsibilities will be to:

• Interpret requirements and design specifications and take ownership of building features from the ground up.
• Write clean, well-documented, scalable, extensible, testable code to ensure application quality and maintainability.
• Work cross-functionally across Shift5 engineering teams to build applications that integrate cleanly across other Shift5 componentry.
• Design, build, and maintain data processing, storage, and integration pipelines.
• Build robust and scalable data products for various stakeholders including data scientists, transportation engineers, and executives that drive insights and decision making.
• Create solutions that utilize AWS cloud services that are efficient, reliable, cost-effective, dynamically scalable, and observable.
• Collaborate with data scientists and engineers to create semantic data models to represent complex vehicular systems.
• Perform analysis on complex data sets to create data ontologies, verify data quality/integrity, and ensure accuracy of data after passing through data pipelines.

You’ll operate in a team-based environment with engineers, product managers, program managers and designers to conceive, implement and shape major features. Engineers are key contributors in shaping this design process and you’ll be a major factor in generating high-impact products that literally save lives. This role resides in our Product Engineering team and reports to our Director, Software Engineering.

Qualifications:

Required:

• 5+ years software/data engineering.
• 3+ years experience with a major programming language (GoLang, Java, Python).
• 3+ years experience with relational databases (PostgreSQL, MySQL, Oracle, etc.).
• 3+ years experience with Big Data (Hadoop, Spark) and Data Modeling.
• 2+ years experience with containerization and cloud services: Docker, Kubernetes, cloud monitoring tools.
• Proven experience building complex data applications from scratch including requirements gathering, design, planning, and implementation.
• Familiar with modern data stack components including data ingestion, transformation, and orchestration.
• Expertise with batch and streaming data pipelines using technologies such as Apache Airflow or Benthos.
• Demonstrated delivery of scalable, observable, supportable, reliable data processing applications.
• Deep understanding of software engineering practices and concepts.
• Experience with end-to-end feature design and ownership.
• Comfortable working in a fast-paced environment.
• Ability to efficiently multitask and accommodate change of priorities on demand.

Preferred:

• Active US Government TS clearance (and willingness to maintain) or an ability to obtain one.
• MS in Computer Science, Cybersecurity, Cyber Intelligence, or equivalent.
• Experience and understanding of data lakes/warehouses (e.g. Snowflake, Databricks, Redshift).
• Proficiency with CI/CD, source control, design reviews, and integrating observable practices.
• Excellent analytical and problem-solving abilities.
• Ability to work effectively in a team and with cross-functional groups.

We are committed to building an inclusive culture of belonging that embraces the diversity of our people and represents the communities in which we work and the customers we serve. We know the happiest and highest performing teams include people with diverse perspectives and ways of solving problems. We strive to attract and retain talent from all backgrounds and create workplaces where everyone feels empowered to bring their full, authentic selves to work.

Shift5 is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sexual orientation, gender identity, national origin, disability, age, marital status, ancestry, projected veteran status, or any other protected group or class.