Data Platform Engineer

Team Cymru; Oregon; Hybrid; USD 150,000 - 210,000; Full time

Job summary

Team Cymru is seeking a Senior Software Engineer in Oregon to design and build Go services for our data lake. You will own data land, cleansing, and conformance, delivering trusted datasets across bronze, silver, and gold layers while mentoring teammates and shaping engineering practices.

The role involves hands-on coding, system design, and collaboration with analysts and product teams to translate threat intelligence workflows into scalable software. Occasional travel may be required.

Qualifications

• 7+ years of professional software engineering experience.
• 3+ years building and operating production Go systems at scale.
• Deep Go fluency: concurrency, profiling, memory management, testing.
• Hands-on experience building and running a data lake using the Medallion Architecture.
• Strong knowledge of open table formats and columnar storage.
• Experience with object storage and partitioning at scale.
• Experience designing distributed systems with scalability and reliability in mind.
• Experience with ClickHouse and PostgreSQL databases.

Responsibilities

• Design, build, and operate large-scale data ingestion and processing systems for the data lake.
• Own data lake layers (bronze, silver, gold) end-to-end.
• Tune table formats, partitioning, and layout for cost, latency, and performance.
• Lead end-to-end components from design to deployment and monitoring.
• Write clean, well-tested Go code and contribute to engineering standards.
• Collaborate with threat intelligence analysts and cross-functional teams to translate requirements into scalable software.

Skills

Go fluency

Distributed systems

Mentorship

Troubleshooting

Collaborative work

Education

Bachelor's degree in CS/SE or related field

Tools

Apache Iceberg

Delta Lake

Apache Hudi

Parquet

S3/GCS/ADLS

Job description

Join the mission to make the digital world safer.

About Team Cymru

Team Cymru's mission is to save and improve human lives by helping public and private sector analysts track and take down cybercriminals. We provide visibility into global cyber threat activity and are a key intelligence source for leading cybersecurity and threat intelligence vendors.

Our Pure Signal™ platform gives enterprise security teams on-demand access to global internet traffic telemetry, providing clarity into what's happening across the internet with a level of visibility comparable to their own internal networks. This allows organizations to close detection gaps, accelerate incident response, and get ahead of critical, recurring threats.

Team Cymru is a fast-paced, distribution-focused, private equity-backed company where your work directly supports a mission that protects millions worldwide.

We're looking for a Senior Software Engineer to design and build the Go services and pipelines that power our data lake. You'll own how raw data lands, gets cleaned and conformed, and becomes trusted, business-ready datasets across our bronze, silver, and gold layers. You'll operate with significant technical ownership, working closely with stakeholders to turn deep domain knowledge into reliable, production-grade systems. This role suits an engineer who can move fluidly between hands‑on coding, system design, and mentoring, and who is energized by the mission-driven, high-signal nature of threat intelligence work.

Key Responsibilities

• Design, build, and operate large-scale, high-throughput systems for collecting, processing, enriching, and ingesting threat intelligence data (network telemetry, indicators of compromise, or similar) into our data lake infrastructure
• Own all layers of the data lake: bronze, silver, and gold
• Choose and tune table formats, partitioning, compaction, and file layout to balance cost, latency, and query performance
• Own significant components or services end-to-end, from technical design through deployment, monitoring, and iteration in production
• Write clean, well-tested, maintainable code in Go, and contribute to our engineering standards and practices
• Participate in architectural decisions, design reviews, and technical planning; provide informed input on trade-offs around scale, latency, and data integrity

Collaboration & Domain Translation

• Partner directly with threat intelligence analysts and researchers to translate investigative workflows and detection logic into scalable software
• Collaborate cross-functionally with product, security, and data teams to prioritize work that has direct impact on customer and analyst outcomes

Reliability & Operations

• Improve the reliability, performance, and observability of existing systems, including on‑call participation for services you own

Mentorship & Engineering Quality

• Mentor other engineers through code review, pairing, and technical guidance; help raise the bar for engineering quality across the team

Qualifications & Experience

• 7+ years of professional software engineering experience, including 3+ years building and operating production Go systems at scale
• Deep Go fluency: concurrency (goroutines, channels, context), profiling and performance tuning, memory management, and idiomatic testing
• Hands‑on experience building and running a data lake using the Medallion Architecture (bronze, silver, gold) in production
• Strong working knowledge of an open table format such as Apache Iceberg, Delta Lake, or Apache Hudi, and columnar formats like Parquet
• Experience with object storage (S3, GCS, or ADLS) and with partitioning, compaction, and schema evolution at scale
• Demonstrated experience designing distributed systems; you can reason clearly about trade-offs in scalability, reliability, latency, and cost
• Experience working with large or high‑velocity datasets; familiarity with streaming or batch data pipeline technologies is a strong plus
• Experience building and maintaining ClickHouse and PostgreSQL databases

Additional Skills

• Genuine interest in cybersecurity or threat intelligence; prior experience in the domain is a plus but not required for a strong engineer with the right curiosity and aptitude
• Excellent written and verbal communication skills, including the ability to explain technical trade-offs to non-engineering stakeholders
• A collaborative, low‑ego approach to technical disagreement, mentorship, and cross‑team problem-solving
• Experience with the specific data domains relevant to threat intelligence (network flow data, DNS, malware analysis, OSINT, or similar)
• Experience with AWS and infrastructure‑as‑code tooling
• Familiarity with security frameworks or standards relevant to the industry (MITRE ATT&CK, STIX/TAXII)
• Prior experience in a startup or fast‑scaling engineering organization, including comfort with ambiguity and shifting priorities
• Open‑source contributions or a public track record of technical writing or speaking

Education and Certifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience

Travel

Occasional travel for team meetings or industry events may be required.

Why Join Team Cymru?

At Team Cymru, we provide unmatched global threat intelligence that empowers organizations to proactively disrupt adversaries. You'll be at the forefront of cybersecurity innovation, helping customers harness the full power of our threat intelligence to achieve critical business and security outcomes.

We offer a collaborative, mission‑driven culture where your expertise and impact will directly contribute to improving global security.

Team Cymru is an equal opportunity employer and welcomes applicants from all backgrounds.