Senior Kafka Platform Engineer

Bloomberg L.P.; New York (NY); On-site; Full time

Job description

Senior Software Engineer - Apache Kafka Infrastructure

Location: New York

Business Area: Engineering and CTO

Ref #: 10051649

Description & Requirements

The Bloomberg Managed Services organization (BMS) is responsible for creating and curating Bloomberg Engineering's "as a Service" software catalog and infrastructure. We develop and integrate products into a simple, elegant user interface and provide a concise way for engineers to create data-store and middleware instances.

The BMS Streaming team focuses on providing streaming solutions on the BMS Platform powered by Apache Kafka and its ecosystem. Apache Kafka has quickly become the backbone of event driven architecture at Bloomberg and the main data bus for data distribution, live streaming, and general purpose messaging. Given that the majority of Engineering teams in the company already leverage our product in production, you’ll have the chance to positively impact virtually any product under the Bloomberg umbrella by joining our team.

The easiest way to learn more about what our team does and some of the challenges we face is to check out our talk at Kafka Summit:

We are extremely proud of our open and inclusive culture, and value diversity of thought and perspective in every form. We're looking for engineers with a real passion for writing reusable, efficient solutions to complex problems, who can collaborate and work effectively on small teams to develop software that impacts thousands of power users around the world.

We work with:

• Open-source frameworks and tools (Apache Kafka, Docker, Kubernetes, Node.js, OpenStack, etc)
• Java, Scala, C++, Python, Javascript, and Go as required to provide these frameworks in an easy to use manner for developers
• All projects follow the team's SDLC practices, including Docker-based unit testing, Jenkins integration, API documentation standards, etc.

We'll trust you to:

• Collaborate within an Agile, multi-disciplinary team
• Develop code around the Apache Kafka broker, its client libraries (C/C++, Java, Python), its ecosystem frameworks (Kafka Connect, Kafka Streams, Cruise Control, Burrow, etc.)
• Work on Open Source projects within the Kafka ecosystem and contribute changes upstream
• Develop an end-to-end full-stack user experience
• Pick up on new frameworks, experiment, and build software that works seamlessly on various environments
• Anticipate engineering needs and expectations from Bloomberg engineers, and build solutions that work for them
• Collaborate directly with product owners and application teams to understand requirements, conduct feature demos, and provide system design consultations
• Identify feature gaps in the technologies and work with the open source community and our vendors to co-design and co-develop features and bug fixes

You’ll need to have:

• 4+ years experience programming in Java, C++, Python, Go, Scala or similar in a production environment
• A Degree in Computer Science, Engineering or similar field of study or equivalent work experience
• Strong communication and collaboration skills
• Strong understanding of distributed systems, data structures, algorithms and system design
• Experience designing and implementing low-latency, high-volume, and high-availability distributed systems
• Commitment to writing meaningful unit tests (including integration tests)

We'd love to see:

• Passion for distributed systems and large scale data systems
• Familiarity with Apache Kafka
• Familiarity with Kubernetes and Docker
• Java programming experience
• Experience maintaining and contributing to large Open Source projects
• Experience evolving and monitoring systems at scale
• Deep understanding of TCP/IP and Unix networking, Linux kernel performance

Salary Range = 160,000 - 240,000 USD Annual + Benefits + Bonus

The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.

We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email [e-mail]