Senior Big Data Engineer

Kforce Inc; Atlanta (GA); Remote; USD 80,000 - 100,000; Full time

Job summary

An innovative firm is seeking a Senior Big Data Engineer to join their fully remote team. This role involves building scalable APIs in Python and Langchain, processing high transaction volumes, and ensuring data integrity for LLMs. The ideal candidate will have extensive experience in data engineering, particularly with NoSQL databases and GCP, and will be passionate about discovering new algorithms and enhancing product functionalities. Join a forward-thinking company that values communication, innovation, and continuous learning, and take your career to new heights in the exciting field of big data and AI.

Benefits

Medical Insurance

Dental Insurance

Vision Insurance

401(k) Plan

Life Insurance

Disability Insurance

Paid Time Off

Qualifications

• 5+ years in data engineering with strong focus on big data and NoSQL.
• Experience with GCP and working with multiple big data sources.

Responsibilities

• Build scalable APIs in Python and Langchain for high transaction processing.
• Ensure correct data input into LLMs and focus on algorithms for product similarities.

Skills

Data Engineering

Experience with LLMs

Big Data Sources

GCP

Vector Stores

NoSQL Databases

Strong Communication

Innovation

Passion for Learning

Job description

This range is provided by Kforce Inc. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$43.00/hr - $52.00/hr

Responsibilities

Kforce has a client seeking a fully remote Senior Big Data Engineer to join their team. The LLM engineer will be building scalable APIs in Python and Langchain that process over 600 transactions per second that directly tie into the LLMs they are building, while the Senior Big Data Engineer will focus on the data side and ensure all the right data is being input into the LLMs. This person will be focused on figuring out the right algorithms that form product similarities, questions/answers, attribute mapping, and retrieving them through vector search. They will be heavily focused on the data side with big data, NoSQL, GCP, pipelines, vector store, and LLMs.

Requirements

• 5+ years in data engineering
• Experience working with LLMs
• Experience working with multiple big data sources
• Experience with GCP
• Experience with Vector Stores
• Strong ability to work with NoSQL Databases
• Strong communication, innovation, passionate, want to learn and reach new horizons

The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract, and business needs. This range may be modified in the future.

We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.

Note: Pay is not considered compensation until it is earned, vested, and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.

This job is not eligible for bonuses, incentives, or commissions.

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.