Senior Data & AI Engineer — LLM & Azure Production

Beacon Technologies, Inc; EE. UU.; A distancia; USD 150.000 - 230.000; Jornada completa

Descripción de la vacante

Beacon Technologies, Inc. seeks a Senior Data & AI / LLM Engineer to design, build, and operate data, ML, and Generative AI solutions for the insurance domain.

You will develop scalable data pipelines, ML/LLM models, and enterprise AI applications using Azure, Databricks, and modern DevOps practices. You will collaborate with data scientists and engineers to productionize models, implement RAG workflows, and ensure data governance and security.

Formación

• Strong professional experience in data engineering, analytics, ML, AI, or software engineering.
• Advanced programming in Python and SQL.
• Experience with Databricks, Spark/PySpark, and Delta Lake.
• Design and support production-scale ETL/ELT pipelines.
• Data analysis on large, complex datasets.
• Knowledge of statistical analysis and ML techniques.
• Hands-on experience with LLMs and Generative AI.
• Experience with Azure cloud and AI services.
• Familiarity with Git, CI/CD, and DevOps practices.

Responsabilidades

• Design, build, test, and maintain scalable data pipelines and data products using Databricks, Spark/PySpark, Delta Lake, SQL, and Python.
• Perform exploratory and advanced data analysis to identify patterns and opportunities in insurance data.
• Build reliable ingestion, transformation, integration, and data-quality processes across structured and unstructured data.
• Work with large-scale datasets across cloud data platforms, APIs, files, databases, and enterprise apps.
• Apply data quality, lineage, observability, metadata, security, and governance.
• Optimize pipelines for reliability, performance, scalability, and cost.
• Develop, evaluate, deploy, and monitor ML models using Python and ML frameworks.
• Translate business problems into analytical or ML approaches and productionize models with data scientists.
• Design and implement enterprise LLM applications (RAG, retrieval, embeddings, vector search, grounding).
• Use AI development tools (GitHub Copilot, Claude) to accelerate engineering delivery.
• Adhere to CI/CD, DevOps, testing, and production deployment practices.

Conocimientos

Python

SQL

Databricks

Spark/PySpark

DL/Delta Lake

LLMs/Generative AI

Azure

Git/CI-CD/DevOps

Production deployment

Educación

Bachelors/Masters in CS/DS/AI/Engineering

Herramientas

Azure Databricks

Delta Lake

GitHub Copilot

Claude

Vector search

Descripción del empleo

Beacon Technologies, Inc. seeks a Senior Data & AI / LLM Engineer to design, build, and operate data, ML, and Generative AI solutions for the insurance domain.

You will develop scalable data pipelines, ML/LLM models, and enterprise AI applications using Azure, Databricks, and modern DevOps practices. You will collaborate with data scientists and engineers to productionize models, implement RAG workflows, and ensure data governance and security.