Data & AI Engineer: Build Scalable Data Pipelines

Ledgent Technology; Swanston (CA); On-site; USD 79,000 - 110,000; Full time

Job summary

Ledgent Technology is seeking a Data & AI Engineer to design and maintain data pipelines, ensuring high-quality data for analytics and AI initiatives. The role partners with data scientists, analysts, and AI engineers to implement scalable data solutions across the enterprise.

Responsibilities include building robust ETL/ELT processes, integrating data across systems, and applying AI techniques to real business problems. Strong cloud, Python/SQL, and data visualization skills are essential.

Qualifications

• Strong programming skills in Python and SQL; working knowledge of additional languages (e.g., Java, R) is a plus.
• Proficiency with cloud data platforms and services such as Azure and Databricks; experience with modern data warehousing concepts.
• Hands‑on experience applying AI and building foundational AI agents (e.g., LLMs, tool use, retrieval‑augmented generation).
• Experience with MLOps/AIOps practices for deploying, monitoring, and maintaining models and data/AI pipelines in production.
• Experience with version control tools (GitHub, Azure DevOps) and data visualization platforms (Power BI, Tableau).

Responsibilities

• Designs and develops data pipelines that extract data from various sources, transforms it, and loads it into the data platform.
• Integrates data from databases, data warehouses, APIs, and external systems; ensures data consistency and integrity; develops APIs for data exchange.
• Applies foundational AI and agent-building skills to support business use cases requiring AI and data platform features.
• Serves as a visible ambassador for data and AI across the organization.
• Implements data quality checks and data governance practices with leadership.
• Optimizes data pipelines for performance, scalability, and efficiency; monitors and tunes data systems.
• Collaborates with data scientists and analysts to optimize models and educate end users on data products.

Skills

Python

SQL

AI/Agent building

MLOps/AIOps

Data integration

Non-technical communication

Tools

Azure

Databricks

GitHub

Azure DevOps

Power BI

Tableau

Job description

Ledgent Technology is seeking a Data & AI Engineer to design and maintain data pipelines, ensuring high-quality data for analytics and AI initiatives. The role partners with data scientists, analysts, and AI engineers to implement scalable data solutions across the enterprise.

Responsibilities include building robust ETL/ELT processes, integrating data across systems, and applying AI techniques to real business problems. Strong cloud, Python/SQL, and data visualization skills are essential.