Senior Data Solutions Engineer – Azure & AI Pipelines

Arthur J. Gallagher & Co. (AJG); Bogotá ciudad; On-site; COP 120,000,000 - 180,000,000; Full time

Job summary

Arthur J. Gallagher & Co. (AJG) seeks a senior Data Solutions Engineer to design and deliver scalable data pipelines across Azure and on‑prem environments.

You will enable BI and AI work, combining data from APIs, databases, and cloud/on‑prem sources to produce trusted datasets for reporting and machine learning. You will lead data integration efforts, implement robust ETL/ELT processes, and collaborate with security and governance teams to ensure data quality and availability for analytics use

Qualifications

• 10+ years of experience in data solutions engineering, including 7+ years on the Microsoft platform.
• Advanced English level.
• 7+ years of experience designing and building large applications with SQL Server.
• Experience with Azure Data Factory, Azure SQL, Azure Databricks, Synapse Analytics, Azure Functions, SQL Server, T-SQL, and SSIS.
• Built or supported CI/CD pipelines and used DevOps tools to move code, database changes, and data through the release cycle.
• Used Python and data libraries such as NumPy, Pandas, and PyArrow.
• Built or supported AI and machine learning solutions in cloud environments, including work with vector databases.
• Able to explain technical ideas clearly to managers, developers, vendors, and systems teams.
• Able to lead a project team, shape a technology vision, and create detailed estimates for planned work.
• Bachelor’s degree in computer science, engineering, or a related field, or equivalent experience.

Responsibilities

• Lead the design and delivery of scalable data pipelines across Azure and on-prem environments.
• Build reliable data structures for reporting, analytics, and machine learning.
• Hands-on data ingestion, transformation, validation, and loading across diverse sources.
• Pull data from APIs, databases, Azure Blob Storage, ADLS Gen2, third-party systems, and on-prem SQL Server; ensure accuracy and availability.
• Design and optimize ETL/ELT processes and data models for analytics use cases.
• Collaborate with security, governance, and data science teams to maintain quality and compliance.

Skills

Azure Data Factory

Azure Databricks

Synapse Analytics

Azure SQL

SQL Server

Python (Pandas, PyArrow)

CI/CD pipelines

DevOps tools

ETL/ELT design

Advanced English

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Azure Data Factory

Azure Databricks

Synapse Analytics

Azure SQL

SQL Server

SSIS

Python (Pandas, PyArrow)

Job description

Arthur J. Gallagher & Co. (AJG) seeks a senior Data Solutions Engineer to design and deliver scalable data pipelines across Azure and on‑prem environments.

You will enable BI and AI work, combining data from APIs, databases, and cloud/on‑prem sources to produce trusted datasets for reporting and machine learning. You will lead data integration efforts, implement robust ETL/ELT processes, and collaborate with security and governance teams to ensure data quality and availability for analytics use