AI Data Engineer

Starr Underwriting; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

A leading company is looking for an AI Data Engineer to bridge data science and engineering. You will be responsible for building data infrastructure and optimizing AI processes using advanced tools and techniques. Ideal candidates will have strong programming and data engineering skills, coupled with relevant experience in cloud environments and machine learning frameworks.

Qualifications

• 5+ years of experience in technology and data engineering or a related role.
• 3+ years of experience in cloud environments.
• Experience with machine learning and AI applications.

Responsibilities

• Design and implement robust data pipelines for data processing.
• Collaborate with Data Scientists for AI integrations.
• Optimize data architectures for AI applications.

Skills

Programming Skills

Data Engineering Tools

Cloud Platforms

Machine Learning Frameworks

Data Modeling

Data Pipelines

Problem Solving

Education

Bachelor's or master’s degree in computer science, Data Science, or a related field

Tools

Databricks

Apache Airflow

TensorFlow

PyTorch

Google Cloud Platform

Docker

Kubernetes

Job description

The AI Data Engineer is a critical role that bridges the gap between data science and engineering, enabling the development and deployment of data assets with integrated models. This role is responsible for building and maintaining the data infrastructure and pipelines that power AI and machine learning applications. As an AI Engineer, you will be at the forefront of technological innovation, working with advanced tools and platforms to transform and optimize data processes.

Key Responsibilities:

1. Data Ingestion and Processing: Design and implement robust data pipelines to collect, clean, transform, and store large volumes of data from diverse sources.
2. Data Preparation: Preprocess and transform data into formats suitable for machine learning algorithms.
3. Feature Engineering: Develop and select relevant features that improve the performance of machine learning models.
4. Data support for Models: Collaborate with Data Scientists and ML Engineering professionals, and other cross-functional teams to integrate AI solutions into systems and processes. This includes optimizing AI solutions to handle large volumes of data efficiently.
5. Scalability: Design and implement scalable data architectures to support the growing demands of AI applications.
6. Performance Optimization: Continuously optimize data processing and model inference for efficiency and speed.

Required Skills:

1. Strong Programming Skills: Proficiency in Python, Java, or Scala.
2. Data Engineering Tools: Experience with Big Data (BigQuery, Hive), processing unstructured and structured data, understanding call center data, media data processing, clickstream, real-time data processing. Experience with ETL tools like Databricks or equivalent.
3. Cloud Platforms: Expertise with GCP cloud environment.
4. Machine Learning Frameworks: Familiarity with TensorFlow, PyTorch, Vertex AI, or other ML frameworks.
5. Data Modeling: Understanding of data modeling techniques and database design.
6. Data Pipelines: Experience with data pipeline orchestration tools like Apache Airflow.
7. Problem Solving: Ability to analyze and solve complex data engineering challenges.

Qualifications:

1. Bachelor's or master’s degree in computer science, Data Science, or a related field.
2. Experience with machine learning and AI applications.
3. 5+ years in technology and data engineering or a related role.
4. 3+ years of experience in cloud environments.

Desired Skills:

• Experience with MLOps practices.
• Knowledge of containerization technologies like Docker and Kubernetes.
• Familiarity with data visualization tools.
• Strong communication and collaboration skills.
• Experience working with Google Cloud Platform.
• Extensive data engineering experience.
• Understanding and familiarity with AI models.

The AI Data Engineer is a key enabler of innovation, powering the development of intelligent applications that transform businesses and industries.