Management Consultant - Data Engineer

IBM; Armonk (NY); Remote; USD 120,000 - 160,000; Full time

Job summary

IBM Consulting is seeking a Data Engineer specialized in Data Platforms-Databricks to build and enhance Databricks solutions for client data and AI use cases. You will design, develop, and deploy data pipelines and AI capabilities, driving value for diverse industries with a focus on scalable, cloud-based data platforms.

The role emphasizes delivering end-to-end data and AI solutions, collaborating with stakeholders to meet client requirements and achieve project success.

Qualifications

• Experience designing, developing and deploying data platforms on cloud environments.
• Proven ability to lead data and AI use cases for clients.
• Knowledge of Databricks architecture and data pipelines.

Responsibilities

• Implement Data and AI use cases on the Databricks platform to meet client needs.
• Enhance the Databricks platform with performance and scalability improvements.
• Lead delivery of data and AI solutions, aligning with client requirements and outcomes.

Skills

Data engineering

Solution delivery

Cloud computing

Tools

Databricks

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your role and responsibilities

As a Data Engineer specializing in Data Platforms-Databricks, you will play a critical role in building and enhancing the Databricks platform for client's Data and AI use cases. This position is responsible for implementing Data and AI use cases on the Databricks platform.

Your primary responsibilities will include:

• Implement Data and AI Use Cases: Design, develop, and deploy data and AI solutions on the Databricks platform to meet client needs, driving business value through data-driven insights.
• Enhance Databricks Platform: Collaborate with stakeholders to identify areas for improvement and implement enhancements to the Databricks platform, ensuring optimal performance and scalability.
• Drive Solution Delivery: Lead the delivery of data and AI solutions, working closely with clients to understand their requirements and ensure successful project outcomes.

*This job can be performed from anywhere in the US.

Required technical and professional expertise

• Deep Expertise in Databricks: Proven experience with designing, developing, and deploying data and AI solutions on the Databricks platform, with a strong understanding of its architecture and capabilities.
• Experience with Data Engineering: Skilled in data engineering principles, including data processing, storage, and retrieval, with the ability to apply this knowledge to build scalable and efficient data pipelines.
• Cloud Computing Knowledge: Experience with cloud-based technologies and infrastructure, including migration, deployment, and management of cloud-based data platforms.
• Certification in Data and AI: Possession of relevant certifications in data engineering, data science, or AI, demonstrating expertise in implementing data and AI use cases on cloud-based platforms.
• Experience with Solution Delivery: Proven track record of leading the delivery of data and AI solutions, working closely with clients to understand their requirements and ensure successful project outcomes.

Preferred technical and professional experience

• Cloud Migration Expertise: Experience with migrating data platforms to cloud-based infrastructure, including planning, execution, and post-migration optimization. Ability to assess existing infrastructure and develop strategies for seamless migration to cloud-based environments.
• Advanced Data Engineering: Deep understanding of data engineering principles, including data warehousing, ETL, and data governance. Ability to design and implement scalable and efficient data pipelines, leveraging expertise in data processing, storage, and retrieval.
• AI Solution Development: Experience with developing and deploying AI solutions on cloud-based platforms, including natural language processing, machine learning, and deep learning. Ability to collaborate with stakeholders to identify business opportunities and develop AI-powered solutions to drive business value.

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.