Management Consultant - Data Engineer

IBM; Atlanta (GA); Remote; USD 120,000 - 170,000; Full time

Job summary

IBM Consulting in the United States is seeking a Data Engineer specializing in Data Platforms-Databricks. You will design, develop, and deploy data and AI solutions on the Databricks platform to meet client needs and drive business value.

You will collaborate with stakeholders to optimize the Databricks platform, scale data pipelines, and lead project delivery with clients to ensure successful outcomes. This role can be performed remotely from anywhere in the US.

Qualifications

• Experience designing, developing, and deploying data and AI solutions on Databricks.
• Strong data engineering principles for scalable data pipelines and storage.
• Certifications in data engineering, data science or AI demonstrate subject-matter mastery.

Responsibilities

• Implement data and AI use cases on the Databricks platform.
• Enhance Databricks platform performance and scalability.
• Lead delivery of data/AI solutions with clients to ensure successful outcomes.

Skills

Solution delivery

Data engineering

Cloud computing

Education

Data/AI certifications

Tools

Databricks

Cloud platforms

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your role and responsibilities

As a Data Engineer specializing in Data Platforms-Databricks, you will play a critical role in building and enhancing the Databricks platform for client's Data and AI use cases. This position is responsible for implementing Data and AI use cases on the Databricks platform.

Your primary responsibilities will include:

• Implement Data and AI Use Cases: Design, develop, and deploy data and AI solutions on the Databricks platform to meet client needs, driving business value through data-driven insights.
• Enhance Databricks Platform: Collaborate with stakeholders to identify areas for improvement and implement enhancements to the Databricks platform, ensuring optimal performance and scalability.
• Drive Solution Delivery: Lead the delivery of data and AI solutions, working closely with clients to understand their requirements and ensure successful project outcomes.

*This job can be performed from anywhere in the US.

Required technical and professional expertise

• Deep Expertise in Databricks: Proven experience with designing, developing, and deploying data and AI solutions on the Databricks platform, with a strong understanding of its architecture and capabilities.
• Experience with Data Engineering: Skilled in data engineering principles, including data processing, storage, and retrieval, with the ability to apply this knowledge to build scalable and efficient data pipelines.
• Cloud Computing Knowledge: Experience with cloud-based technologies and infrastructure, including migration, deployment, and management of cloud-based data platforms.
• Certification in Data and AI: Possession of relevant certifications in data engineering, data science, or AI, demonstrating expertise in implementing data and AI use cases on cloud-based platforms.
• Experience with Solution Delivery: Proven track record of leading the delivery of data and AI solutions, working closely with clients to understand their requirements and ensure successful project outcomes.

Preferred technical and professional experience

• Cloud Migration Expertise: Experience with migrating data platforms to cloud-based infrastructure, including planning, execution, and post-migration optimization. Ability to assess existing infrastructure and develop strategies for seamless migration to cloud-based environments.
• Advanced Data Engineering: Deep understanding of data engineering principles, including data warehousing, ETL, and data governance. Ability to design and implement scalable and efficient data pipelines, leveraging expertise in data processing, storage, and retrieval.
• AI Solution Development: Experience with developing and deploying AI solutions on cloud-based platforms, including natural language processing, machine learning, and deep learning. Ability to collaborate with stakeholders to identify business opportunities and develop AI-powered solutions to drive business value.

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.