Associate Data Engineer 2027 - AI & Data Analytics

IBM

San Francisco (CA)

On-site

USD 71,000 - 107,000

Full time

4 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

IBM is seeking an Associate Data Engineer in California to design, build, and improve data platforms and services that support analytics, AI, and machine learning initiatives. You will work across data gathering, ingestion, transformation, storage, and real-time processing while ensuring data quality and governance.

You will collaborate with diverse teams, leverage modern data stack tools, and contribute to scalable cloud-based data architectures that power AI-enabled decision making.

Qualifications

Foundational understanding of data engineering concepts and data pipelines.
Basic understanding of cloud computing environments (AWS/Azure/Google Cloud/IBM Cloud).
Ability to apply basic statistical or ML concepts to data tasks.
Interest in AI/ML, generative AI, or enterprise AI platforms.
Strong analytical thinking, problem solving, and teamwork.

Responsibilities

Design, build, and improve data platforms, products, and services supporting analytics and AI solutions.
Optimize data pipelines and data services for performance, reliability, and data quality.
Collect and analyze structured and unstructured data to provide actionable insights.
Collaborate with clients, architects, and AI engineers to translate requirements into solutions.
Establish data governance, lineage, and observability across pipelines and systems.

Skills

Data pipelines

Databases

APIs

ETL/ELT

Data modeling

Cloud computing basics

AI/ML interest

Teamwork

Communication skills

Education

High School Diploma/GED

Bachelor's Degree

Tools

Spark

Hadoop

Kafka

Airflow

dbt

Databricks

Snowflake

Delta Lake

Linux

Job description

Ready to think boldly, work with some of the world's most recognized brands, and kick-start your career? Welcome to IBM's Associate Program for university hires. From day one, you will collaborate with global clients and IBM teams on projects that help organizations solve tough challenges across digital transformation, cloud strategy, AI adoption, process redesign, analytics, modern data platforms, and agentic AI-enabled data transformation.

As an Associate, you will work alongside a global cohort of diverse, ambitious peers and have access to industry-recognized certifications, digital badges, and a minimum of 40 hours of structured learning per year on IBM's AI-driven learning platform, supported by coaches, mentors, and professional communities across practices. IBM's culture of internal mobility means you can explorenew technologies, industries, and career paths as your interests evolve.

Bring your curiosity. Grow your skills. Build what's next - like an IBMer. This role is a strong fit for builders who like turning messy data into reliable systems and who want to help make analytics, generative AI, and AI agents useful, reliable, and safe through governed data, trustworthy context, observable pipelines, and secure interfaces to enterprise systems.

Your role and responsibilities

As an Associate Data Engineer, you will help design, build, and improve data platforms, data products, and services that support analytics, machine learning, generative AI, and agentic AI solutions. You will work across data gathering, ingestion, transformation, storage, batch and real-time processing, semantic enrichment, retrieval, APIs, visualization, data quality, observability, and governance.

Collaborating closely with diverse teams, you will playan important rolein selecting suitable data management systems andidentifyingthe critical data needed for insightful analysis. As a Data Engineer, you will help tackle challenges related to database integration, data quality, and complex structured and unstructureddatasets.

Key Responsibilitiesmay include:

Assisting designing and implementing scalable data architecture, data products, and management systems for modern cloud environments, analytics, and AI-enabled use cases.
Work on optimizing existing data pipelines, retrieval indexes, and data services for improved performance, reliability, data quality, and freshness of AI-ready context.
Collect, prepare, and analyze structured, semi-structured, and unstructured data to identify trends, providing clients with actionable insights that enhance marketing, operational, and business practices.
Participate in troubleshooting data-related issues, working to solve data quality challenges, retrieval-quality gaps, processing failures, and inconsistencies affecting analytics, generative AI, or agentic workflows.
Create visually compelling and user-friendly dashboards, reports, and observability views to communicate findings, pipeline health, and AI system insights to both technical and non-technical stakeholders.
Ensure data integrity, accuracy, reliability, lineage, and access control through rigorous data cleaning, validation, preprocessing, cataloging, and governance practices.
Work with project teams to prioritize and translate client requirements into current and future operational scenarios, processes, models, use cases, data products, APIs, tool interfaces, plans, and solutions; collaborate with clients, architects, and AI engineers.
Present analytical findings, data quality insights, and recommendations clearly and concisely, demonstrating the value of data-driven and AI-enabled decision-making to clients.
Work with cross-functional teams to tackle complex business problems, utilizing data expertise across cloud platforms, RAG, vector search, APIs, responsible AI, and agent orchestration patterns while staying current on modern data stack trends.

Consulting And Collaboration Skills

Analyze business processes and application portfolios to identify where teams need better data, context, tools, automation, or process optimization.
Use Agile ways of working, planning, and project-management practices to deliver production-ready data and AI solutions.
Communicate with curiosity, clarity, and empathy; ask insightful questions about data meaning, risk, governance, and business impact.

Required education

High School Diploma/GED

Preferred education

Bachelor's Degree

Required technical and professional expertise

High School Diploma/GED.
Foundational understanding of data engineering concepts, including data pipelines, databases, APIs, distributed processing, ETL/ELT, data modeling, or data products.
Basic understanding of cloud computing environments such as AWS, Azure, Google Cloud, IBM Cloud, or similar platforms.
Ability to apply foundational statistical, machine learning, or information retrieval concepts to data preparation, analysis, search, or model-support work.
Interest in AI/ML, generative AI, agentic AI, intelligent automation, RAG, LLM-powered systems, or enterprise AI platforms.
Strong analytical thinking, problem solving, adaptability, teamwork, and communication skills.
Willingness to travel up to 100%, based on project requirements.

Preferred technical and professional experience

Bachelor’s degree in a related field such as Computer Science, Data Science, Statistics, Mathematics, MIS, Engineering, AI/ML, or another quantitative field.
Coursework, projects, internship experience, or portfolio work involving data engineering, software engineering, cloud platforms, analytics, AI/ML, or modern data products.
Experience with technologies such as Spark, Hadoop, Kafka, Airflow,dbt, Databricks, Snowflake, Delta Lake, Linux, or similar platforms.
Familiarity with LLMs, embeddings, vector databases such as Pinecone,Weaviate, orpgvector, retrieval systems, prompt workflows, RAG, and AI agent architectures.
Exposure to orchestration and agentic AI frameworks such asLangChain,LangGraph,LlamaIndex, Semantic Kernel, AutoGen, MCP-based tooling, or similar tools.
Understanding of Git, containers, APIs, testing frameworks, CI/CD, Kubernetes, observability, data governance, privacy, security, or responsible AI practices.
Preferred certifications, coursework, or credentials such asSnowProCore, Google Associate Cloud Engineer, Google Data Engineer coursework, or related cloud/data credentials.
Familiarity with AI coding tools and GenAI concepts, including prompt engineering, RAG, fine-tuning, and model evaluation.

ABOUT BUSINESS UNIT

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS

IBM offers a competitive and comprehensive benefits program. Eligible employees may have access to:

Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being
Financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long- term disability coverage, and opportunities for performance based salary incentive programs
Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs. IBM also offers paid family leave benefits to eligible employees where required by applicable law
Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals
Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences

We consider qualified applicants with criminal histories, consistent with applicable law.

This position was posted on the date cited in the key job details section and is anticipated to remain posted for 21 days from this date or less if not needed to fill the role.

IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship.

The compensation range and benefits for this position are based on a full-time schedule for a full calendar year. The salary will vary depending on your job‑related skills, experience and location. Pay increment and frequency of pay will be in accordance with employment classification and applicable laws. For part time roles, your compensation and benefits will be adjusted to reflect your hours. Benefits may be pro‑rated for those who start working during the calendar year.

Job Title

Date posted

14-Aug-2026

Job ID

128609

City / Township / Village

State / Province

California

Country

United States

Work arrangement

Onsite