Member of Technical Staff – Data Engineer

Microsoft; New York (NY); On-site; USD 117,000 - 230,000; Full time

Job summary

An established industry player is seeking passionate Data Engineers to join their dynamic team. In this role, you will build mission-critical data pipelines that support innovative AI solutions. You will collaborate with talented engineers and researchers, tackling complex challenges in a fast-paced environment. This position offers an opportunity to contribute to groundbreaking projects that empower individuals and organizations globally. If you are driven by a desire to innovate and make AI accessible to all, this role is perfect for you. Join a culture that values growth, inclusion, and collaboration as you help shape the future of technology.

Qualifications

• 4+ years of experience in software development or data engineering work.
• Proficiency in building data processing applications with Python, Java, or SQL.

Responsibilities

• Build scalable data pipelines for AI use cases.
• Collaborate with engineers and researchers to develop data platform products.

Skills

Python

Java

Spark

SQL

Data Modeling

Data Engineering

Problem Solving

Interpersonal Skills

Education

Bachelor's Degree in Computer Science

Master's Degree in Computer Science

Tools

Apache Hadoop

Kafka

NoSQL

Azure

AWS

GCP

Job description

As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad —to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.

Microsoft AI (MS AI) is seeking experienced Data Engineers to help build mission critical data pipelines that ingest, process and publish data streams from our personal AI, Copilot systems. We’re looking for someone who possesses technical prowess, a methodical approach to problem-solving, proficiency in big data processing technologies, and a mastery of templating to architect solutions that stand the test of time and who will bring an abundance of positive energy, empathy, and kindness to the team every day, in addition to being highly effective. The Data Platform Engineering team is responsible for building core data pipes that help fine tune models, support introspection and retrospection of data so that we can constantly evolve and improve human AI interactions.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

By applying to this U.S. New York, New York OR Mountain View, CA OR Redmond, WA position, you are required to be local to the New York OR San Francisco OR Seattle area and in office 3 days a week.

Responsibilities

1. Build scalable data pipelines for sourcing, transforming and publishing data assets for AI use cases.
2. Work collaboratively with other Platform, infrastructure, application engineers as well as AI Researchers to build next generation data platform products and services.
3. Ship high-quality, well-tested, secure, and maintainable code.
4. Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
5. Enjoy working in a fast-paced, design-driven, product development cycle.
6. Embody our Culture and Values.

Qualifications

Required Qualifications:

1. Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in software development, data modeling or data engineering work.
2. OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in software development, or data engineering work.
3. OR equivalent experience.
4. 4+ years technical engineering experience building data processing applications (batch and streaming) with coding in languages including, but not limited to, Python, Java, Spark, SQL.
5. Experience working with Apache Hadoop ecosystem, Kafka, NoSQL, etc.
6. 2+ years' experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP. Extensive use of datastores like RDBMS, key-value stores, etc.
7. 2+ years' experience building distributed systems at scale and extensive systems knowledge that spans bare-metal hosts to containers to networking.

Preferred Qualifications:

1. Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience.
2. Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security.
3. Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, designers, and other engineers.
4. Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders.
5. Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in web development and AI.
6. Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.
7. Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.

Data Engineering IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.

Microsoft will accept applications and processes offers for these roles on an ongoing basis.

#Copilot #MicrosoftAI

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.