Data Engineer II

Microsoft

United States

On-site

USD 100,600 - 199,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Microsoft is seeking a Data Engineer II to design and optimize data solutions within the Microsoft Security AI team. This role focuses on enhancing security through advanced data pipelines and requires experience in data engineering and proficiency in programming languages like Python, Scala, or SQL.

Qualifications

2+ years experience in data engineering.
Building and optimizing large-scale data pipelines and architectures.
Understanding of machine learning workflows.

Responsibilities

Design and optimize data pipelines for model training and deployment.
Collaborate with researchers and engineers for data integration.
Drive innovation in data engineering.

Skills

Programming skills in Python

Programming skills in Scala

Programming skills in SQL

Expertise in distributed computing frameworks

Experience with cloud platforms

Education

Bachelor's Degree in Computer Science

Master's Degree in Computer Science

Job description

Join to apply for the Data Engineer II role at Microsoft

Get AI-powered advice on this job and more exclusive features.

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world.

As a Data Engineer II in the Models Engineering team within Microsoft Security AI, you will play a critical role in shaping the infrastructure and pipelines that power advanced security intelligence. Working at the intersection of cutting-edge AI research and real-world threat protection, you will design, optimize, and scale data solutions that enable high-performance model training and deployment. Your contributions will ensure that Microsoft Security remains at the forefront of AI-driven defense, providing robust, adaptive, and trustworthy protection across complex digital environments. In this role, precision, efficiency, and strategic thinking are paramount, as you help drive innovation in security technology while maintaining the highest standards of reliability and integrity.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

Design and optimize data pipelines to support efficient model training, evaluation, and deployment within Microsoft Security AI.
Collaborate with researchers and engineers to ensure seamless integration of large-scale datasets into AI-driven security solutions.
Develop scalable data solutions that enhance threat intelligence, anomaly detection, and security automation capabilities.
Ensure data integrity and reliability by implementing rigorous validation, monitoring, and governance practices.
Drive innovation in data engineering by exploring new technologies, architectures, and methodologies to improve AI security performance.

Qualifications

Required/Minimum Qualifications:

Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in data engineering, building and optimizing large-scale data pipelines and architectures.

OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in data engineering, building and optimizing large-scale data pipelines and architectures.
OR equivalent experience.

Programming skills in languages such as Python, Scala, or SQL for data processing and automation.
Expertise in distributed computing frameworks like Spark, Hadoop, or other cloud-based data solutions.
Experience with cloud platforms such as Azure, AWS, or GCP, with a focus on data storage, processing, and security.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred/Additional Qualifications

Understanding of machine learning workflows and data requirements for AI-driven security models.
Knowledge of cybersecurity principles and familiarity with threat intelligence or anomaly detection in security applications.

Data Engineering IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until June 1, 2025.

#MSFTSecurity #MSECAI #DataEngineering #AI #CyberSecurity #MicrosoftSecurity #CloudComputing #ThreatIntelligence #MachineLearning #BigData #SecurityAI #TechCareers

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Seniority level