Data Engineer - Clearance Required

LMI Consulting, LLC; Pittsburgh (Allegheny County); On-site; USD 101,144 - 174,591; Full time

Job summary

LMI Consulting, LLC is seeking a Data Engineer in Pittsburgh with a Secret clearance. You will build and operate data pipelines in Palantir Foundry (Vantage) and Databricks, lead data engineering efforts, and collaborate with data scientists and software teams. On-site Pittsburgh preference, remote option available.

The role emphasizes leadership, technical mentorship, and advancing AI-enabled data solutions for Army AI2C mission applications.

Qualifications

• Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or related field, or equivalent work experience.
• 3-5 years of data engineering experience with Palantir Foundry (Vantage)
• Experience with Foundry pipeline development (PySpark/Pipeline Builder) and Foundry Workshop
• Databricks experience as a secondary platform (notebook, Delta Lake, Spark)
• Proficiency in Python and SQL for data manipulation
• Familiarity with data visualization tools for pipeline outputs
• Experience leading data pipelines and applying CI/CD practices
• Active Secret Clearance or ability to obtain one

Responsibilities

• Lead data engineering efforts within Palantir Foundry (Vantage) including ontology design and pipeline development.
• Build and optimize Foundry pipelines using PySpark and Foundry's framework.
• Develop data workflows in Databricks with notebooks and Delta Lake tables.
• Write robust Python/SQL code for Foundry Workshop or Slate apps.
• Integrate AI/ML capabilities into Foundry and Databricks apps.
• Mentor teammates and drive AI-forward development practices.
• Collaborate with data scientists, UX designers, and developers using Git and Agile methods.
• Engage Army stakeholders to expand development footprint.

Skills

Python

PySpark

SQL

Palantir Foundry (Vantage)

Databricks

Git

Agile

Communication

Education

Bachelor's degree in CS/related field

Master's degree (preferred)

Tools

Databricks

Git

Job description

Data Engineer - Clearance Required

Job Locations

US-PA-Pittsburgh | US-Remote

Job ID: 2026-14307

# of Openings: 1

Benefit Type: Salaried High Fringe/Full-Time

Overview

LMI is seeking a skilled Data Engineer to join our team and contribute to developing innovative software programs that support activities for the Army's AI2C organization, located in Pittsburgh, PA. This role is centered on building and operating data pipelines, ontologies, and applications within Palantir Foundry (Vantage), with secondary responsibilities extending into Databricks for large-scale data processing and analytics engineering. This position offers an opportunity to provide technical leadership while strategically growing the development footprint with the customer. Candidates should be comfortable working in a fast-paced, flexible environment and be self-directed, collaborative, and eager to grow technically. Candidates with the ability to be on-site in Pittsburgh are preferred.

LMI is a new breed of digital solutions provider dedicated to accelerating government impact with innovation and speed. Investing in technology and prototypes ahead of need, LMI brings commercial-grade platforms and mission-ready AI to federal agencies at commercial speed.

Leveraging our mission-ready technology and solutions, proven expertise in federal deployment, and strategic relationships, we enhance outcomes for the government, efficiently and effectively. With a focus on agility and collaboration, LMI serves the defense, space, healthcare, and energy sectors-helping agencies navigate complexity and outpace change. Headquartered in Tysons, Virginia, LMI is committed to delivering impactful results that strengthen missions and drive lasting value.

Responsibilities

Lead data engineering efforts within Palantir Foundry (Vantage), including ontology design, pipeline development, and data integration for Army AI2C mission applications

• Build, maintain, and optimize Foundry pipelines using Python-based transforms (PySpark/Pipeline Builder), Code Repositories, and Foundry's data connection framework
• Develop and maintain data engineering workflows in Databricks, including notebooks, Delta Lake tables, and Spark jobs, for workloads that complement or feed into the Foundry environment
• Write, design, and implement efficient, reusable, and reliable code using Python, PySpark, SQL, and TypeScript/JavaScript as needed for Foundry Workshop or Slate applications
• Translate complex data science and analytics outputs into governed, reusable data products surfaced through Foundry and Databricks
• Lead the integration of AI/ML capabilities into Foundry and Databricks-based applications, identifying opportunities to leverage emerging AI technologies (including Foundry AIP or Databricks ML/AI tooling)
• Champion AI-forward, platform-first development practices and guide the team in implementing AI/ML features and data-driven experiences
• Provide technical leadership and mentorship to grow the team's capabilities across Foundry (Vantage) and Databricks
• Identify and pursue opportunities to expand development initiatives with Army stakeholders
• Collaborate effectively with data scientists, UX designers, and software developers using Git, participating in code reviews and adopting Agile methodologies
• Engage with Army managers and representatives in a consultative capacity to identify data platform needs, explore innovative data-driven solutions including AI applications, and build strategic relationships that expand our development footprint
• Comfortable working independently and as a member of a team, with demonstrated ability to work in strategic and consultant-oriented environments
• Excellent verbal and written communication skills with ability to articulate technical concepts to non-technical stakeholders and influence strategic decisions

Qualifications

Minimum Qualifications

• Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or a related field, or equivalent work experience
• 3-5 years of experience in data engineering, with hands-on experience building and operating applications on the Palantir Foundry (Vantage) platform
• Demonstrated experience with Foundry pipeline development (PySpark/Pipeline Builder), Code Repositories, ontology/object modeling, and Foundry Workshop application building
• Working experience with Databricks, including notebooks, Delta Lake, and Spark-based data processing, as a secondary platform to Foundry
• Proficiency in Python and SQL for data manipulation and pipeline development (pandas, PySpark, numpy, or similar)
• Familiarity with data visualization approaches (D3.js, Plotly, Recharts, or Foundry-native Workshop widgets) for surfacing pipeline outputs
• Demonstrated experience in planning, analyzing, designing, implementing, testing, and maintaining data pipelines and applications for an enterprise-level system
• Familiarity with Git, Agile methodologies, CI/CD, and automated deployments
• Demonstrated experience in leadership roles, technical mentorship, or client relationship management
• Active Secret Clearance or ability to obtain one is required

Additional Preferred Qualifications

• Experience integrating AI/ML capabilities into Foundry or Databricks-based applications and identifying strategic AI use cases
• Familiarity with AI frameworks and APIs (OpenAI, Anthropic Claude, LangChain, or similar) and with Foundry AIP
• Knowledge of statistical analysis and machine learning concepts
• Experience with Storybook for component development, documentation, and design system management
• Hands-on deployment experience across multiple environments and platforms, including classified/air-gapped Foundry instances
• Knowledge of the Army software development process and its technologies or experience developing applications for classified data
• Background working in strategic planning or consultant environments supporting government or DoD clients
• Proven track record of expanding technical scope or footprint with government customers
• 7+ years of directly related experience
• Master's degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or related field
• On-site (Pittsburgh) candidates preferred

The target salary range for this position is $101,144 - $174,591.

The salary range displayed represents the typical salary range for this position and is not a guarantee of compensation. Individual salaries are determined by various factors including, but not limited to location, internal equity, business considerations, client contract requirements, and candidate qualifications, such as education, experience, skills, and security clearances.

Applicants must meet eligibility requirements for a U.S. Government security clearance. Only US Citizens are eligible for a security clearance. For this position, LMI will only consider applicants with security clearances or applicants who are eligible for security clearances, due to the nature of the work.

Percentage of Travel Required: 10%

Job Locations

US-PA-Pittsburgh

US-Remote

LMI is an Equal Opportunity Employer. LMI is committed to the fair treatment of all and to our policy of providing applicants and employees with equal employment opportunities. LMI recruits, hires, trains, and promotes people without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, pregnancy, disability, age, protected veteran status, citizenship status, genetic information, or any other characteristic protected by applicable federal, state, or local law. If you are a person with a disability needing assistance with the application process, please contact [e-mail]. Colorado Residents: In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information.