Databricks Engineering Consultant

PowerToFly; Washington (District of Columbia); On-site; USD 98,000 - 163,000; Full time

Job summary

Deloitte AI & Data team seeks a Data Engineer II to map data flows and environments underpinning CIP across Databricks and Palantir Foundry. Youll partner with managers, analysts, and stakeholders to translate requirements into architecture diagrams and interface documentation, ensuring governance and security standards for financial data.

You'll work on governance, data lineage, and risk identification while collaborating with build teams for remediation and improved reliability in a dynamic

Qualifications

• Bachelor's degree in CS, Engineering, or related field.
• Authorized to work in the United States without sponsorship.
• Active U.S. Secret security clearance.

Responsibilities

• Map data flows, pipelines and integration points across Databricks and Palantir Foundry.
• Assess current-state data architecture, sources, interfaces, dependencies.
• Catalog data sources, transformation logic, and downstream consumers.
• Evaluate ETL/ELT patterns (PySpark, SQL) for quality and governance alignment.
• Translate requirements into architecture diagrams and system maps.
• Review pipelines and configurations; flag data quality gaps for remediation.
• Support design and monitoring of data governance standards for sensitive data.
• Prepare architectural assessments for leadership; compare current vs target states.

Skills

Independent work

Communication

Detail oriented

Relationship building

Project leadership

Time management

Interpersonal skills

Deadline driven

Guidance to others

Education

Bachelor's degree in Computer Science or Engineering

Tools

Databricks

Palantir Foundry

Gotham

Apollo

SQL

Python

Apache Spark

Job description

Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant impact on our clients' success. You'll work alongside talented professionals reimagining and reengineering operations and processes that are critical to businesses. Your contributions can help clients improve financial performance, accelerate new digital ventures, and fuel growth through innovation.

Work you'll do

The Audit AI & Automation Associate will support the assessment and mapping of the data, systems, and interface environment underpinning CIP, working across Databricks and/or Palantir Foundry ecosystems. This role acts as a junior architect, building a clear picture of how data moves, where it lives, and how systems connect - laying the groundwork for scalable, well-governed solutions. As a Data Engineer II on the AI & Data team, you will be responsible for:

• Map and document existing data flows, pipelines, and integration points across Databricks and/or Palantir Foundry environments.
• Assess current-state data architecture, including source systems, interfaces, and dependencies, to identify gaps, redundancies, and risks.
• Catalog data sources, transformation logic, and downstream consumers to establish clear data lineage.
• Evaluate existing ETL/ELT patterns (e.g., PySpark, SQL) for structure, quality, and alignment with governance standards, without owning day-to-day build work.
• Partner with technical managers, analysts, and business stakeholders to gather requirements and translate them into architecture diagrams, system maps, and interface documentation.
• Review data pipelines and system configurations to flag issues, gaps in data quality, and reliability concerns for remediation by build teams.
• Support the design, documentation, and monitoring of data governance standards for financial data under GDA programs.
• Prepare clear architectural assessments, findings, and recommendations for leadership, including current-state vs. target-state comparisons.
• Maintain strict adherence to security protocols when handling GDA-related financial information and system access.

A successful candidate would possess these skills:

• Ability to work independently and collaborate as part of a team
• Effective written and verbal communication skills
• Meticulous attention to detail and quality of work product
• Ability to build and sustain professional relationships
• Ability to lead projects or workstreams
• Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
• Strong interpersonal skills and professional demeanor
• Ability to meet deadlines
• Ability to provide clear guidance to others

The team

Deloitte's Government & Public Services (GPS) practice - our people, ideas, technology and outcomes - is designed for impact. Serving federal, state, & local government clients as well as public higher education institutions, our team of professionals brings fresh perspective to help clients anticipate disruption, reimagine the possible, and fulfill their mission promise.

Our AI & Data offering provides a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offerings help clients innovate, enhance and operate their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.

Qualifications

Required:

• Bachelor's degree in Computer Science, Engineering, or a related field
• Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.
• Must possess and maintain an active U.S. Secret security clearance
• 2+ years of experience working with Palantir Foundry, Gotham or Apollo
• 2+ years of experience with SQL, Python, or Apache Spark
• Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve.

Preferred:

• Experience supporting government, public sector, or higher education clients
• Active U.S. TS/SCI clearance preferred

For individuals assigned and/or hired to work in California, Deloitte is required by law to include a reasonable estimate of the compensation range for this role. This compensation range is specific to California and takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $97,700 to $162,800.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.