Onsite Data Engineer - Spark, Python, Secret Clearance

DCI Solutions; New York (NY); On-site; USD 175,000 - 260,000; Full time

Benefits offered by this job

401(k)

401(k) matching

Dental insurance

Flexible schedule

Flexible spending account

Health insurance

Health savings account

Life insurance

Paid time off

Parental leave

Professional development assistance

Relocation assistance

Retirement plan

Tuition reimbursement

Vision insurance

Job summary

DCI Solutions is seeking a Data Engineer to join a cross-functional team in New York, NY onsite. You will integrate data, build components to support operational decisions, and ensure reliable data builds through monitoring and debugging.

The role covers data feed transfers, distributed transformations with Spark, and platform support as teams examine the data products. You will contribute to platform data footprint inquiries and collaborate with product teams to debug code.

Qualifications

• BS in Computer Science / Engineering (or related field)
• Proven data engineering background
• Experience with Spark, PySpark, and/or Pandas
• Extensive Python coding experience
• Extensive SQL/R experience
• Strong algorithms and data structures knowledge
• Foundry experience preferred
• Active Secret Security Clearance required

Responsibilities

• Act as a Data Engineer on a cross-functional team to address problems
• Integrate data, translate insights into usable formats, and build applications for operational decision-making
• Set up transfers of data feeds from source systems into the required data location
• Write transformations using Spark for distributed computation
• Monitor build progress and debug build issues
• Design application components addressing operational questions
• Support RFI requests related to platform data footprint
• Collaborate with product teams to debug code supporting the platform

Skills

Data engineering

Python coding

SQL

R

Education

BS in Computer Science / Engineering

Tools

Spark

PySpark

Pandas

Foundry

Job description

DCI Solutions is seeking a Data Engineer to join a cross-functional team in New York, NY onsite. You will integrate data, build components to support operational decisions, and ensure reliable data builds through monitoring and debugging.

The role covers data feed transfers, distributed transformations with Spark, and platform support as teams examine the data products. You will contribute to platform data footprint inquiries and collaborate with product teams to debug code.