Databricks Data Engineer

ADP, Inc.; Washington (District of Columbia); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Large vacation allowance

Annual bonuses

401k matching

Paid training

100% health care coverage

Job summary

Square Peg Technologies is seeking a Data Engineer to design, implement, and maintain robust data pipelines for diverse customers. You will build automated data flows and models using cloud-based platforms and best practices in data engineering.

You'll work with Databricks, open to training programs, and contribute to AI/ML initiatives while collaborating with customers, academia, and industry leaders in the DoD, NASA and other agencies.

Qualifications

• Proficient in Python, SQL, and at least one other language such as Java.
• Experience designing data models and building databases to support business solutions.
• Understanding of SQL database structures and mapping data structures across SQL databases.
• Knowledge of API development techniques.
• Experience with cloud-based data management and ML platforms such as Databricks, Splunk, Cloudera, and Snowflake.
• Experience with cloud services like AWS.

Responsibilities

• Design, implement, and maintain data pipelines for customers.
• Develop automated pipelines for diverse data types and datasets.
• Leverage Databricks and related technologies to solve complex data problems.

Skills

Python

SQL

Java

Data modeling

API development

Databricks

AWS

Tools

Databricks

Splunk

Cloudera

Snowflake

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Full Time Washington, DC, US

30+ days ago Requisition ID: 1004

Clearance Required:

Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph.

Location:

Northern Virginia

The Mission:

Square Peg is seeking a Data Engineer to be responsible for designing, implementing, and maintaining data pipelines for our customers. The Data Engineer will develop automated pipelines for a variety of data types and datasets. Using Databricks, which was named to both the Magic Quadrant for Cloud Database Management Systems and the Magic Quadrant for Data Science and Machine Learning Platforms, you'll using best in class technology to help our customer solve some of their most challenging data problems.

Don't know Databricks, no problem! Sign up for our extensive training program to be a part of shaping the future of AI/ML

Basic Qualifications:

• Proficient with one or more programming languages (Python,SQL, Java)
• Prepare big data, implement data models and develop database to support the business solutions
• Understanding of SQL database structures and mapping data structures between different SQL databases
• Knowledge of API development techniques
• Demonstrated experience in data engineering, data processing and modeling techniques using cloud-based data management, data science, and ML platforms such as Databricks, Splunk, Cloudera, and Snowflake.
• Demonstrated experience with cloud based database services such as Databricks and AWS

Preferred Qualifications

• Experience with usingApache Spark and Hadoop to conduct large-scale data processing
• Extensive experience in Extract-Transform-Load (ETL) processes
• Demonstrated extensive experience with cloud services (AWS strongly preferred)
• Familiarity with open source data engineering tools and processes

Square Peg Technologies Company Information

Square Peg Technologies is a boutique technology consulting firm that specializes in data solutions using the latest technologies in analytics, data science, data engineering and data management. Our mission is to develop and integrate cutting edge technology solutions that inspire our customers to push the fields of science and technology forward. Here at Square Peg, you will not get lost in a crowd. We value each person’s contribution, celebrate wins together and invest in the personal and professional development of our employees. Along with a strong positive culture that allows employees to thrive and grow, we also offer top notch benefits to include a large amount of vacation, annual bonuses, 401k matching, paid training, and 100% health care coverage.

At Square Peg Tech, we aim to be at the forefront of technology and innovation. Our ideal candidate must be forward leaning and eager to engage with customers, academia and industry leaders on the future applications of AI/ML, as well as best practices in advanced analytics. With a firm footprint in theIntelligenceCommunity, Square Peg Tech is looking to expand its capabilities into the Department of Defense, NASA and other prominent government agencies.