TS/SCI Databricks Data Engineer — Cloud Pipelines

Square Peg Technologies; Washington (District of Columbia); On-site; USD 110,000 - 140,000; Full time

Job summary

Square Peg Technologies is seeking a Data Engineer to design, implement, and maintain data pipelines for diverse datasets and customer solutions. The role leverages Databricks and cloud data management to enable AI/ML initiatives.

The candidate will participate in extensive training and must bring proficiency in Python/SQL/Java, API development, and data modeling, with experience in cloud platforms like AWS and Snowflake.

Qualifications

• Proficient in Python, SQL or Java and API development.
• Experience with big data modeling and data pipelines.
• Familiar with cloud data platforms including Databricks and AWS.
• Knowledge of SQL databases and data mapping.
• Experience with Spark/Hadoop for large-scale processing.

Responsibilities

• Design, implement, and maintain data pipelines for customers.
• Develop automated pipelines for diverse data types and datasets.
• Leverage Databricks and related cloud platforms to solve data problems.
• Participate in training programs to stay current with AI/ML technologies.

Skills

Python

SQL

Java

API development

Data modeling

Tools

Databricks

Splunk

Cloudera

Snowflake

AWS

Job description

Square Peg Technologies is seeking a Data Engineer to design, implement, and maintain data pipelines for diverse datasets and customer solutions. The role leverages Databricks and cloud data management to enable AI/ML initiatives.

The candidate will participate in extensive training and must bring proficiency in Python/SQL/Java, API development, and data modeling, with experience in cloud platforms like AWS and Snowflake.