Databricks Consultant - Onsite NYC

thinkbridge; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

thinkbridge is a data engineering partner in the United States, delivering scalable data pipelines and analytics solutions using Databricks and cloud platforms.

We are seeking a Data Engineer to design and optimize ETL processes, collaborate with client teams, and ensure data quality across large datasets. Expect a growth-focused environment with opportunities to advance in Databricks, Spark, and PySpark projects.

Qualifications

• Must have: Bachelor’s degree in computer science, Data Engineering, or related field.
• 3+ years of experience in data engineering and pipeline development.
• Expertise in Databricks, Spark, and PySpark.
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Proficiency in Python or Scala.

Responsibilities

• Design and implement data pipelines using Databricks to process and transform large-scale datasets.
• Collaborate with the client's technical teams to gather requirements and create customized data solutions.
• Optimize Databricks clusters for performance, reliability, and cost efficiency.
• Implement ETL processes to ensure data quality, security, and accuracy.
• Provide guidance on best practices for leveraging Databricks for analytics and data engineering.
• Troubleshoot and resolve issues in data workflows and platform configurations.
• Stay updated with the latest Databricks features and industry trends to recommend innovative solutions.

Skills

Data engineering mindset

Analytical thinking

Cross-functional collaboration

Education

Bachelor’s degree in computer science or related field

Tools

Databricks

Spark

PySpark

Python

Scala

AWS

Azure

Google Cloud

ETL

Data Warehousing

Job description

thinkbridge is how growth-stage companies can finally turn into tech disruptors. They get a new way there - with world-class technology strategy, development, maintenance, and data science all in one place. But solving technology problems like these involves a lot more than code. That’s why we encourage thinkers to spend 80% of their time thinking through solutions and 20% coding them. With an average client tenure of 4+ years, you won't be hopping from project to project here - unless you want to. So, you really can get to know your clients and understand their challenges on a deeper level. At thinkbridge, you can expand your knowledge during work hours specifically reserved for learning. Or even transition to a completely different role in the organization. It's all about challenging yourself while you challenge small thinking.

thinkbridge is a place where you can:

• Think bigger - because you have the time, opportunity, and support it takes to dig deeper and tackle larger issues.
• Move faster - because you'll be working with experienced, helpful teams who can guide you through challenges, quickly resolve issues, and show you new ways to get things done.
• Go further - because you have the opportunity to grow professionally, add new skills, and take on new responsibilities in an organization that takes a long-term view of every relationship.

thinkbridge..there's a new way there.

What is expected of you?

As part of the job, you will be required to

• Design and implement data pipelines using Databricks to process and transform large-scale datasets.
• Collaborate with the client's technical teams to gather requirements and create customized data solutions.
• Optimize Databricks clusters for performance, reliability, and cost efficiency.
• Implement ETL processes to ensure data quality, security, and accuracy.
• Provide guidance on best practices for leveraging Databricks for analytics and data engineering.
• Troubleshoot and resolve issues in data workflows and platform configurations.
• Stay updated with the latest Databricks features and industry trends to recommend innovative solutions .

If your beliefs resonate with these, you are looking at the right place!

• Accountability -Finish what you started
• Communication-Context-aware, proactive, and clean communication
• Outcome -High throughput
• Quality -High-quality work and consistency
• Ownership -Go Beyond

Requirements

Must-Have:

• Bachelor’s degree in computer science, Data Engineering, or a related field.
• 3+ years of experience in data engineering and pipeline development.
• Expertise in Databricks, Spark, and PySpark .
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Proficiency in programming languages such as Python or Scala.
• Strong knowledge of ETL processes, data integration, and data warehousing concepts.
• Exceptional problem-solving and analytical skills.
• Strong communication skills to effectively collaborate with cross-functional teams.

Good to Have:

• Databricks certifications (e.g., Databricks Certified Data Engineer Associate or Professional).
• Experience with data visualization tools such as Tableau or Power BI.
• Familiarity with data governance frameworks and security best practices.
• 3-6Contract(Renewablebasedonperformance)
• Visa Type: AuthorizedtoworkintheUnitedStates