Data Engineer - Databricks
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote.
Pay: $100-130/hr
US Citizens or GC Holders Only
No c2c - W2 Only
Qualifications:
- Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field
- 7+ years of experience in designing and building large-scale solutions in an enterprise setting
- 3+ years designing and building solutions in the cloud
- Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architectures
- Expertise in building Cloud Database Management Systems in Databricks Lakehouse or analogous architectures
- Deep SQL expertise, data modeling, and experience with data governance in relational databases
- Experience with data warehousing concepts, methodologies, and frameworks using technologies like Vertica, Teradata, SparkSQL, Hadoop, Kafka
- Refined skills using scripting languages (e.g., Python, bash)
- Ability to design and develop data pipelines considering security, scalability, uptime, and reliability
- Expertise in relational and dimensional data modeling
- UNIX administration and general server administration experience
- Experience with CI/CD pipelines
- Experience with Big Data query and transformation tools such as Presto, Hive, SparkSQL, Cassandra, Solr (plus)
- Experience using Spark, Kafka, Hadoop or similar distributed data technologies (plus)
- Experience with Agile methodologies (preferred)
- Experience with ETL/ELT tools like Talend, Informatica (plus)
- Experience with Cloud Data Warehouses such as Redshift, BigQuery or similar (plus)