Data Engineer

Crexi; Los Angeles (CA); In loco; USD 109.000 - 139.000; Tempo pieno

Descrizione del lavoro

A leading technology provider in commercial real estate is looking for a Data Engineer to build and optimize data pipelines. This role offers an opportunity to work with advanced technologies in a dynamic environment, contributing to significant business insights and improvements.

Competenze

• 5+ years of experience in developing data pipelines and databases.
• Experience building scalable data pipelines with Spark, Hive, Trino/Presto, etc.
• Familiarity with cloud services like AWS, Azure, or Google.

Mansioni

• Building and optimizing big data pipelines using AWS cloud services.
• Performing root cause analysis on data processes.
• Creating test suites and documentation for all pipelines.

Conoscenze

SQL

Python

Data Engineering best practices

Data structures

Algorithms

Formazione

BS degree in Computer Science or relevant work experience

Strumenti

AWS

Snowflake

Kafka

Hadoop

Descrizione del lavoro

Get AI-powered advice on this job and more exclusive features.

Crexi is transforming commercial real estate with advanced, integrative technology and data analytics designed to maximize CRE stakeholders’ success. From trading properties to AI-powered industry Intelligence, Crexi’s intuitive CRE solutions accelerate transaction velocity and empower millions of monthly users to close $540 billion in deals and market over $5 trillion in property value

What You'll Do

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of SQL/NoSQL databases and data stores like MSSQL , Dynamodb.
• Building and optimizing 'big data' data pipelines, architectures and data sets using AWS cloud services and SnowFlake
• Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management using DBT and Airflow or similar tools.
• Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores using Hadoop, Spark, Kafka, etc.
• Creating a strong test suite, alerting, monitoring and documentation for all the pipelines

Who You Are

• BS degree in Computer Science or relevant work experience
• 5+ years of experience in developing data pipelines and databases
• Proficient in Python and SQL
• Experience with Data Engineering best practices including Test Automation, Quality Controls, Reconciliation, Documenting data flows, etc.
• Have thorough knowledge of data structures and algorithms
• Have experience working with customers to understand and capture requirements
• Experience building highly scalable and reliable data pipelines using technologies like Spark, Hive, Trino/Presto, Airflow, Kafka, and/or Flink.
• Experience with data stores like Snowflake, Postgres, Feast

Pluses

• Experience with cloud service providers, including AWS, Azure, or Google
• Familiarity with Analytical tools like Tableau
• Knowledge of data service and deployment frameworks, including Docker, and Kubernetes
• Experience with data compliance and governance tools like OneTrust or DataGrail
• Experience with the Kafka

The anticipated salary range for candidates who will work in our Playa Vista, California location is $109,000 to $139,000. The final salary offered to a successful candidate will depend on several factors, which may include, but are not limited to, the type and length of experience applicable to the role and within the industry, education, geographic location, etc. Commercial Real Estate Exchange, Inc (“Crexi”) is a multi-state employer, and this salary range may not reflect positions that work in other states.

Crexi is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Crexi will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at Crexi by 2x

Sign in to set job alerts for “Data Engineer” roles.

Santa Monica, CA $95,300.00-$127,800.00 2 days ago

ML Software Engineer (L4/L5) - Media Algorithms

Glendale, CA $104,600.00-$153,500.00 4 weeks ago

Los Angeles, CA $114,000.00-$171,000.00 2 weeks ago

Los Angeles, CA $145,000.00-$204,000.00 2 weeks ago

Los Angeles Metropolitan Area 3 weeks ago

Long Beach, CA $132,000.00-$169,000.00 1 day ago

Burbank, CA $79,000.00-$133,000.00 1 week ago

Los Angeles, CA $141,000.00-$202,000.00 17 hours ago

Pasadena, CA $70,000.00-$125,000.00 12 hours ago

Santa Monica, CA $120,000.00-$190,000.00 1 month ago

Software Engineer, Game Support, Game Studio

Los Angeles, CA $86,700.00-$173,300.00 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.