Salesforce Principal Engineer

Cloud Analytics Technologies, LLC; Sunnyvale (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

CLOUD ANALYTICS TECHNOLOGIES, LLC in Sunnyvale, CA invites a Back-End Engineer with data engineering depth to design and maintain scalable data pipelines and back-end systems. You will work with Spark, Python, Scala, Java, SQL, DataFrames, and cloud storage (S3) in AWS/GCP to deliver reliable data solutions.

Join a collaborative team including data scientists to ensure data quality and security. Requirements include a BS in CS or related field and 5+ years in back-end data engineering.

Qualifications

• Bachelor's degree in computer science or related field or equivalent experience.
• 5+ years of back-end development with a focus on data engineering.

Responsibilities

• Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
• Write efficient and optimized SQL queries for ETL processes.
• Work with DataFrames to manipulate and analyze large datasets.
• Implement data storage and processing solutions using cloud technologies (AWS/GCP).
• Build and maintain real-time data streaming pipelines using MSK/Kafka.
• Utilize S3 for data storage and retrieval.
• Work with data lake technologies like Iceberg.
• Ensure data quality, integrity, and security.
• Collaborate with data scientists and other engineers to understand data requirements.
• Participate in code reviews and contribute to improving development processes.
• Troubleshoot and resolve issues in data pipelines and back-end systems.

Skills

Spark

Python

Scala

Java

SQL

DataFrames

AWS

GCP

Kafka

S3

Iceberg

Data warehousing

Communication

Education

Bachelor's degree in computer science or related field

Tools

Cloud platforms (AWS/GCP)

Job description

About the Role

We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.

Responsibilities

• Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
• Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
• Work with DataFrames to manipulate and analyze large datasets.
• Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).
• Build and maintain real-time data streaming pipelines using MSK/Kafka.
• Utilize S3 for data storage and retrieval.
• Work with data lake technologies like Iceberg.
• Ensure data quality, integrity, and security.
• Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.
• Participate in code reviews and contribute to improving our development processes.
• Troubleshoot and resolve issues in data pipelines and back-end systems.

Qualifications

• Bachelor's degree in computer science or a related field (or equivalent experience).
• 5+ years of experience in back-end development with a focus on data engineering.

Required Skills

• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and working with relational databases.
• Experience with DataFrames for data manipulation and analysis.
• Experience with cloud technologies (preferably AWS or GCP).
• Experience with message streaming platforms like MSK/Kafka.
• Experience with S3 or similar object storage.
• Experience with data lake technologies like Iceberg.
• Solid understanding of data warehousing concepts.
• Excellent communication and collaboration skills.

Bonus Points

• Experience with data modelling and schema design.
• Experience with data governance and data quality management.
• Experience with DevOps practices and CI/CD pipelines.
• Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).

Equal Opportunity Employer

CLOUD ANALYTICS TECHNOLOGIES is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract.

CLOUD ANALYTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract.

Some of our Business Ventures - Knowledge Analytics

Do restrictive necessities, your capability for advanced analytics or your business model need custom-made applications and infrastructure configurations? opt for our hosted managed services to urge comprehensive analytics solutions supported industry-leading Cloud Analytics Technologies, LLC code - delivered by the Cloud Analytics Technologies, LLC consultants UN agency understand these solutions best. Through a mix of with-it technology and dedicated service and support, Cloud Analytics Technologies, LLC hosted managed services will facilitate you: