Direct message the job poster from Stellar Consulting Solutions, LLC
Senior Technical Recruiter @ Stellar Consulting Solutions, LLC
In addition to strong Power BI expertise, the ideal candidate should have working knowledge of Microsoft Fabric, Data Pipelines, and PySpark notebooks.
Key Responsibilities:
- Design and implement scalable data pipelines using PySpark notebooks, Spark SQL, and Python (covering ingestion, transformation, and loading processes).
- Troubleshoot and resolve complex issues related to Spark core internals, Spark SQL, Structured Streaming, and Delta.
- Monitor and optimize data pipelines to improve performance and efficiency across large-scale datasets.
- Ensure data security and compliance with relevant data privacy regulations throughout the engineering process.
- Build and maintain infrastructure to support efficient extraction, transformation, and loading (ETL) from diverse data sources.
Seniority level
Employment type
Job function
Industries
- IT Services and IT Consulting
Referrals increase your chances of interviewing at Stellar Consulting Solutions, LLC by 2x
Get notified about new Architect jobs in Marietta, GA.
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.