Senior Data Engineer
Skills
- Expertise in Databricks SQL, Spark SQL, and PySpark for data processing.
- Experience using Pandas and Databricks Delta Lake.
- Familiarity with Databricks workspace, clusters, jobs/workflows, and notebooks.
- Strong SQL tuning and query optimization skills.
- Experience with Databricks REST API for automation and integration.
Responsibilities
- Build and maintain batch and real-time, fault-tolerant data pipelines using Databricks and Spark.
- Lead complex program implementations and provide consultation on data engineering solutions.
- Develop and maintain comprehensive documentation for systems and projects.
- Tune distributed queries processing billions of rows for optimum performance.
- Perform root cause analysis to resolve software and business process issues.
Education
- Bachelor's or Master's degree in Engineering, Mathematics, Statistics, Computer Science or related quantitative fields.
Benefits
- Flexible remote and hybrid working options (location dependent).
- Career advancement opportunities including international mobility.
- Professional development programs and access to cutting-edge tools and expert training.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Senior Data Engineer role at StubHub to develop robust data infrastructure and drive innovation in a hybrid work environment.
Valorem Reply is seeking a seasoned Data Engineer 3 to design and implement scalable ETL solutions that drive data-driven business transformation.
An experienced Data Engineer is sought to develop scalable AWS data lakes and pipelines supporting AI/ML initiatives for a government-focused consulting firm.
Careforth is looking for a Data Engineer I experienced with Python, SQL, and large-scale data processing to help build scalable data systems supporting caregiving services nationwide.
Samsara seeks a Senior Data Engineer to build and optimize scalable data pipelines and platforms that drive data-driven decisions across global operations in a fully remote role.
BlackRock is hiring an Analyst - Data Engineering to develop and maintain scalable data pipelines within their Market Data team under a hybrid work model in Atlanta, GA.
Senior Data Engineer opportunity at FanDuel Group to lead development of scalable and performant data platform solutions with a focus on governance and operational excellence.
Experienced Data Engineer needed at Tyto Athene to develop and maintain scalable data lake solutions supporting mission-critical military operations in Doral, FL.
Help shape the future of compliance training at EasyLlama as a Senior Data Engineer building impactful, scalable data solutions in a fully remote environment.
Brillio is seeking a skilled Lead Data Engineer to lead cloud migration and development of scalable data pipelines using Google Cloud Platform and modern data engineering tools.
Experienced data engineer with strong Oracle expertise and active TS/SCI clearance needed to advance large-scale data solutions in a fast-paced IC setting.
Seeking an experienced Senior Data Engineer with Oracle expertise and TS/SCI clearance to enhance enterprise data systems in a dynamic IC setting.
Mercury Insurance is hiring a Data Engineer II to design and maintain cloud-based big data solutions that empower analytics and data science teams across the organization.
Headquartered in London, UK, Valtech SE operates as an advanced technology consulting group. The Company offers internal applications for project delivery, skills transfer, and enterprise planning. Valtech serves automotive, travel and hospitality...
1 jobs
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
