TransWikia.com

Has anyone succeeded in finding a good Scala/Spark kernel for Jupyter?

Data Science Asked by Varun Gawande on September 17, 2020

The ones I’ve tried so far

Almond: Works very well for just Scala, but you have to import dependencies, and it gets tedious after a while. And unfortunately can’t run when using Spark with YARN instead of Local.

Spylon-kernel: Kernels connects, but gets stuck in the initializing stage.

Apache Toree: I would’ve loved this so much only if it worked. Lots of language support, magics, incubated by apache. However, this kernel doesn’t connect. Get’s stuck on the "Kernel Connecting" stage.

Are we to never run Spark with the freedom and flexibility of Jupyter?
What curse is this?

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP