6
netflix开源支持scala/spark/python的notebook
source link: https://zhuanlan.zhihu.com/p/88645498
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
netflix开源支持scala/spark/python的notebook
做数据分析和机器学习的对python的jupyter notebook都很熟悉了. 虽然jupyter 发展很快,现在也支持越来越多的内核,例如有社区开源的R/scala/Eilixir内核版本. 但是jupyter有很多短板,例如智能提示,代码补全等功能还是完全不能和pycharm等IDE相比.
网飞(netflix)公司近日开源了他们内部数据团队使用的polynote( https://polynote.org/). 官方介绍:
Polynote is a different kind of notebook. It supports mixing multiple languages in one notebook, and sharing data between them seamlessly. It encourages reproducible notebooks with its immutable data model.(Learn more)
本地下载试用了一下, 交互和智能提示还是很强大的.
下载:https://github.com/polynote/polynote/releases
安装指南:https://polynote.org/docs/01-installation.html
- 需要提前安装好python/JDK/SPARK, 设置好JAVA_HOME和SPARK_HOME. ubuntu的环境变量推荐使用/etc/profile.d/yourname.sh定义.
- >pip3 install numpy jep jedi pyspark virtualenv
- > ./ploynote
编辑于 2019-12-28
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK