GitHub - kimhc6028/soft-decision-tree: pytorch implementation of "Distillin...
source link: https://github.com/kimhc6028/soft-decision-tree
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Soft-Decision-Tree
Soft-Decision-Tree is the pytorch implementation of Distilling a Neural Network Into a Soft Decision Tree, paper recently published on Arxiv about adopting decision tree algorithm into neural network. "If we could take the knowledge acquired by the neural net and express the same knowledge in a model that relies on hierarchical decisions instead, explaining a particular decision would be much easier."
Requirements
- python
- pytorch
Result
I achieved 92.95% of test dataset accuracy on MNISTafter 40 epoches, without exploring enough of hyper-parameters (The paper achieved 94.45%). Higher accuracy might be achievable with searching hyper-parameters, or training longer epoches (if you can, please let me know :) )
Usage
$ python main.py
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK