3

GitHub - Oneflow-Inc/oneflow: OneFlow is a performance-centered and open-source...

 2 years ago
source link: https://github.com/Oneflow-Inc/oneflow
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

OneFlow

OneFlow is a performance-centered and open-source deep learning framework.

Latest News

  • Version 0.7.0 is out!
    • Introducing global tensor
    • Semi-auto parallelization has landed
    • Full changelog

Publication

  • OneFlow: Redesign the Distributed Deep Learning Framework from Scratch

  • Bibtex Citation

    @misc{yuan2021oneflow,
          title={OneFlow: Redesign the Distributed Deep Learning Framework from Scratch},
          author={Jinhui Yuan and Xinqi Li and Cheng Cheng and Juncheng Liu and Ran Guo and Shenghang Cai and Chi Yao and Fei Yang and Xiaodong Yi and Chuan Wu and Haoran Zhang and Jie Zhao},
          year={2021},
          eprint={2110.15032},
          archivePrefix={arXiv},
          primaryClass={cs.DC}
    }
    

Install OneFlow

System Requirements

  • Linux. As for now, there is no pre-built release for macOS, Windows.

  • Python 3.6, 3.7, 3.8, 3.9, 3.10

  • (Highly recommended) Upgrade pip

    python3 -m pip install --upgrade pip #--user
    
  • CUDA Toolkit Linux x86_64 Driver

    • CUDA runtime is statically linked into OneFlow. OneFlow will work on a minimum supported driver, and any driver beyond. For more information, please refer to CUDA compatibility documentation.

    • Please upgrade your Nvidia driver to version 440.33 or above and install OneFlow for CUDA 10.2 if possible.

Install with Pip Package

  • To install latest stable release of OneFlow with CUDA support:

    python3 -m pip install -f https://release.oneflow.info oneflow==0.7.0+cu102
  • To install nightly release of OneFlow with CUDA support:

    python3 -m pip install --pre oneflow -f https://staging.oneflow.info/branch/master/cu102
  • To install other available builds for different variants:

    • Stable
      python3 -m pip install --find-links https://release.oneflow.info oneflow==0.7.0+[PLATFORM]
    • Nightly
      python3 -m pip install --pre oneflow -f https://staging.oneflow.info/branch/master/[PLATFORM]
      
    • All available [PLATFORM]:
      Platform CUDA Driver Version Supported GPUs
      cu112 >= 450.80.02 GTX 10xx, RTX 20xx, A100, RTX 30xx
      cu102 >= 440.33 GTX 10xx, RTX 20xx
      cpu N/A N/A
  • If you are in China, you could run this to have pip download packages from domestic mirror of pypi:

    python3 -m pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple
    

    For more information on this, please refer to pypi 镜像使用帮助

Use docker image

docker pull oneflowinc/oneflow:nightly-cuda10.2
docker pull oneflowinc/oneflow:nightly-cuda11.2

Build from Source

Clone Source CodeBuild OneFlow

Troubleshooting

Please refer to troubleshooting for common issues you might encounter when compiling and running OneFlow.

Advanced features

XRT

Getting Started

Documentation

Model Zoo and Benchmark

Communication

  • GitHub issues: any install, bug, feature issues.

  • www.oneflow.org: brand related information.

    • QQ 群: 331883
    • 微信号(加好友入交流群): OneFlowXZS
    • 知乎
  • International

The Team

OneFlow was originally developed by OneFlow Inc and Zhejiang Lab.

License

Apache License 2.0


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK