270
GitHub - huggingface/swift-coreml-transformers: Swift Core ML 3 implementations...
source link: https://github.com/huggingface/swift-coreml-transformers
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
README.md
Swift Core ML implementations of Transformers: GPT-2, BERT, more coming soon!
This repository contains:
- For BERT:
- a pretrained Google BERT model fine-tuned for Question answering on the SQuAD dataset.
- Swift implementations of the BERT tokenizer (
BasicTokenizerandWordpieceTokenizer) and SQuAD dataset parsing utilities. - A demo question answering app.
- For GPT-2:
- a conversion script from Pytorch trained GPT-2 models (see our
pytorch-transformersrepo) to CoreML models. - The GPT-2 generation model itself, including decoding strategies (greedy and TopK are currently implemented) and GPT-2 Byte-pair encoder and decoder.
- A neat demo app showcasing on-device text generation.
- a conversion script from Pytorch trained GPT-2 models (see our
? GPT-2
Unleash the full power of text generation with GPT-2 on device!!
? BERT
The pretrained Core ML model was packaged by Apple and is linked from the main ML models page. It was demoed at WWDC 2019 as part of the Core ML 3 launch.
? Demo Time ?
Apple demo at WWDC 2019
full video here
BERT Architecture (wwdc slide)
Notes
We use git-lfs to store large model files and it is required to obtain some of the files the app needs to run.
See how to install git-lfson the installation page
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK