Fast.ai Camera App for CNNs
source link: https://github.com/TylerNoblett/fastai-cnn-camera-app/blob/master/README.md
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Fast.ai CNN Camera App
Overview
This is a web app that allows a user to take a picture using an interface similar to a native camera app. After the picture is taken, it's sent to a fast.ai CNN model running on render . The modified server will the return a classification of the image along with related content.
There are a handful of prebuilt apps that allow a user to upload a photo ( this and this ), but I couldn't find an app that allowed the user to skip the step of manually uploading it.
I'd like to give a major shoutout to @abenjamin765 whose tutorial/repo was instrumental in creating this application.
Demo
Check out a demo app here . The demo app recognizes everyday objects (cars, people, trees, computers, chairs, etc).
Getting Started
To get started, fork this repo. A few things you'll need to change:
-
In
scripts.js
, changeconst url = "https://dc2.onrender.com/analyze"
to the url for your render endpoint. -
In
index.hmtl
, you may want to modify the starting app description (in<p id="content">
), the header (<h1 id="type">
), and the title<title>
. - Follow this guide to set up your render server if you haven't already.
-
In
server.py
in your render repo, change this linereturn JSONResponse({'result': str(prediction)})
to something like this. You can take a look at the server code for the demo project here .
# change the prediction into a string and capitalize it # to map it to items to grab the description prediction = str(prediction).capitalize() # Items contains the description text for each result items = { 'Tree': 'Trees are great!', 'Person': 'If you are reading this, you too are a person', 'Car': '4 wheels is all you need', 'Computer': 'A very useful tool', 'Pen': 'Useful for writing something down!', 'Desk': 'The perfect place to put your things', 'Chair': 'Ideal for sitting' } return JSONResponse({ 'result': prediction, 'content': items[prediction] })
Hosting
Github Pages
The easiest solution is github pages
; however, your repo must either be public or you'll need a paid github plan. Within the repo go to settings and search for github pages
to get started.
Netlify
Netlify is free and is only more marginally tedious to set up, and has a lot of great features that github pages doesn't have.
In the pipeline
I'm hoping to add support for flask and create a template server you can use if you'd prefer to use the app without render. Additionally, I'd like to make the content area within the app scrollable. If you'd like to contribute, just submit a PR!
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK