Paperspace for fast.ai

These notes correspond to first 12 minutes of lesson 1 video.
Note: These notes are more up-to-date and comprehensive than the video.

About

Paperspace is a GPU accelerated cloud platform
Paperspace login: https://www.paperspace.com
- create account
- 🔑 save user name and password somewhere where you can find it
- click on confirmation email to activate account
Paperspace runs on their own machines (unlike Crestle, which runs on top of AWS)

Reference

Setup Fastai v1 on Paperspace
If you run into problems opening Jupyter Notebooks on Paperspace, this might help (@Etrama):
https://medium.com/@kaushikmoudgalya/my-adventures-with-paperspace-day-1-connection-issues-ff7c390b1a48

Summary of Charges

STORAGE
- 50 GB ($5/month)
- 100 GB ($7/month)
- 250 GB ($10/month)
USAGE
- M4000: $0.51/hr
- P4000: $0.51/hr
- P5000: $0.78/hr
PUBLIC IP ADDRESS: $3/month (single static IP address)
Note: There is a $15 credit code you can use: FASTAI10TL. This code is only for fastai students.
- If this code is unavailable, visit the fast.ai forums for user promo codes (generally $5).

Paperspace Support

Technical support, email support@paperspace.com
Forum thread
- can post any questions here: http://forums.fast.ai/t/paperspace-setup-help/9290
- can ping @dillon

Part I: Creating a Machine

Step 1: Where to start

click on this link: https://www.paperspace.com/console/machines

Step 2: Create a new machine

select green button New Machine

Step 3: Choose region

pick a data center
Regions: there are 3 regions available
- West Coast (California)
- East Coast (New York)
- Europe
pick the one closest to you; (for me it is East Coast (NYC)); if a region is unavailable, try another region. (West Coast may be unavailable for some machines).

Step 4: Choose template

Select Public Templates
Select icon for fast.ai
Ignore warning about contacting Paperspace about this template. It applies to the default selected, not fastai.

Step 5: Choose machine

there are various machines with charges noted by the hour
Paperspace is cheaper than Crestle, with fast machines
if you choose the P4000 or P5000 machine, it may ask you to contact Paperspace asking why (anti-fraud step); let them know it is for fast.ai and they will get you up and running (this may take several days...)
Machines to choose (whichever you prefer and is available in your region of choice)
- the M4000 (cheap, no paperspace authorization needed)
- the P4000 (~2x M4000 and same price, but must get authorization)
- the P5000 (better P4000, more expensive, need auth.)

Step 6: Choose storage

note that you pay for storage as soon as you start the machine up
select 50 GB option; unless you are sure you need more (applies to data storage only, not OS install)
storage costs are pro-rated (like compute (or "usage") costs)

Step 7: Options

turn ON Public IP (cost is $3/month)
turn OFF Auto Snapshot (to save money on doing back-ups)

Step 8: Payment

add in promo code
add in credit card information (required, even if you have a promo code)

Step 9: Create machine

select Create your Paperspace box
you'll see the new machine "provisioning"
It may take several hours (4-5 hrs) to receive the confirmation email from Paperspace due to high demand
you'll receive an email with subject "Your new Paperspace Linux machine is ready"
- a temporary password will be included in that email

Your temporary sign-in password for machine New Machine 1 is: *************

You can ssh into your new machine with the following command:ssh paperspace@184.###.###.###

Happy computing!
- The Paperspace Team

Part II: Logging into Paperspace Fastai Image Machine

select the machine in Paperspace
press "Start"
press "Open" to use the Paperspace console, or use ssh from local machine terminal
copy password from email
paste in terminal
- Windows: Ctrl + Shft + v
- Mac: Cmd + v
notice the prompt (fastai) paperspace@psnqh1ltz:~$

Warning: Permanently added '10.64.22.222' (ECDSA) to the list of known hosts.
paperspace@10.64.50.184's password: 
Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.4.0-104-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

Last login: Thu Jan  4 16:47:39 2018 from ###.###.###.###
(fastai) paperspace@psgyqmt1m:~$

list the files

ls lists all the files

(fastai) paperspace@psgyqmt1m:~$ ls
anaconda3  data  downloads  fastai

list the data files

ls data lists the data contents for first part of this course

(fastai) paperspace@psgyqmt1m:~$ ls data
dogscats  dogscats.zip

list fastai files

ls fastai lists everything for this course

(fastai) paperspace@psgyqmt1m:~$ ls fastai
CODE-OF-CONDUCT.md  courses  environment.yml  fastai  LICENSE  MANIFEST  MANIFEST.in  README.md  README.rst  requirements.txt  setup.cfg  setup.py  tutorials
(fastai) paperspace@psgyqmt1m:~$

🔴 Part III: Updating fastai repo contents

🔑 this step is important as having updated content and libraries can bypass errors

Step 1: go to directory

cd fastai

(fastai) paperspace@psnqh1ltz:~$ cd fastai
(fastai) paperspace@psnqh1ltz:~/fastai$ pwd
/home/paperspace/fastai
(fastai) paperspace@psnqh1ltz:~/fastai$

Step 2: update repo

git pull

from time to time, you should pull the latest fastai repo from GitHub

(fastai) paperspace@psnqh1ltz:~/fastai$ git pull
Already up-to-date.

Step 3: update Python / Anaconda libraries

conda env update

do this from time to time (every few weeks)

Step 4 (optional): Update password and apply root password

passwd and sudo passwd

Current password = temp from Paperspace email
Root (sudo) currently has no password... we should set that too.

(fastai) paperspace@psjs5366a:~$ passwd
Changing password for paperspace.
(current) UNIX password:
Enter new UNIX password:
Retype new UNIX password:
passwd: password updated successfully
(fastai) paperspace@psjs5366a:~$ sudo passwd
Enter new UNIX password:
Retype new UNIX password:
passwd: password updated successfully
(fastai) paperspace@psjs5366a:~$

Part IV: Paperspace & Jupyter Notebook

Step 1: `cd` into fastai directory

make sure you are here: /home/paperspace/fastai

(fastai) paperspace@psgyqmt1m:~/fastai$ pwd
/home/paperspace/fastai
(fastai) paperspace@psgyqmt1m:~/fastai$

Step 1.5: Fix Jupyter Notebook config file

jupyter notebook --generate-config

The config file was previously set up by default to allow remote access, but updated jupyter notebook breaks.

(fastai) paperspace@psgyqmt1m:~/fastai$ jupyter notebook --generate-config
Overwrite /home/paperspace/.jupyter/jupyter_notebook_config.py with default config? [y/N]

Step 2: Launch Jupyter Notebook (now with more config!)

jupyter notebook --no-browser --port=8889 --NotebookApp.allow_remote_access=True

the config settings can be written permanently into /home/paperspace/.jupyter/jupyter_notebook_config.py.
The reason to change port=8889 will be clear in a minute.

(fastai) paperspace@psgyqmt1m:~/fastai$ jupyter notebook --no-browser --port=8889 --NotebookApp.allow_remote_access=True
[I 20:37:41.604 NotebookApp] Serving notebooks from local directory: /home/paperspace/.jupyter
[I 20:37:41.605 NotebookApp] The Jupyter Notebook is running at:
[I 20:37:41.605 NotebookApp] http://localhost:8889/?token=a7a724c1ba8d4c91132834c2d076298f517002227d4e8a72
[I 20:37:41.605 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[C 20:37:41.605 NotebookApp]

    Copy/paste this URL into your browser when you connect for the first time,
    to login with a token:
        http://localhost:8889/?token=a7a724c1ba8d4c91132834c2d076298f517002227d4e8a72

Step 2.5: SSH into machine and redirect local localhost to machine localhost

open a terminal or cmd window on your local machine
ssh -N -L localhost:8888:localhost:8889 paperspace@your.public.ip.here

C:\Users\Me>ssh -N -L localhost:8888:localhost:8889 paperspace@184.###.###.###
The authenticity of host '184.###.###.### (184.###.###.###)' can't be established.
ECDSA key fingerprint is SHA256:bWbbhUD/7KFh+AM5CtmcSR8Z+n4rNp4p3D+V5q7P8Sw.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '184.###.###.###' (ECDSA) to the list of known hosts.
paperspace@184.###.###.###'s password:

keep this cmd window open. It appears to hang after enter on password, but all good.
this was sourced from https://hsaghir.github.io/data_science/jupyter-notebook-on-a-remote-machine-linux/
For a more permanent solution, see Optional section below

Step 3: Get Notebook url

copy jupyter notebook URL http://localhost:8889/?token=a7a724c1ba8d4c91132834c2d076298f517002227d4e8a72
paste url into your local browser (example: Chrome, Firefox, Opera, etc) and change port from 8889 to 8888
💥 Hooray, it works! 😃
alternately, bookmark localhost:8888 and use the token a7a724c1ba8d4c91132834c2d076298f517002227d4e8a72 to log in.
- Note: the token changes each time you restart jupyter notebook on the Paperspace machine

Part V: Workflow

I opened the Lesson 1 notebook, made a copy with the name tmp-reshama-lesson1.ipynb

http://184.###.###.###:8888/notebooks/courses/dl1/lesson1.ipynb

🔴 Part VI: Shutting down Notebook & Machine

🔴 Remember to shut the notebook down and STOP Instance! 💰 🔴

Paperspace has an option where you can choose to automatically shut down your machine at: 1 hr, 8 hrs, 1 day, 1 week
I chose the 8 hrs option
🔑 Note that the auto shut down works only for the browser console. Paperspace will not auto shut down your server if you SSH to it.
How do I use Auto-Shutdown on my Linux machine when connecting through SSH?

Optional Steps

Skip password and updating IP address in Jupyter Notebook link

Setup: Simplifying Logging in to Paperspace

Note: the below commands are run on * YOUR LOCAL COMPUTER *

Step 1: Install `ssh-copy-id`

If you don't have it already, here's how to install it (Mac):

brew install ssh-copy-id

Step 2: Ensure public keys are available

cd into ~/.ssh directory
if you don't have an .ssh directory in your home folder, create it (mkdir ~/.ssh)
if you don't have an id_rsa.pub file in your ~/.ssh folder, create it (ssh-keygen and hit Enter 3 times)

Step 3: Copy public key to Paperspace

replace IP address in syntax below with your own, and run command

ssh-copy-id -i ~/.ssh/id_rsa.pub paperspace@184.###.###.###

Step 4: Add Paperspace info to `config` file

make sure you are in the right directory

cd ~/.ssh

if you don't have a config file, create one. This example creates file using nano editor.

nano config

add these contents to your config file (replace IP address here with your Paperspace IP address)

Host paperspace
     HostName 184.###.###.###
     IdentityFile ~/.ssh/id_rsa
     # StrictHostKeyChecking no  
     User paperspace
     LocalForward 8888 localhost:8889

here's the nano command for saving file
ctrl o
Enter
here's the nano command for exiting a file
ctrl x

my example of config file

% pwd
/Users/reshamashaikh/.ssh

% cat config
Host paperspace
     HostName 184.###.###.###
     IdentityFile ~/.ssh/id_rsa
     # StrictHostKeyChecking no  
     User paperspace
     LocalForward 8888 localhost:8888

Step 5: `ssh` into Paperspace from local computer

ssh paperspace

my example

Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.4.0-104-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

Last login: Mon Jan 29 20:53:40 2018 from 10.64.48.1
(fastai) paperspace@psgyqmt1m:~$

Step 6: start Jupyter Notebook (after logging into Paperspace computer via `ssh` from your local computer)

jupyter notebook

my example

(fastai) paperspace@psgyqmt1m:~$ jupyter notebook

Step 7: navigate around Paperspace machine

my example

Last login: Sun Jan  7 12:57:35 2018 from 77.777.777.777
(fastai) paperspace@psgyqmt1m:~$ ls
anaconda3  data  downloads  fastai

(fastai) paperspace@psgyqmt1m:~$ cd fastai

(fastai) paperspace@psgyqmt1m:~/fastai$ ls
CODE-OF-CONDUCT.md  environment.yml  LICENSE   MANIFEST.in  README.rst        setup.cfg  tutorials
courses             fastai           MANIFEST  README.md    requirements.txt  setup.py

(fastai) paperspace@psgyqmt1m:~/fastai$ jupyter notebook
[I 12:58:13.608 NotebookApp] Writing notebook server cookie secret to /run/user/1000/jupyter/notebook_cookie_secret
[W 12:58:14.363 NotebookApp] WARNING: The notebook server is listening on all IP addresses and not using encryption. This is not recommended.
[I 12:58:14.376 NotebookApp] Serving notebooks from local directory: /home/paperspace/fastai
[I 12:58:14.376 NotebookApp] 0 active kernels
[I 12:58:14.376 NotebookApp] The Jupyter Notebook is running at:
[I 12:58:14.376 NotebookApp] http://[all ip addresses on your system]:8888/?token=594036202395d8ea6324d33ecee448cd87e99a50b64918cb
[I 12:58:14.376 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[C 12:58:14.377 NotebookApp] 
    
    Copy/paste this URL into your browser when you connect for the first time,
    to login with a token:
        http://localhost:8888/?token=77594036202395d8ea6324d33ecee448cd87e99a50b64918cb

Cool! no password required, and no need to update notebook url with Paperspace IP address

this is my url link, and it works! 💥
http://localhost:8888/?token=77594036202395d8ea6324d33ecee448cd87e99a50b64918cb

Files

paperspace.md

Latest commit

History

paperspace.md

File metadata and controls

Paperspace for fast.ai

About

Reference

Summary of Charges

Paperspace Support

Part I: Creating a Machine

Step 1: Where to start

Step 2: Create a new machine

Step 3: Choose region

Step 4: Choose template

Step 5: Choose machine

Step 6: Choose storage

Step 7: Options

Step 8: Payment

Step 9: Create machine

Part II: Logging into Paperspace Fastai Image Machine

list the files

list the data files

list fastai files

🔴 Part III: Updating fastai repo contents

Step 1: go to directory

Step 2: update repo

Step 3: update Python / Anaconda libraries

Step 4 (optional): Update password and apply root password

Part IV: Paperspace & Jupyter Notebook

Step 1: cd into fastai directory

Step 1.5: Fix Jupyter Notebook config file

Step 2: Launch Jupyter Notebook (now with more config!)

Step 2.5: SSH into machine and redirect local localhost to machine localhost

Step 3: Get Notebook url

Part V: Workflow

🔴 Part VI: Shutting down Notebook & Machine

🔴 Remember to shut the notebook down and STOP Instance! 💰 🔴

Optional Steps

Skip password and updating IP address in Jupyter Notebook link

Setup: Simplifying Logging in to Paperspace

Step 1: Install ssh-copy-id

Step 2: Ensure public keys are available

Step 3: Copy public key to Paperspace

Step 4: Add Paperspace info to config file

Step 5: ssh into Paperspace from local computer

Step 6: start Jupyter Notebook (after logging into Paperspace computer via ssh from your local computer)

Step 7: navigate around Paperspace machine

Cool! no password required, and no need to update notebook url with Paperspace IP address

Step 1: `cd` into fastai directory

Step 1: Install `ssh-copy-id`

Step 4: Add Paperspace info to `config` file

Step 5: `ssh` into Paperspace from local computer

Step 6: start Jupyter Notebook (after logging into Paperspace computer via `ssh` from your local computer)