Data Science Asked by chatbot_chakra on March 2, 2021
I want to train a deep learning model on a dataset containing around 3000 images. Since the dataset is huge, I want to use Google colab since it’s GPU supported. How do I upload this full image folder into my notebook and use it?
You don't need to upload them if you have a download link ...( it would be faster if you can upload them all as either ways you have to do so.. So its better to upload them first and then download them in your notebook every-time you run it)
If you have a download link then just this
! wget <Link>
Else upload then to your drive and then just use the following
from google.colab import files
uploaded = files.upload()
##files.upload returns a dictionary of the files which were uploaded. The
##dictionary is keyed by the file name, the value is the data which was
##uploaded.
for fn in uploaded.keys():
print('User uploaded file "{name}" with length {length} bytes'.format(
name=fn, length=len(uploaded[fn]))
Answered by Aditya on March 2, 2021
I recommend you uploading a zip file containing your images to your drive and downloading the content from drive to Colab. Then you will be able to extract them. The code for uploading is here.
Answered by Media on March 2, 2021
You can upload stuff to Google Drive and then download it from there on Colab. I've written some utils for that - see this notebook.
As to how upload files to Google Drive, Media's suggestion is useful - upload zipped image folder.
Answered by Jakub Bartczuk on March 2, 2021
Method 1 :
Method 2 :
Answered by Srijeet on March 2, 2021
The best bet would be to upload the images as a zip file to your Google drive and then access it through Google Colab (GC)
Turn to GC to authorise and mount your Google drive
from google.colab import drive
drive.mount('/content/drive')
Follow the link and paste the code to your GC notebook
Unzip the file from GC
!unzip -uq "/content/drive/My Drive/PATH_TO_ZIP" -d "/content/drive/My Drive/PATH_TO_OUTPUT"
The files are now ready to use
Answered by Surya Palaniswamy on March 2, 2021
On Colab simply use:
!gdown --id file_id
For instance, if your Google drive share link for the file is:
https://drive.google.com/file/d/zz2Xs5Vriz6aF3V-Z22112yAj91c222fI1F/view?usp=sharing
use:
!gdown --id zz2Xs5Vriz6aF3V-Z22112yAj91c222fI1F
Answered by Rexcirus on March 2, 2021
Get help from others!
Recent Questions
Recent Answers
© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP