TransWikia.com

Can theano work on mapreduce or on spark?

Data Science Asked by 0xF on March 5, 2021

I am not sure whether the Theano library can be used to write parallelized code in map reduce or in spark. Any expert opinion is welcome. A discussion was on at:
Theano-dev

2 Answers

I don't think theano have spark support yet, however there are at least 2 deep learning libraries that are good with that. The first one is mxnet, they have support for spark, R, python and C++. Another option is deeplearning4j, made in Java with direct access to Spark.

Answered by hoaphumanoid on March 5, 2021

I don't think there is any support for Map-Reduce or Spark for theano but if you want to run it in a distributed setting you can refer to this technical report on using theano with MPI.

PS : Authors of the above mentioned report have released the code for the same. You can find it here.

Answered by SHASHANK GUPTA on March 5, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP