TransWikia.com

How does a photonic tensor core work?

Physics Asked on September 4, 2021

There has been much media coverage of the paper Photonic Tensor Cores for Machine Learning:

However, neither the paper nor the media coverage seem to actually explain how such a "Photonic TPU" actually works. Maybe I have been living under a rock, but I have never heard of a matrix processor which works using photons instead of the classical electrical circuits.

There have been neural networks implemented with photons instead of electrical circuits, but these approaches are limited to the evaluation of a pre-trained NN, whereas a "Photonic TPU" would be able to actually train a network.

What is the concept behind Photonic TPUs, how do they work?

2 Answers

The news coverage dont explain. It is clear from the paper. There are multiple units that perform the dot-product operation, using Wavelength division multiplexing. These wavelengths, which represent the entries of a 4x1 vector (modulated carriers), are weighted through multi-bit photonic memories that are written electrically. The weighted wavelengths are summed together by photodetector. And this happens for all the 16 dot-products of a 4x4 matrix-matrix multiplication. very similar to electronic TPU operations, with difference that most operations are performed while photons travel in the waveguides. It is elegant. no separation between memory and processing.

Answered by Kelig Anelov on September 4, 2021

What Anelov says seems correct. https://arstechnica.com/science/2018/07/neural-network-implemented-with-light-instead-of-electrons/ reads as a diffractive optics network with 3d printed "boards". It can not be tuned. You need to 3d print new modules for new neural networks. The photonic tensor core uses micron size waveguides, so much smaller and it seems that the memory can be written and it can potentially implement multiple neural networks.

Answered by Bijan Gazemi on September 4, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP