Optical neural networks are expected to be hybrid systems for the foreseeable future combining optics and electronics. The linear portion of the system, consisting of the weighted interconnections between the neurons, can be realized optically. The nonlinear activation functions and the training of the network are implemented with nonlinear optics or electronically.