Technical Seminar
Technical Seminar
Abstract
There were some initial simulations using formal logic. McCulloch and
Pitts (1943) developed models of neural networks based on their understanding
of neurology. These models made several assumptions about how neurons
worked. Their networks were based on simple neurons, which were considered
to be binary devices with fixed threshold.
!1
Not only was neuroscience, but psychologists and engineers also
contributed to the progress of neural network simulations. Rosenblatt (1958)
stirred considerable interest and activity in the field when he designed and
developed the Perceptron. The Perceptron had three layers with the middle layer
known as the association layer. This system could learn to connect or associate a
given input to a random output unit.
Another system was the ADALINE (Adaptive Linear Element) which was
developed in 1960 by Widrow and Hoff (of Stanford University). The
ADALINE was an analogue electronic device made from simple components.
The method used for learning was different to that of the Perceptron, it
employed the Least-Mean-Squares (LMS) learning rule.
Progress during the late 1970s and early 1980s was important to the re-
emergence on interest in the neural network field.Significant progress has been
made in the field of neural networks-enough to attract a great deal of attention
and fund further research.
!2
!3