Neural network chips from Intel and Adaptive Solutions
In 1989-1990 two chips appeared that were made for neural networks. Intel's analog ETANN had 64 neurons and 10,240 synapses, its weights held as charge on floating gates, and computed more than 1.3 billion connections a second. Adaptive Solutions' digital CNAPS had 64 processors at 25 MHz and learned on the chip itself.
Why it matters
A neural network became not only a program on a general-purpose machine but a separate product of two companies. The two chips showed at once both paths the line kept choosing between: analog density with limited precision against digital flexibility with learning on the chip.
ETANN, by its Intel designers' 1993 abstract: a 1-micron CMOS non-volatile memory process, a 64 x 64 EEPROM weight array, more than 1.3 billion connections a second, and more than 2 billion in a 2:1 multiplex mode. Users of the chip in 1992 (an AFIT thesis working from Intel's manual, and a Fermilab report) write that weights are retained for at least 10 years and that learning is mostly done off the chip; one gives a weight resolution of 7.5 bits, the other about 6. CNAPS, by Adaptive Solutions' NIPS 1990 paper: all processors receive the same instruction, 1.6 billion inner product steps a second per chip, a 9 x 16-bit multiplier, 16-bit weights. An eight-chip board updates 2.3 billion connections a second in learning and processes 9.6 billion in the forward pass, but these figures come from a clock-accurate simulator, not measured silicon. Who was first. Computer Design wrote in October 1992 that the first commercially available chip made specifically for neural networks was Intel's 80170NX, the ETANN, introduced in 1989; that is the magazine's statement three years on, not a finding of this record, and no document of 1989-1990 read here makes the claim. The abstract of Intel's own paper of June 1989 speaks of 8,192 synapses joining 64 neurons to each other and to 64 inputs, while its title gives 10,240. What the record does not claim: the day ETANN was shown; anything from Intel's data booklet for the 80170NX, which a Fermilab paper cites as dated June 1991 and which was not read; the full text of the 1989 paper.