Jump to content

Modular neural network

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by 122.52.110.165 (talk) at 03:56, 6 March 2012 (→Biological Basis). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

A modular neural network is a neural network characterized by a series of independent neural networks moderated by some intermediary. Each independent neural network serves as a module and operates on separate inputs to accomplish some subtask of the task the network hopes to perform [1]. The intermediary takes the outputs of each module and processes them to produce the output of the network as a whole. The intermediary only accepts the modules’ outputs—it does not respond to, nor otherwise signal, the modules. As well, the modules do not interact with each other.

Complexity

One of the major benefits of a modular neural network is the ability to reduce a large, unwieldy neural network to smaller, more manageable components [1]. There are some tasks it appears are for practical purposes intractable for a single neural network as its size increases. The following are benefits of using a modular neural network over a single all-encompassing neural network.

Efficiency

The possible connections increases at a daunting rate as nodes are added to the network. Since computation time depends on the number of nodes and their connections, any increase here will have drastic consequences in the processing time. As the greater task is further compartmentalized, the possible connections each node can make are limited, and the subtasks will hopefully execute more efficiently than trying to tackle the whole task at once.

Training

A large neural network attempting to model multiple parameters can suffer from interference as new data can dramatically alter existing connections or just serve to confuse. With some foresight into the subtasks to be solved, each neural network can be tailored for its task. This means the training algorithm used, and the training data used for each sub-network can be unique and implemented much more quickly. In large part this is due to the possible combinations of interesting factors diminishing as the number of inputs decreases.

Robustness

Regardless of whether a large neural network is biological or artificial, it remains largely susceptible to interference at and failure in any one of its nodes. By compartmentalizing subtasks, failure and interference are much more readily diagnosed and their effects on other sub-networks are eliminated as each one is independent of the other.

Notes

  1. ^ a b (Azam, 2000)

References

Retrieved from "https://en.wikipedia.org/w/index.php?title=Modular_neural_network&oldid=480438497"