Feedback

Feedback networks contain node linkages that are not strictly forward-feeding.

• Time-delay and windowed algorithms' contextual information is strictly limited to the size of the window or delay
• Feedback networks have virtual unlimited (or at least not strictly limited) capacity to describe sequence context

Few types

• fully recurrent networks - multiple feedback is part of the architecture itself (Bell '88)
• partially recurrent networks - single feedback loops are added to a feed-forward network (Jordan '86, Elman '90)

next prev