There are several ways of interpreting the idea of `recurrence' -- obvious ones are Hopfield networks which feed back to themselves until reaching stability. Here we consider generalisations or adaptions of feed-forward (e.g., back propagation) networks that incorporate some element of feedback or recurrence.