https://gwern.net Pages from gwern.net in the 'AI: Neural Network Architectures & Techniques' section Sat, 07 Mar 2026 22:52:09 +0000 GwernRSSBuilder/1.0 https://gwern.net/aunn https://gwern.net/aunn Proposal for a general NN architecture handling arbitrary tasks, for scaling up MLPs, with applications. Gwern Thu, 20 Jul 2023 00:00:00 +0000 2025-04-07T00:00:00Z essay ai/nn/fully-connected ai/nn/rnn ai/nn/transformer/attention ai/scaling https://gwern.net/tank https://gwern.net/tank AI folklore tells a story about a neural network trained to detect tanks which instead learned to detect time of day; investigating, this probably never happened. Gwern Tue, 20 Sep 2011 00:00:00 +0000 2023-07-04T00:00:00Z essay ai/nn history reinforcement-learning/safe sociology https://gwern.net/rnn-metadata https://gwern.net/rnn-metadata Teaching a text-generating char-RNN to automatically imitate many different authors by labeling the input text by author; additional experiments include imitating Geocities and retraining GPT-2 on a large Project Gutenberg poetry corpus. Gwern Sat, 12 Sep 2015 00:00:00 +0000 2019-03-26T00:00:00Z essay ai/nn/rnn ai/nn/sampling ai/poetry cs/shell tutorial