用4.39亿方块在《我的世界》手搓一款ChatGPT？玩家又一次“整活”，还把游戏玩出了新高度

Core Insights - A developer named Sammyuri has successfully created a small language model called CraftGPT within the game Minecraft, utilizing 4.39 billion blocks to build a virtual environment for the model to operate [4][20]. - CraftGPT consists of 5,087,280 parameters and is designed to handle basic English conversations, although it is significantly smaller than models like GPT-1 and GPT-3 [25]. Technical Details - The CraftGPT project occupies a massive area in Minecraft, measuring 1020 blocks long, 260 blocks high, and 1656 blocks wide [7]. - The internal structure of CraftGPT includes various components such as tokenizers, matrix multipliers, and multi-headed attention mechanisms, all constructed using Minecraft's redstone circuitry [12][13]. - The model was trained on the TinyChat dataset, focusing on basic conversational English [13]. Performance and Limitations - Despite its innovative design, CraftGPT has significant limitations, including long response times that can take several hours for a single reply [16][17]. - The model's context window is limited to 64 tokens, restricting its ability to handle longer conversations [14]. - Users are advised to use a high-performance redstone server (MCHPRS) to improve response times, as running it on standard Minecraft could lead to impractically long wait times [16][17]. Community Reaction - The project has garnered significant attention and admiration from the gaming community, with many expressing astonishment at the creativity and technical achievement involved in building such a model within Minecraft [20][23]. - CraftGPT is seen as a continuation of previous impressive redstone projects in Minecraft, such as functioning CPUs and even a version of the game DOOM [20].