用4.39亿方块在《我的世界》手搓一款ChatGPT？玩家又一次“整活”，还把游戏玩出了新高度！

Core Viewpoint - The article discusses the innovative project where a developer named Sammyuri created a small language model called CraftGPT within the game Minecraft, utilizing the game's redstone mechanics to simulate a functional AI model with 5 million parameters [6][9][15]. Group 1: Project Overview - CraftGPT was built using approximately 439 million blocks in Minecraft, with dimensions of 1020 blocks long, 260 blocks high, and 1656 blocks wide [9][6]. - The model operates on a small scale, with 5,087,280 parameters, trained on the TinyChat dataset for basic English conversations [15][16]. - The project showcases the potential of Minecraft as a platform for complex computational tasks, previously demonstrated by other projects like a 16-bit CPU and a computer running DOOM [25][26]. Group 2: Technical Details - CraftGPT's architecture includes components such as tokenizers, matrix multipliers, and multi-headed attention mechanisms, all constructed using redstone circuits [11][13]. - The model's embedding dimension is 240, with a vocabulary size of 1920 tokens and a total of 6 layers [16]. - To optimize resource usage, most weights are quantized to 8 bits, while embedding and LayerNorm weights retain higher precision [17]. Group 3: Performance and Limitations - The response time for CraftGPT can be extremely long, with simple queries taking up to two hours to generate a reply [22][20]. - The model's context window is limited to 64 tokens, restricting the length of conversations it can handle [18]. - Users are advised to use the MCHPRS (Minecraft High-Performance Redstone Server) to improve performance, as running the model on standard Minecraft could take years for a single response [22][23]. Group 4: Community and Future Implications - The project has sparked interest and excitement within the gaming and AI communities, highlighting the creative potential of Minecraft [25][34]. - Sammyuri's work raises the bar for what can be achieved in Minecraft, suggesting that the game's limitations are primarily defined by human creativity [25][33].