Claude悄悄更新了Skills生成器，这绝对是一次史诗级升级。

Core Viewpoint - The article discusses a significant update to Anthropic's Skill-creator, emphasizing its importance in enhancing the Skills ecosystem and improving the functionality and evaluation of skills created using this tool [1][8][80]. Group 1: Skill-creator Update Features - The new Skill-creator introduces four major capabilities: an evaluation system to assess skill effectiveness, benchmark testing to quantify pass rates and resource usage, parallel testing with multiple agents to ensure independent results, and description optimization to refine skill triggers [10][11][12][13]. - The evaluation system is highlighted as crucial for guiding the development of skills, addressing previous limitations where skills were treated as black boxes without clear quality metrics [14][15]. Group 2: Practical Application and Case Study - A case study is presented where a skill was created to download videos and generate transcripts, demonstrating the ease of use and effectiveness of the updated Skill-creator [21][22]. - The article illustrates how the new features allow for iterative improvements, such as optimizing the skill's description to prevent conflicts between similar skills [31][32][39]. Group 3: Evaluation Process - The evaluation process involves designing test scenarios based on the skill's functionality, with quantifiable acceptance criteria to assess performance [49][50][53]. - The article details how multiple independent agents can run tests simultaneously, reducing contamination of results and improving the accuracy of evaluations [58][60]. Group 4: Performance Metrics - The article provides performance metrics showing that skills created with the updated Skill-creator have a 100% success rate in triggering relevant actions, compared to a baseline of 9% for skills without the update [65]. - It also notes that the token usage for skills with the update is approximately 4000 tokens per execution, compared to 1750 tokens without, indicating a trade-off between resource consumption and output quality [66][67]. Group 5: Future Implications - The article concludes that the enhancements to the Skill-creator will lead to a flourishing ecosystem of skills, encouraging users to update and optimize their existing skills [80][92]. - It emphasizes the importance of continuous evaluation and improvement in skill development, suggesting that all skills should undergo this process to ensure their relevance and effectiveness [92][93].