作者 | Sean Goedecke 译者 | 王强 策划 | Tina 什么是批处理推理？ GPU 擅长执行大型矩阵乘法（GEMMs，或"通用矩阵乘法"）。假设你有一个 token，你想通过模型 传递（即通过乘以其所有权重，其他架构细节不谈）。你将其表示为一个与模型维度（或隐藏大小） 相匹配的向量（即 1x 其大权重矩阵的宽度），然后将其乘过去。那就是 1 个 GEMM。但如果你想 一次通过一批十个 token，也仍然只是一个 GEMM，因为你可以将 token 堆叠成一个矩阵（10x 模 型维度）。这比执行十个稍小的 GEMM 要快得多。因此，推理服务器的实现可能看起来是这样的： 请注意，服务器会决定拉取多大的批次大小。这是吞吐量和延迟之间的权衡。如果你不进行批处理， 只是逐个处理 token，那么没有用户会在队列中等待（上述步骤 3），所以延迟很低（假设你有足够 的 GPU）。然而，如果你进行大量批处理，延迟会很高，因为用户将等待到批次大小填满，但吞吐 量会高得多，因为 GPU 的使用效率更高。 1. 一个请求带着提示词进来 2. 该提示被预填充（通过注意力传递，我们稍后将看到如何将它也做批处理），形成 ...

Core Viewpoint - Semiconductor manufacturing companies, specifically SMIC, are advancing their technology by applying for a new patent related to semiconductor structure formation, which aims to improve product yield and reduce sensitivity to environmental impurities [1][2]. Group 1: Patent Application - SMIC has applied for a patent titled "Method for Forming Semiconductor Structure," with publication number CN120261287A, filed on January 2024 [1]. - The patent describes a process that includes forming a silicon layer on a substrate, followed by a metal layer, and involves multiple heat treatments and acid washes to create a metal silicide layer [1]. - The new method enhances the growth of metal silicide by minimizing the impact of environmental factors, thus improving product yield [1]. Group 2: Company Overview - SMIC Beijing was established in 2002, focusing on the manufacturing of computers, communications, and other electronic devices, with a registered capital of 100 million USD [2]. - SMIC Shanghai was founded in 2000, also specializing in similar manufacturing sectors, with a registered capital of 244 million USD [2]. - Both companies have significant patent portfolios, with each holding around 5,000 patents, and have participated in numerous bidding projects [2].

2025年上半年，北交所主题基金成为了基金市场中的最大赢家。 Wind数据显示，截至今年6月30日，华夏北交所创新中小企业精选两年定开（014283）以72.16%的年内回报居全市场（除QDII基金）第3位，拉长时间 看，该基金过去三年回报高达175.64%，居全市场基金首位，大幅跑赢同期北证50指数39.45%和24%的涨幅。 这表明北交所主题基金充分发挥了主动管理基金的优势，起到了良好的价值发现作用。 近三年业绩排名市场首位 华夏北交所主题基金业绩亮眼 2021年11月，北交所鸣钟开市，作为服务创新型中小企业的主阵地，这家仅设立三年多的全国性证券交易所给市场带来了许多惊喜。 文/每日财报 杨悦 今年上半年，北交所主题基金业绩普遍表现亮眼。来自华夏基金、中信建投基金、万家基金、汇添富基金等多家基金公司旗下的北交所主题基金半年回报 均超50%，给基民带来了良好的投资体验。 其中，华夏基金旗下的华夏北交所创新中小企业精选两年定开以72.16%的年内回报居全市场（除QDII基金）第3位。 该基金不仅短期业绩表现喜人，长期业绩更是可圈可点。Wind数据显示，截至6月30日收盘，华夏北交所创新中小企业精选两年定开近三 ...

Core Viewpoint - Semiconductor Manufacturing International Corporation (SMIC) has applied for a patent related to a new "anti-fuse structure and its formation method," indicating ongoing innovation in semiconductor technology [1]. Company Overview - SMIC was established in 2000 and is located in Shanghai, primarily engaged in the manufacturing of computers, communications, and other electronic devices [2]. - The company has a registered capital of 244 million USD and has made investments in four enterprises, participated in 127 bidding projects, and holds 150 trademark records and 5,000 patent records [2].

Core Viewpoint - Local governments are intensifying efforts to address overdue payments to enterprises by issuing new special bonds to raise funds for debt repayment [2][4][5] Group 1: Special Bond Issuance - Qinghai Province plans to issue approximately 11.7 billion yuan in government bonds, including 1.42 billion yuan in new special bonds specifically for repaying overdue payments to enterprises [2] - The central government has proposed a total of 4.4 trillion yuan in local government special bonds for 2025, an increase of 500 billion yuan from the previous year, with a focus on addressing overdue payments to enterprises [4] - Hunan Province has received a debt limit of 182.3 billion yuan, with 20 billion yuan allocated specifically for repaying overdue payments to enterprises, representing about 14% of the new special bond quota [4] Group 2: Financial Impact and Usage - As of July 4, approximately 2.22 trillion yuan in new special bonds have been issued, with about 519.5 billion yuan (23%) allocated for unspecified projects, likely including overdue payments and replacing hidden debts [5] - The Ministry of Finance plans to allocate 800 billion yuan annually from new local government special bonds from 2024 to 2028 to address hidden debts [6] - The overdue payment issue has intensified due to economic pressures, with a notable increase in accounts receivable and extended payment periods for small and medium-sized enterprises [6][8] Group 3: Regional Efforts and Challenges - Some regions have reported success in repaying overdue payments, with specific municipalities achieving significant reductions in government debts to enterprises [7] - Local government revenues have been under pressure, with a 1.9% increase in general public budget revenue and an 8.3% decline in government fund budget revenue in the first five months of the year [8] - The reliance on local financial resources for clearing overdue payments has led to challenges, making the issuance of special bonds a quicker solution to alleviate liquidity issues for enterprises [8]

Core Insights - Gree New Yuan Electronics Co., Ltd., Gree Electric Appliances Inc., and Gree New Yuan Electronics (Nanjing) Co., Ltd. have obtained a patent for a device that promotes the absorption of electrolytic liquid in electrolytic capacitors, with the patent granted on CN112802693B and applied for on January 1, 2021 [1][2]. Company Overview - Zhuhai Gree New Yuan Electronics Co., Ltd. was established in 1988 and is located in Zhuhai City, primarily engaged in the manufacturing of computers, communications, and other electronic devices. The company has a registered capital of 126.18 million RMB. It has invested in 2 companies, participated in 44 bidding projects, and holds 304 patents along with 31 administrative licenses [1]. - Zhuhai Gree Electric Appliances Inc. was founded in 1989 and is also based in Zhuhai City, focusing on the manufacturing of electrical machinery and equipment. The registered capital is 601,573.0878 million RMB. The company has invested in 101 enterprises, participated in 5,000 bidding projects, and possesses 5,000 trademark and patent records, in addition to 827 administrative licenses [1]. - Gree New Yuan Electronics (Nanjing) Co., Ltd. was established in 2018 and is located in Nanjing City, primarily engaged in retail. The registered capital is 10 million RMB. The company has participated in 2 bidding projects, holds 24 patents, and has 14 administrative licenses [2].

Group 1 - Ningxia issued a 15-year special local government bond for healthcare with a scale of 0.66 billion and an issuance rate of 1.94% [1] - The marginal multiple for the healthcare bond was 1.30 times, with an expected multiple of 2.18 [1] - Ningxia also issued a 10-year special local government bond for urban renewal with a scale of 1.00 billion and an issuance rate of 1.79% [1] Group 2 - The marginal multiple for the urban renewal bond was 3.00 times, with an expected multiple of 2.34 [1]

编者按 | 为帮助投资者了解北交所市场相关知识 ，我们全新推出《北证知识一站通》系列动画，重点 | | --- | | 围绕开户、交易等方面，向投资者详细介绍参与北交所市场的相关知识。第三期为《 北证专 | | 精特新指数特辑 》，感兴趣的投资者快来看看吧！ | 北证知识一站通第三期： 北证专精特新指数特辑 ...

科技日报记者 崔爽 机械臂运动精度达0.1毫米，已在泌尿外科、普外科等领域完成数千例手术的手术机器人；厚度仅 为纸张的1/6，却能经受住30万次以上弯折考验的柔性钢材；像帽子一样附着在儿童头皮，根据收集的 脑电信息生成脑功能状态评估分析报告的非植入式孤独症辅助诊断系统……在近日举办的第二十届中国 国际中小企业博览会（以下简称"中博会"）上，超过2000家国内外企业亮相，展现创新图景。 加速融入全球产业链 "智元机器人远征A2人形机器人是全球首个同时拥有中、美、欧三个区域认证的人形机器人，也是 国内首个获得CR（中国机器人认证）和CE-MD（机械指令）认证的人形机器人。"智元机器人展台的工 作人员介绍，这是他们第一次参加中博会，希望获得更多国际客户的青睐。 记者从会上了解到，我国已累计培育科技和创新型中小企业超60万家、专精特新中小企业超14万 家、专精特新"小巨人"企业1.46万家。 工业和信息化部部长李乐成在开幕式上表示，我国中小企业快速发展壮大，综合实力、核心竞争力 和保就业惠民生能力不断增强，呈现"量质齐升"的发展态势。 释放强劲创新活力 最新数据显示，今年以来，中小企业运行总体平稳。1至5月，规模以上 ...

蔡澜去世，想起多年前他请客的一餐早茶。 蔡澜去世，想起多年前他请客的一餐早茶。 那时候正在为一家媒体做一个名人书房的专题，每期一人，到他们家中访谈、拍摄，让他们聊自己买书、读书、 写书的感受。蔡澜爽快地接受了访问，但不想让我们去他家拍摄，说没什么好拍的，他可以直接提供各种图片给 我们，还是请我们吃顿早茶，边吃边聊来得尽兴。 于是第二天一早8点半，就睡眼惺忪地来到约定的乐园茶餐厅。蔡澜已经在和老板说笑了，桌上则摆满了从不同地 方打包的点心和菜肴。这家茶餐厅在九龙城衙前围道九龙城市政大厦的2楼，更像是室内大排档的一个摊点。1988 年以前，它是真正的露天小摊，就像这边近年来进行的菜市场改造一样，香港的很多路边摊也经历过一轮搬进大 楼的洗礼。 蔡澜是这里的熟客，现任老板的父亲当家时，他就经常光顾了，"因为茶和炒米粉很好吃"。其他如叉烧、烧肉、 野生黄鱼、马友鱼、咸鱼、印尼大春卷、印尼饭和印尼面，则是从周围不同店家买来的。"菜市场买来的最新 鲜。"蔡澜边招呼大家多吃一点，边介绍每一道菜或主食的特点。在附近住了十几年，他每天早上五六点就起床， 去菜场买菜，然后吃早饭。问他早饭是不是天天这么丰盛，他说是，早饭很重要，而且 ...