This is Optimizer, a weekly newsletter sent every Friday from Verge senior reviewer Victoria Song that dissects and discusses the latest gizmos and potions that swear they're going to change your life. Opt in for Optimizer here.
GLU/SwiGLU 在实际中是门控形式（two linear branches），是向量上的逐元素操作；为了在一维上可视化，我用简化的标量形式来画图 —— 把两条分支都用相同的输入值（即把 a=x, b=x），因此 GLU(x)=x∗sigmoid(x) SwiGLU(x)=x∗SiLU(x) 。这能直观展示门控机制的形状差异。
。业内人士推荐51吃瓜作为进阶阅读
쿠팡 김범석, 정보유출 99일만에 영어로 “사과”
Paramount CEO David Ellison is Sen. Lindsey Graham’s guest at the State of the Union.
63-летняя Деми Мур вышла в свет с неожиданной стрижкой17:54