Fragments — Zhilin GongNotes on papers, code, and ordinary life. 关于阅读、技术与日常生活的片段。https://zhilingong.com/en-usNotes on Linear Attention: From Linear Attention to KDAhttps://zhilingong.com/writing/2026-08-29-notes-on-linear-attention-from-linear-attention-to-kda/https://zhilingong.com/writing/2026-08-29-notes-on-linear-attention-from-linear-attention-to-kda/A derivation-first path from softmax attention to fixed-size associative memory, DeltaNet, Gated DeltaNet, and Kimi Delta Attention.Sat, 29 Aug 2026 00:00:00 GMTlinear-attentiontransformersllm回到广东https://zhilingong.com/writing/2026-03-27-guangdong-trip/https://zhilingong.com/writing/2026-03-27-guangdong-trip/三月里的珠海、阳江和广州。Fri, 27 Mar 2026 00:00:00 GMTtravelcitynotes on policy gradient methodhttps://zhilingong.com/writing/2026-01-05-policy-gradient-method/https://zhilingong.com/writing/2026-01-05-policy-gradient-method/Deriving the log-derivative trick and connecting the objective to surrogate losses used in code.Mon, 05 Jan 2026 05:03:18 GMTreinforcement-learningoptimization2025 recaphttps://zhilingong.com/writing/2026-01-05-2025-recap/https://zhilingong.com/writing/2026-01-05-2025-recap/一些旧的习惯，一些新的开始，以及学习慢一点生活。Mon, 05 Jan 2026 00:57:49 GMTyearly-review2024 recaphttps://zhilingong.com/writing/2025-02-05-2024-recap/https://zhilingong.com/writing/2025-02-05-2024-recap/回望忙碌、健康起伏与研究生最后一年的 2024。Wed, 05 Feb 2025 00:00:00 GMTyearly-review离开幻海之前https://zhilingong.com/writing/2024-10-01-before-leaving-huanhai/https://zhilingong.com/writing/2024-10-01-before-leaving-huanhai/一篇关于故乡、环境与告别的短篇故事。Tue, 01 Oct 2024 04:45:54 GMTfiction上海的夏天https://zhilingong.com/writing/2024-10-01-shanghai-summer/https://zhilingong.com/writing/2024-10-01-shanghai-summer/从杭州搬到上海之后，关于实习、散步和慢慢恢复的一段记忆。Tue, 01 Oct 2024 00:00:00 GMTcitylife苏州生活https://zhilingong.com/writing/2021-07-15-suzhou-sweet-and-elderly/https://zhilingong.com/writing/2021-07-15-suzhou-sweet-and-elderly/关于本科最后的考试、实习，以及衰老与告别。Thu, 15 Jul 2021 00:00:00 GMTlifereadingcity