Finishing what I left off: deriving Deep Learning without touching a single index

After 8 months since the last post on deriving backpropagation, I finally got some time to write the sequel. Well, during that 8 months, a lot has happened, but what matters is that I finally got some time to write this post.

In the last post, I defined derivatives on normed vector spaces, and used that to find the derivative of one of the most important functions: the Frobenius norm. The heart of our approach is using linearity to pass the derivative operator through the functions like the trace function to end up with a nice and clean expression for the derivative of complicated formulas.

Solving a four-year-old problem: finding all combine functions for NRS

It was 2020. I was starting to switch from the “Cry = 10/10” rating system to a more systematic approach, as described in the title Anime Rating Rework. With this, a brand new system for anime ranking, with its own complicated rules are introduced. An anime’s score is consisted of several subscores, and the total score is just simply the weighted total of these subscores. No more “if this anime makes me cry, then it is an instant 10” (looking at you, Your Lie in April). The motivation for this is to buff the ongoing series Love Live! Nijigasaki Gakuen School Idol Doukoukai, an anime that completely changed my life (for the better or worse). In the old system, it did not give me much “emotional impact”, so it performs not as well as the top anime. And because of that, taking the excuse of “modernizing the anime ranking system”, people decided to make a rework out of nowhere, giving birth to the first rework system.

As everyone who clicked on this post should know by now, C++ modules have been a thing since C++20. Oh, 2020, it’s been a while, huh. Back then, C++ modules to me were nothing but a distant dream. We need to wait for major compilers to adopt this new thing, CMake to support it, and LSPs like clangd to handle them properly. And looking at how some people are still writing C++ like ‘C with classes’, certainly this won’t come soon, right?