Experimenting with hypersurface-constrained dynamic weight updating [P]

Hey everyone! I want to share the results of a small language model architecture experiment I’ve been running as a side project. The ultimate goal is to test an approach to reduce the number of the model's training param