3 Comments
User's avatar
The Heat's avatar

JJK, It is klypto/Jason Heater, you video called me when turned down the invitation to intern for you about 20 years ago. I have just released a paper that could really interest you. It is the basis for diffusion language models.

https://huggingface.co/blog/klyfff/machine-learning

Joseph Kim's avatar

I tried to take a Quick Look but it’s pretty involved will read over weekend. Thx for the link

The Heat's avatar

Yeah I kinda tried making it bulletproof and completely buried I have a working language diffusion model in working parts in the GitHub at the bottom. Each piece code should have its own explanation. It literally just borrows equations from other fields like thermodynamics and slots them in where they make sense. It's just circular.