As some of you may know, LightOn has built a few Large Language Models, and we are now making them usable to Enterprise customers. In the meantime and on the theoretical side of things, the Simons Institute for the Theory of Computing has organized a workshop on the topic of Large Language Models and Transformers. The program is listed below, every...

Back in 2011, Marc Andreesen announced that Software was eating the world while everyone was trying to make sense of the realities of the cloud versus brick and mortar businesses. Eight years later, Tarry Singh articulated how AI was eating software; a year before GPT-3 and Codex would give solid ground to this prediction. Fast forward two years later,...

** Nuit Blanche is now on Twitter: @NuitBlog ** This is history of computing in the making stuff! Four years ago to the day, LightOn’s first Optical Processing Unit (OPU) had its first light in a Data Center showing that our technology was data center ready. It is with immense pride and pleasure to announce that LightOn’s OPU has been installed in...

** Nuit Blanche is now on Twitter: @NuitBlog ** As larger models seem to be providing more context and more ability for zero-shot learning, Julien just created the Akronomicon: an Extreme-Scale Leaderboard featuring the world's largest Machine Learning Models. And yes, LightOn is on that board for the moment!  Want to contribute? https://github.com/lightonai/akronomicon ...

** Nuit Blanche is now on Twitter: @NuitBlog ** Just got an email from Rina Panigrahy Hi Igor, I am an algorithms researcher at Google (http://theory.stanford.edu/~rinap) and I am organizing this workshop on "Conceptual Understanding of Deep Learning" (details below). It's trying to understand the Brain/Mind as an algorithm from a mathematical/theoretical...

** Nuit Blanche is now on Twitter: @NuitBlog ** At LightOn, we build photonic hardware that performs random projections and it is nice to find a source of materials on the subject in one document. Here is a report comprehensively presenting how randomized algorithms are key to the future of computing: Randomized Algorithms for Scientific Computing...