Iβm Siddesh and this is my digital commonplace book.
Explore More
Bachelor's in Electrical and Electronic Engineering, 2018-2022
Nanyang Technological University
Background LLMs is just a bunch of optimized matrices in N layers with floating-point weights. Generation of LLMs means doing a bunch of matrix multiplication. And doing floating point operations is expensive in terms of energy consumption.