Why: Learn fundamentals of modern AI by very gently soaking into science.
-
AI Intuition
I have an ambitious goal to help you gain strong intuition about Artificial Intelligence and particularly the role of Deep Learning that enables the modern day AI magic. All in a course of several bite-size posts. Well, I will be happy if at the least my efforts will help you build a mental roadmap for…
-
Importance of Language
Follow up on AI Intuition. The Large Language Model has a key word in the middle – Language. Language is the main means of human communication and what makes humans differentiate from animals. But language is not just a way of communication, it is also the primary way we accumulate and codify knowledge pretty much about everything that eventually gets passed…
-
World Knowledge: Compression and Representation
Follow up on Importance of Language. Intelligence, no matter artificial or human, relies to great extent on: The profoundness, impact of our inferences depends on the capacity of stored knowledge and ability to quickly connect dots between its fragments. Information Theory place in LLM Large Language Models heavily rely on many tenets of Information Theory. It is of particular…
-
LLM foundations and Brain-DNA analogy
Follow up on World Knowledge: Compression and Representation It sounds like magic and hardly believable how potent Large Language Models (LLMs) are with their impressive and skillful expression of knowledge. The goal of this article is to demystify why LLMs are so capable. There are different schools of what intelligence and conscience are, what reasoning means…
-
Manifolds and Representations
Follow up on LLM foundations and Brain-DNA analogy In my efforts to help you build convincing intuition about Large Language Models (LLMs) I mentioned in earlier posts two main scientific pillars that it is based on – Information Theory and Probability Theory. They help compressing the essence of knowledge on the one hand, and choosing from and correlating massive…
-
LLM Training and Inference
Follow up on Manifolds and Representations This article is a culmination of gaining AI Intuition introductory series. The previous five posts explained scientific underpinnings and building blocks behind Generative AI magic: Here we will talk about what is achieved during Large Language Model training and inference. Main objectives of LLM Training We learn two main things…