Sitemap
A list of all the posts and pages found on the site. For you robots out there, there is an XML version available for digesting as well.
Pages
Posts
New Year, Deep Reflection
Published:
A New Year reflection on AI’s progress, the limits of pure instrumental rationality, and why generative interpretability, decentralization, and human–AI collaboration matter.
Neuro-Symbolic Systems: The Art of Compromise
Published:
Neuro-symbolic intelligence arises from fusing two complementary compression engines: neural networks that blur reality into continuous manifolds, and symbolic systems that carve it into sharp, rule-based distinctions.
Decentralized Computation: The Hidden Principle Behind Deep Learning
Published:
This post explores how decentralized information processing plays a key role in Deep Neural Networks, and what is missing compared to other Complex Systems.
portfolio
Portfolio item number 1
Short description of portfolio item number 1
Portfolio item number 2
Short description of portfolio item number 2
publications
A Survey of Interpretable and Biologically Plausible LLMs
A comprehensive, interdisplinary survey of interpretable and biologically plausible LLMs based on my tutorial delivered at CS 591 BAI seminar. See Talks for more information.
IIT-Based Event-Driven Memory for Self-Evolving Large Language Model Agents
Memory is central to autonomous, self-evolving agents. Leveraging Integrated Information Theory (IIT), we design time-variant memory that integrates past experience via event-driven updates gated by reward, effectively treating consolidation as learning in a standard RL framework.
Modular Network Training via Adjoint Structure Predictor
Learn the LLM’s computational topology instead of hand-engineering it: We propose a structure predictor adjoint to a LLM, which generates a context-dependent computational graph applied to the LLM. This allows the modular structure to emerge with minimal contraints during training.
talks
A Tutorial of Interpretable and Biologically Plausible LLMs, Section 1
Published:
In this section, we introduce a conceptual overview of AI interpretability and argue for its vital role in shaping next-generation LLM architectures, drawing insights from research in artificial neural networks, complex systems, and philosophy.
A Tutorial of Interpretable and Biologically Plausible LLMs, Section 2
Published:
In this section, we explore neuron-level interpretability by introducing a biologically plausible neural model — the Spiking Neural Network (SNN) — illustrating how the incorporation of temporal dynamics enhances the expressiveness of individual neurons, and highlighting the delicate balance between biological plausibility and computational efficiency that enables the scalability of spiking neurons in large language models.
A Tutorial of Interpretable and Biologically Plausible LLMs, Section 3
Published:
In this section, we explore model-level interpretability by introducing Transformer Circuit Theories, outlining their mathematical foundations, pinpointing how current models benefit from these principles, and illustrating how such insights inspire the development of modular and sparse next-generation AI architectures.
A Tutorial of Interpretable and Biologically Plausible LLMs, Section 4
Published:
In this section, we shift our focus from structural interpretability to behavioral interpretability by introducing Test-Time Compute (System 2 Thinking), Neuro-Symbolic Reasoning, and Competitive Market-Based Learning, and illustrating how structural and behavioral interpretability form a coherent and complementary framework.
AI Interpretability in the Era of LLMs: Architecture, Behavior and Beyond, Section 1 (Post-hoc Interpretability)
Published:
In this section, we examine post-hoc interpretability methods for large language models, covering techniques that explain already-trained models’ architectures and behavior after the fact.
AI Interpretability in the Era of LLMs: Architecture, Behavior and Beyond, Section 2 (Generative Interpretability)
Published:
In this section, we turn to generative interpretability, exploring how large language models can be understood and steered through the lens of their generative behavior rather than solely their internal structure.
teaching
Teaching experience 1
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Teaching experience 2
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.