1. Introduction
  2. Getting Started
  3. Installation
  4. Quick Start
  5. First Training Loop
  6. Core Concepts
  7. Architecture
  8. Overview
  9. Design Philosophy
  10. Module Organization
  11. Type System
  12. Memory Management
  13. Autograd Engine
  14. What is Automatic Differentiation?
  15. Tape-Based Computation Graphs
  16. Tensor Operations
    1. Matrix Multiplication
    2. Activations (ReLU, GELU, Swish)
    3. Layer Normalization
    4. Attention Mechanism
  17. Backward Pass
  18. Gradient Computation
  19. Finite Difference Validation
  20. Optimizers
  21. Overview
  22. Stochastic Gradient Descent (SGD)
  23. Adam Optimizer
  24. AdamW (Decoupled Weight Decay)
  25. Learning Rate Schedulers
    1. Cosine Annealing
    2. Step Decay
    3. Exponential Decay
  26. Gradient Clipping
  27. SIMD-Accelerated Updates
  28. Optimizer Theory
  29. LoRA (Low-Rank Adaptation)
  30. What is LoRA?
  31. Parameter-Efficient Fine-Tuning
  32. LoRA Layer Architecture
    1. Low-Rank Matrices A and B
    2. Scaling Factor (alpha/rank)
    3. Merge and Unmerge
  33. Target Module Selection
  34. Gradient Flow Isolation
  35. Adapter Persistence
    1. Saving Adapters
    2. Loading Adapters
    3. Sharing Adapters
  36. QLoRA (Quantized LoRA)
  37. Memory-Efficient Fine-Tuning
  38. 4-bit Quantization
    1. Block-Wise Quantization
    2. Scale Factors
    3. Quantization/Dequantization
  39. QLoRA Layer
  40. On-the-Fly Dequantization
  41. Memory Benchmarks
    1. LoRA vs QLoRA Comparison
    2. Transformer Model Benchmarks
    3. Compression Ratios
  42. Trade-offs and Best Practices
  43. Model Merging
  44. Overview
  45. TIES Algorithm
  46. DARE Algorithm
  47. SLERP Algorithm
  48. Multi-Model Ensembles
  49. Merge Best Practices
  50. Knowledge Distillation
  51. What is Distillation?
  52. Temperature-Scaled KL Divergence
  53. Multi-Teacher Ensemble
  54. Progressive Layer-Wise
  55. Distillation Loss Functions
  56. Student-Teacher Architecture
  57. Training Loops
  58. Trainer API
  59. Callback System
  60. Train Config
  61. Basic Training Loop
  62. Batching and Data Loading
  63. Loss Functions
  64. Validation and Testing
  65. Checkpointing
  66. Early Stopping
  67. Curriculum Learning
  68. Explainability
  69. Real-Time Monitoring
  70. Overview
  71. Experiment Tracking
  72. Quality Gates (Jidoka)
  73. Metrics Collection
  74. Terminal Dashboard
  75. Drift Detection
  76. Andon Alerting (Jidoka)
  77. Model Lineage
  78. Export Formats
  79. Hansei Reports
  80. Dashboard
  81. Overview
  82. DashboardSource Trait
  83. WASM Bindings
  84. Ecosystem Integration
  85. Overview
  86. Batuta Integration
  87. Realizar GGUF Export
  88. Ruchy Session Bridge
  89. Model I/O
  90. Overview
  91. Save Models
  92. Load Models
  93. Model Metadata
  94. Supported Formats
    1. SafeTensors Format
    2. JSON Format
    3. YAML Format
    4. GGUF Format
  95. Command-Line Interface
  96. CLI Overview
  97. Research Commands
  98. Benchmark Commands
  99. Declarative Training
  100. Overview
  101. YAML Mode Training (v1.0)
  102. YAML Examples Catalog
  103. Toyota Way QA Process
  104. YAML Configuration
  105. train_from_yaml Function
  106. Configuration Schema
  107. Optimizer Builders
  108. Model Builders
  109. API Reference
  110. Tensor API
  111. Autograd Operations
  112. Optimizer API
  113. LoRA API
  114. QLoRA API
  115. Configuration System
  116. Error Handling
  117. Examples
  118. Linear Regression with Autograd
  119. Training a Simple MLP
  120. Fine-Tuning with LoRA
  121. Memory-Efficient QLoRA
  122. Custom Loss Functions
  123. Learning Rate Scheduling
  124. Gradient Clipping
  125. Adapter Sharing
  126. Development Guide
  127. Contributing
  128. EXTREME TDD Methodology
  129. Testing Strategy
    1. Unit Tests
    2. Property-Based Tests
    3. Gradient Checking Tests
    4. Mutation Testing
  130. Quality Gates
    1. Pre-Commit Hooks
    2. Continuous Integration
    3. Code Coverage
    4. Clippy Linting
  131. Benchmarking
  132. PMAT Toyota Workflow
  133. Best Practices
  134. Optimizer Selection
  135. Learning Rate Tuning
  136. LoRA Configuration
  137. Memory Optimization
  138. Gradient Stability
  139. Debugging Training Issues
  140. Performance Profiling
  141. Advanced Topics
  142. Custom Backward Passes
  143. Implementing New Optimizers
  144. Custom LoRA Variants
  145. Advanced Quantization
  146. Distributed Training
  147. Model Parallelism
  148. Compiler-in-the-Loop (CITL)
  149. Sovereign Deployment
  150. Overview
  151. Academic Research
  152. Overview
  153. Specifications
  154. Autograd Specification
  155. Optimizer Specification
  156. LoRA Specification
  157. Quantization Specification
  158. Academic Foundations
  159. Appendix
  160. Glossary
  161. Mathematical Notation
  162. References
  163. FAQ
  164. Changelog
  165. Migration Guide
  166. Benchmarking Results