context-distillation

Here are 4 public repositories matching this topic...

fajarhide / omni

Your agent pays twice for output it has already seen. OMNI returns a handle instead: 97.2% off a file read twice. Nothing deleted, nothing invented.

Updated Oct 9, 2026
Rust

kaistAI / GenPI

Star

This repository is the official implementation of Generative Context Distillation.

agent distillation prompt-injection prompt-compression prompt-internalization context-distillation

Updated May 10, 2025
Python

SomethingObvious / Prompt-Baking

Star

Bakes a system prompt into a LoRA adapter, so a chat model behaves as if prompted without the prompt in its context. It trains on the KL divergence to the prompted model, after Prompt Baking (arXiv 2409.13697). PyTorch, Transformers and PEFT, Qwen3.5 by default, and it fits an 8 GB GPU.

nlp machine-learning deep-learning transformers pytorch lora knowledge-distillation kl-divergence fine-tuning peft huggingface large-language-models llm prompt-engineering qwen system-prompt context-distillation prompt-baking

Updated Oct 1, 2026
Python

Numoy / kvpack

Star

Pack a repo, docs site or folder into a trained KV cache your LLM reads instead of a giant prompt. Open source, self-hosted.

transformers self-hosted pytorch rag kv-cache apple-silicon openai-api llm long-context context-distillation

Updated Sep 28, 2026
Python

Add this topic to your repo

To associate your repository with the context-distillation topic, visit your repo's landing page and select "manage topics."

Learn more