gitea
502f47eb21
- Rename AGENT.md -> .agent.md, RULES.md -> .rules.md, ONBOARDING.md -> .onboarding.md - Rename BUG_REPORT.md -> .bug_report.md, ADVERSARIAL_BUG_REPORT.md -> .adversarial_bug_report.md, VERDICT.md -> .verdict.md - Fix onboarding.md references to use new .onboarding.md path - Fix stop-hook-pattern.md reference to use .onboarding.md - Update README.md, config.md, install.sh, update.sh, prompts/*, references/* - VRAM detection script validated and working
1.9 KiB
1.9 KiB
Framework Configuration
This file contains global framework settings that apply across all projects.
VRAM Configuration
Settings for task decomposition based on available VRAM.
- Auto-detect: Yes # Detect GPU VRAM, RAM, and model context window automatically
- Target context: 16k tokens # Override auto-detect if needed
- Headroom: 25% # Leave headroom for code, context, and reasoning
- Max peak context per sub-task: 12k tokens # Max context for any single sub-task
Auto-detection
When Auto-detect: Yes, the framework probes your system to detect:
- GPU VRAM (via
nvidia-smiorlspci) - System RAM (via
free) - Model context window (via API config or model name lookup)
- Framework overhead (by reading all loaded prompt files)
To disable auto-detection and use manual values:
## VRAM Configuration
- **Auto-detect**: No
- **Target context**: 8k
- **Headroom**: 30%
- **Max peak context per sub-task**: 5.6k
Model Configuration
Settings for the LLM model being used.
- Model: auto # Use auto-detection from API config, or specify explicitly (e.g., gpt-4o, claude-3-5-sonnet)
- Override context window: auto # Override auto-detection, or specify (e.g., 128k, 200k)
Auto-detection
When Model: auto, the framework detects the model name from:
.agent.mdin the project (if specified there)- API config files (
.env,config.yaml,config.json, etc.) - Model name lookup by name (e.g., gpt-4o → 128k, claude-3-5-sonnet → 200k)
To disable auto-detection and use manual values:
## Model Configuration
- **Model**: gpt-4o
- **Override context window**: 128k
System Requirements
Requirements for the environment the framework runs in.
- nvidia-smi: Required if NVIDIA GPU (for VRAM detection)
- lspci: Fallback if NVIDIA GPU not available (for AMD GPU VRAM detection)
- /proc/meminfo: Required for RAM detection (Linux)
- sysctl: Fallback for RAM detection (macOS)