PentestGPT

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

LLM KV cache compression made easy

Verbalized Sampling, a training-free prompting strategy to mitigate mode collapse in LLMs by requesting responses with probabilities. Achieves 2-3x diversity improvement while maintaining quality. Model-agnostic framework with CLI/API for creative writing, synthetic data generation, and dialogue simulation.