arXiv AI recent: Exposing the Unsaid: Visualizing Hidden LLM Bias through Stochastic Path Aggregation
Researchers introduced TreeTracer, a visual analytics tool designed to detect and evaluate representational and syntactic biases in Large Language Models (LLMs). The tool uses a perturbat...
TreeTracer replaces ontology-defined terms in prompts and aggregates hundreds of generations into a syntax-aligned hierarchical structure, using an auxiliary language model for node merging. It employs contrastive inference to display counterfactual token probabilities to reduce misinterpretation...