“Researchers demonstrate how direct preference optimization can reduce LLM biases toward spurious social contexts, particularly important for high-stakes applications like teacher evaluations. This work addresses a critical safety concern as AI systems increasingly influence consequential decisions affecting people's careers and livelihoods.”