Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates

Published in Conference on Neural Information Processing Systems, 2024