The latest advancements in language models (LMs), exemplified by GPT-4 (OpenAI, 2023), PaLM (Anil et al., 2023), and LLaMa (Touvron et al., 2023), have demonstrated remarkable capabilities in natural ...