🚇 Long Context Challenge in LLMs

Existing solutions and possible directions to long-context generation

🔇 Paper Reading: Code Pretraining in LLMs

If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents https://arxiv.org/abs/2401.00812