This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers in this list investigate the learning behavior, generalization ability, and other properties of language models through theoretical analysis, empirical analysis, or a combination of both.

This repository explores building a character-level transformer decoder in PyTorch, similar to GPT but focusing on understanding individual characters. My goal is to gain deep transformer knowledge and see if character-level learning improves handling of unseen words. The code allows for hyperparameter tuning and experiment customization.

Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting

Implementation of Alphafold 3 in Pytorch

Accelerate your training with this open-source library. Optimize performance with streamlined training and serving options with JAX. 🚀

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

Unify Efficient Fine-Tuning of 100+ LLMs

🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

中文nlp解决方案(大模型、数据、模型、训练、推理)

A custom framework for easy use of LLMs, VLMs, etc. supporting various modes and settings via web-ui

[ICML2024] Unified Training of Universal Time Series Forecasting Transformers

A lightweight efficient audio codec in 30MB with 30~170x compression ratio. Supports 16kHz mono speech audio.

😷 The Fill-Mask Association Test (FMAT): Measuring Propositions in Natural Language.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

Signal Processing Fun (in the sun)

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

Jlama is a modern Java inference engine for LLMs

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper