RAG Law systems base on google search and Gemini Pro

This repository is dedicated to small projects and some theoretical material that I used to get into NLP and LLM in a practical and efficient way.

Projects and Models built in Python leveraging PyTorch, implementing Reinforcement Learning algorithms for reward-based tasks.

Applying quantum computing principles to large language models for more reliable, interpretable, and steerable systems.

Survey of preference alignment algorithms

Intelligent AI Chatbot that has the capability to learn from the user

Code for my thesis titled "Eliciting latent knowledge from language reward models" for the MPhil in Machine Learning and Machine Intelligence at the University of Cambridge

This project is based on fine-tuning LLM models (FLAN-T5) for text summarisation task using PEFT approach. All evaluation metrics being computed on ROUGE scoring and LoRA optimisation techniques being used for fine-tuning.

An alternative RLHF reward model formulation from a social choice perspective

Library built on TextRL for easy training and usage of fine-tuned models using RLHF, a rewards model, and PPO

Applying AlphaZero Self-Play Tactics to LLaMA for Enhanced Chatbot Interaction

This project uses LLMs to generate music from text by understanding prompts, creating lyrics, determining genre, and composing melodies. It harnesses LLM capabilities to create songs based on text inputs through a multi-step approach.

Direct Preference Optimization of ChatGPT2 using TRL Library

Codebase and experiments of LLM(Large Language Modeling)

Summaries of papers related to the alignment problem in NLP

Python package for cognosis kb, syntax, and markup language. Under-construction.

This repository was commited under the action of executing important tasks on which modern Generative AI concepts are laid on. In particular, we focussed on three coding actions of Large Language Models. Extra and necessary details are given in the README.md file.

Researching the reinforcement learning algorithm of ChatGPT

Embark on the "Reinforcement Learning from Human Feedback" course and align Large Language Models (LLMs) with human values.