Skip to content

Issues: JohnSnowLabs/langtest

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

73 Open 346 Closed
73 Open 346 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Implement the Generic to Brand Drug Name Swapping Tests and Vice-Versa
#1057 opened Jun 25, 2024 by chakravarthik27
@chakravarthik27
Add Tests/Metrics for Multimodal models
#1056 opened Jun 24, 2024 by dcecchini
Integrate Prometheus Model for Enhanced Evaluation current release ⭐ Feature Indicates new feature requests
#1054 opened Jun 20, 2024 by chakravarthik27
1
@chakravarthik27
Enhance LLMEval Class to Accept Model Parameters 💡Enhancements Something can be improved
#1052 opened Jun 19, 2024 by chakravarthik27
1
@chakravarthik27
Fix Security and Dependency Issues 🛠️ Maintenance Flagged under maintenance
#1045 opened Jun 17, 2024 by chakravarthik27
1
@chakravarthik27
Blogpost on Leaderboard for Benchmarking models in locally current release
#1037 opened May 20, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Blogpost on LLM evaluation in healthcare current release
#1036 opened May 20, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Blogpost for LLM Evaluation with Prometheus 2 current release
#1035 opened May 20, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Templates for Chat Models for HuggingFace current release
#1034 opened May 17, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Add Support for Multi-Model with Multi-Dataset current release
#1033 opened May 17, 2024 by chakravarthik27 2.3.0
1
@chakravarthik27
Include 'Better Safe Than Sorry' Dataset in Healthcare Test current release
#1026 opened May 13, 2024 by chakravarthik27 2.3.0
1
@chakravarthik27
Exploring LLM2LLM for Data Augmentation
#1002 opened Apr 1, 2024 by chakravarthik27
Rate Limit feature for Azure/OpenAI results generation current release 💡Enhancements Something can be improved
#988 opened Feb 27, 2024 by Jeff-ZYX
1
implementation of a leaderboard for different quantizations (gguf 4 vs 6 vs etc bits)
#987 opened Feb 26, 2024 by chakravarthik27
Enhancing Data Quality Testing for Langtest ⭐ Feature Indicates new feature requests
#982 opened Feb 19, 2024 by RakshitKhajuria
Explore litellm
#978 opened Feb 6, 2024 by ArshaanNazir
Do Embedding Benchamark for different datasets
#973 opened Feb 2, 2024 by ArshaanNazir
Explore AI-Secure ⏭️ Next Release Issues or Request for the next release
#971 opened Jan 31, 2024 by ArshaanNazir
Explore Together AI embedding models ⏭️ Next Release Issues or Request for the next release
#968 opened Jan 30, 2024 by dcecchini
Try different Prompting Techniques like few shot, ER , COT etc
#959 opened Jan 15, 2024 by ArshaanNazir
1
Explore Galileo's hallucination index ⏭️ Next Release Issues or Request for the next release
#957 opened Jan 11, 2024 by dcecchini
Add tests for De-Identification ⏭️ Next Release Issues or Request for the next release
#954 opened Jan 4, 2024 by dcecchini
@chakravarthik27 @ArshaanNazir
1
Add Word Embedding (with Pooling) to benchmark ⏭️ Next Release Issues or Request for the next release
#950 opened Jan 2, 2024 by dcecchini
Preparing Embeddings Benchmarks (LangTest)
#947 opened Dec 27, 2023 by ArshaanNazir
@chakravarthik27 @ArshaanNazir
9
Preparing LLM Benchmark Table ( LangTest)
#946 opened Dec 27, 2023 by ArshaanNazir
@ArshaanNazir
9
ProTip! Add no:assignee to see everything that’s not assigned.