Skip to content

Issues: promptfoo/promptfoo

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

66 Open 382 Closed
66 Open 382 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Expose runAssertion for advanced integration
#1014 opened Jun 26, 2024 by mihalik
2
WebUI Concurrent Editing Issue: Data Overwrites
#1013 opened Jun 26, 2024 by pchuri
Proxy Support for Azure with Client credentials enhancement New feature or request
#1012 opened Jun 25, 2024 by chittamitgit
1
Proxy support for AWS SDK enhancement New feature or request
#1010 opened Jun 25, 2024 by aureliomarcoag
Use @googleapis/* packages instead of googleapis dependencies Pull requests that update a dependency file
#1008 opened Jun 24, 2024 by benasher44
1
Feature request: integrate file_ids for evaluating assistants dependencies Pull requests that update a dependency file enhancement New feature or request
#1007 opened Jun 24, 2024 by gonzab
[Web UI] Increase robustness of markdown rendering for tables enhancement New feature or request
#1003 opened Jun 24, 2024 by mannharleen
Error while running npx promptfoo@latest init --no-interactive my-redteam-project on Mac M1 bug Something isn't working
#1001 opened Jun 23, 2024 by rrbanda
6
Enhance UI to group --repeat tests into collapsible sections enhancement New feature or request
#992 opened Jun 22, 2024 by aantn
Latency is overriden when response is cached enhancement New feature or request
#980 opened Jun 21, 2024 by trondrensel
How to calculate something like F1 score? question Further information is requested
#979 opened Jun 20, 2024 by manojlds
1
How to run a test_use_cases.yaml on all the prompts from an input CSV. question Further information is requested
#974 opened Jun 20, 2024 by SysOverdrive
[WebUI] Do not re-render markdown for images in result cells bug Something isn't working
#969 opened Jun 19, 2024 by chrismaltais
1
punycode module is deprecated bug Something isn't working
#961 opened Jun 18, 2024 by chenrui333
Is there a way to attach a Debugger to the call_api Python External Provider enhancement New feature or request
#955 opened Jun 18, 2024 by SysOverdrive 0.65.0
2
Avg Latency is not cached enhancement New feature or request
#945 opened Jun 17, 2024 by jay0129
[Feature suggestion]: Exposing model costs for usage with Custom Providers enhancement New feature or request
#940 opened Jun 16, 2024 by Codeshark-NET
3
Feature Request: [Web UI] Show assertion details when using assert-set enhancement New feature or request
#919 opened Jun 11, 2024 by sjsinju
Failed to fetch when attempting to log in/sign up on the web-UI after promptfoo share bug Something isn't working
#892 opened Jun 7, 2024 by MehakGopal
expression to select subset of output to display in view enhancement New feature or request
#879 opened Jun 6, 2024 by pelikhan
3
[Web UI] Image previewer not working for variables or failed tests bug Something isn't working
#865 opened Jun 4, 2024 by chrismaltais
Support systemInstruction for Gemini (PALM) enhancement New feature or request
#837 opened May 31, 2024 by YiFanChen99 0.63.0
7
Not working using text prompt with Palm2 Google Vertex API bug Something isn't working
#826 opened May 28, 2024 by rmonteiro89
1
Allow overriding provider config in prompt or test case enhancement New feature or request
#815 opened May 24, 2024 by tomquist
Markdown appearing when manually failing test case bug Something isn't working
#810 opened May 23, 2024 by chrismaltais
2
ProTip! Follow long discussions with comments:>50.