Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add SnorkelAI? #78

Open
mdingemanse opened this issue Feb 15, 2024 · 0 comments
Open

add SnorkelAI? #78

mdingemanse opened this issue Feb 15, 2024 · 0 comments

Comments

@mdingemanse
Copy link
Collaborator

mdingemanse commented Feb 15, 2024

The customary 'release by blog post' strategy:
https://snorkel.ai/new-benchmark-results-demonstrate-value-of-snorkel-ai-approach-to-llm-alignment/

HF page with model card used mainly for advertising:
https://huggingface.co/snorkelai/Snorkel-Mistral-PairRM-DPO

Based on Mistral 7B so every bit as closed as that except for Ultrafeedback DPO data (the "RL" component).

I hesitate to add this because it is so obviously designed as an attention grab: get a high position on a leaderboard, then release and advertise the leaderboard position as a reason for folks to get in business with you. It is not clear Snorkel is being offered as anything like a serious 'open' model for other than commercial downstream uses.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant