How can I train the adalora about nn.Conv1d? #1640
Unanswered
girlsending0
asked this question in
Q&A
Replies: 2 comments
-
Indeed, as you observed, the The error message could certainly be improved, as the small vs capital |
Beta Was this translation helpful? Give feedback.
0 replies
-
@BenjaminBossan |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I face the problem when I finetune the Whisper model.
Whisper model is consisted of nn.Conv1d layer. so, I want finetune only encoder and try below:)
but I got error,
![image](https://private-user-images.githubusercontent.com/83329561/321546140-45c507a3-658f-4a12-bffd-5c60deaaeabb.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk2MTgxMTksIm5iZiI6MTcxOTYxNzgxOSwicGF0aCI6Ii84MzMyOTU2MS8zMjE1NDYxNDAtNDVjNTA3YTMtNjU4Zi00YTEyLWJmZmQtNWM2MGRlYWFlYWJiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI4VDIzMzY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNmOTQ0Y2MzOWMzZjU1NDk5ZDgwYjBkYzI2Y2YwMmVjODc0ODZlNTBmZTJhOWM4MzczYTYyYWI5ZjA5ZmQxMmEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.URAFZBkVY1w83HR5-LJb2q7D2W0y9rFBzIIDvoDWKIY)
I think this error is because the whisper model consists of nn.Conv1d layer. However, Adalora only accepts Conv1D of the hugging face as target_modules.
Does anyone know about this error?
Beta Was this translation helpful? Give feedback.
All reactions