Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamic path for DS-mobilenet #12

Open
NoLookDefense opened this issue Jan 7, 2022 · 1 comment
Open

Dynamic path for DS-mobilenet #12

NoLookDefense opened this issue Jan 7, 2022 · 1 comment

Comments

@NoLookDefense
Copy link

Hi. Thanks for your work. I am reading your paper and trying to reimplement, and I feel confused about some details.
You mentioned in your paper that the slimming ratio ρ∈[0.35 : 0.05 : 1.25], which have 18 paths.
However, in your code, there are only 14 paths ρ∈[0.35 : 0.05 : 1] as mentioned in

[list(range(736, 1152 + 1, 32)), 2, 3, 2, 'ds', False],

. And also, when conducting gate training, the gate function only has a 4-dimension output, meaning that there is only 4 paths and the slimming ratio is restricted to ρ∈[0.35 : 0.05 : 0.5].
channel_gate_num=4 if has_gate else 0)

Why the dynamic path for larger network is not used?

@changlin31
Copy link
Owner

Hi, @NoLookDefense
We made some explanations on the implementation of the routing space in the Supplementary Material.

  1. For number of paths:

image

2. For restricted paths:

image

Please feel free to ask if you have further questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants