Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable configuration/tags to turn off data introspection in SDK #921

Open
skrawcz opened this issue May 27, 2024 · 0 comments
Open

Enable configuration/tags to turn off data introspection in SDK #921

skrawcz opened this issue May 27, 2024 · 0 comments
Labels
enhancement New feature or request SDK Related to hamilton SDK for th UI UI Related to the Hamilton UI

Comments

@skrawcz
Copy link
Collaborator

skrawcz commented May 27, 2024

Is your feature request related to a problem? Please describe.
Currently the SDK introspects all outputs. Sometimes, especially in the case of Parallel, this could be a really long list of things; it'd be nice to turn it off selectively.

Describe the solution you'd like
Option 1: inspect tag to skip

@tag(sdk=["skip.introspection"])
def my_func(...) -> ...:

Option 2: skip via configuration

sdk_config = {"my_func": ["skip.introspection"]}
HamiltonTracker(..., tracker_config=sdk_config) # or some config file

We'd then want these to both output some type of result that the UI could then render.
Minimally based on the type returned it could be something basic about it -- so when you got to the UI you can see that this was skipped.

Describe alternatives you've considered
N/A

Additional context
This is an optimization.

Functionality to hide sensitive information from being logged could follow a similar path -- but likely a more explicit decorator in the code would be best in this situation.

@skrawcz skrawcz added enhancement New feature or request UI Related to the Hamilton UI SDK Related to hamilton SDK for th UI labels May 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request SDK Related to hamilton SDK for th UI UI Related to the Hamilton UI
Projects
None yet
Development

No branches or pull requests

1 participant