Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Storage] Creating new buckets in sky jobs launch fails #3666

Open
romilbhardwaj opened this issue Jun 14, 2024 · 1 comment · May be fixed by #3671
Open

[Storage] Creating new buckets in sky jobs launch fails #3666

romilbhardwaj opened this issue Jun 14, 2024 · 1 comment · May be fixed by #3671
Assignees

Comments

@romilbhardwaj
Copy link
Collaborator

sky jobs launch --cloud aws task.yaml

file_mounts:
  /outputs:
    name: romil-sky-outputs1 # This is a new unique bucket
    store: s3
    mode: MOUNT

run: |
  echo "Hello, world!" > /outputs/hello.txt

Fails with:

$ sky jobs logs --controller 1
...
(sky-4d6a-romilb, pid=30569) sky.exceptions.StorageSpecError: Attempted to mount a non-sky managed bucket 'romil-sky-outputs1' without specifying the storage source. Bucket 'romil-sky-outputs1' already exists.
(sky-4d6a-romilb, pid=30569)     • To create a new bucket, specify a unique name.
(sky-4d6a-romilb, pid=30569)     • To mount an externally created bucket (e.g., created through cloud console or cloud cli), specify the bucket URL in the source field instead of its name. I.e., replace `name: romil-sky-outputs1` with `source: s3://romil-sky-outputs1`.
ERROR: Job 1 failed with return code list: [1]

For controllers, we may need to relax this check.

@romilbhardwaj romilbhardwaj self-assigned this Jun 14, 2024
@romilbhardwaj
Copy link
Collaborator Author

Should also update smoke tests to test this case.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant