Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The workdir setting does not appear to work for the Dask/local executors #1940

Open
Andrew-S-Rosen opened this issue Mar 6, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@Andrew-S-Rosen
Copy link
Contributor

Andrew-S-Rosen commented Mar 6, 2024

Environment

  • Covalent version: 0.234.0rc0
  • Python version: 3.10.13
  • Operating system: Ubuntu

What is happening?

Back in #1619, the workdir setting was introduced for the Dask and local executors to allow for user-specified working directories. The default workdir is typically something like the following:

/home/rosen/.cache/covalent/workdir

which can be seen with a ct.get_config() check. One would expect, then, the files (by default) to be written out to this workdir directory, but they are not. The proof is shown below.

How can we reproduce the issue?

import covalent as ct

@ct.lattice
@ct.electron
def test():
    from pathlib import Path

    return Path.cwd()

ct.dispatch(test)()

In my case, I got back

/home/rosen/software/miniconda/envs/covalent/lib/python3.10/site-packages/covalent_ui

When I try changing doing

import covalent as ct

ct.set_config({"executors.dask.workdir": "/home/rosen/test"})

and rerunning the above script again, I still get the same answer back.

What should happen?

The working directory of the Python process when run via the Dask or local executors should correspond to the workdir variable.

Any suggestions?

No response

@Andrew-S-Rosen Andrew-S-Rosen added the bug Something isn't working label Mar 6, 2024
@Andrew-S-Rosen Andrew-S-Rosen closed this as not planned Won't fix, can't repro, duplicate, stale Mar 6, 2024
@Andrew-S-Rosen Andrew-S-Rosen changed the title Modification of the current working directory can lead to unexpected behavior The workdir setting does not appear to work for the Dask/local executors Mar 6, 2024
@Andrew-S-Rosen Andrew-S-Rosen reopened this Mar 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant