Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

output dir in inner_join does not listen... #389

Open
KnutJaegersberg opened this issue Dec 1, 2022 · 2 comments
Open

output dir in inner_join does not listen... #389

KnutJaegersberg opened this issue Dec 1, 2022 · 2 comments

Comments

@KnutJaegersberg
Copy link

I tried to set the output dir in inner_join, to avoid that it makes a temp dir on my small primary HD on Linux and uses my secondary HD mount.
But nonetheless, a step on line 32 in the inner_join.R, it makes a tempdir nonetheless.
I used unixtools::set.tempdir("/run/media/knut/HD/tmp/') as a quick fix, one can I guess also change temp variable in .Rprofile file.
But it's not working as expected, so I thought I open an issue.
@KnutJaegersberg
Copy link
Author

However, as I manually overwrote those two lines, as a first attempt to solve it,

  x = rechunk(x, shardby=by, nchunks = max(ncy,ncx), outdir = tempfile(fileext = ".df"), overwrite = FALSE)
  y = rechunk(y, shardby=by, nchunks = max(ncy,ncx), outdir = tempfile(fileext = ".df"), overwrite = FALSE)

with my own tempdir, it still wrote to the primary hd tempdir, regardless. Thus the reason could be elsewhere, too.

@xiaodaigh
Copy link
Collaborator

xiaodaigh commented Dec 3, 2022 •
edited
Loading

I see. What does tempdir() give you? cos tempfile calls tempdir to obtain the temporary directory. The temp directory is set per R session, so probably need a way to set it for all R Sesions.. I don't recall which setting is used. I wonder if setting a TMPDIR environment variable would work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@xiaodaigh @KnutJaegersberg