New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use os.pwrite on unix to write chunks in parallel #4487

Open

milahu opened this issue Jun 16, 2024 · 0 comments

Assignees

Labels

feature request pyLoad Next

milahu commented Jun 16, 2024 •

edited

Loading

on unix, pyload should write one file with os.pwrite

currently, pyload writes every chunk to a separate file, and then joins the files
but writing multiple files is bad for SSD

on windows, pyload should throw a fatal error sorry mate your OS sucks : P

https://old.reddit.com/r/rust/comments/gkhakc/what_is_the_best_way_to_write_to_a_file_using/

https://www.geeksforgeeks.org/python-os-pwrite-method/

https://board.jdownloader.org/showthread.php?t=61760

https://stackoverflow.com/questions/3852758/equivalent-to-pread-pwrite-in-msvc

https://stackoverflow.com/questions/50902714/python-pread-pwrite-only-on-unix

https://github.com/vimpunk/cratetorrent#how-to-run

https://old.reddit.com/r/rust/comments/kiah3q/i_wrote_cratetorrent_a_bittorrent_engine_in_rust/

vimpunk/cratetorrent#95

https://docs.rs/tokio-file/latest/tokio_file/trait.AioFileExt.html#method.writev_at

related #4421

The text was updated successfully, but these errors were encountered:

milahu added feature request pyLoad Next labels

milahu assigned vuolter

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment