Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve data transfer between ScalaPy and Python #232

Open
3 tasks
itopcic opened this issue Oct 27, 2021 · 1 comment
Open
3 tasks

Improve data transfer between ScalaPy and Python #232

itopcic opened this issue Oct 27, 2021 · 1 comment

Comments

@itopcic
Copy link

itopcic commented Oct 27, 2021

The goal is to improve the transfer speed of data passing from ScalaPy to Python. This would make ScalaPy programs which rely heavily on data switching from one to other run much faster.

The current plan for solving this issue is:

These two alone could bring a speedup of an order of magnitude if not more.

  • Find and implement optimization like low-level copying of data (if possible) or using proxies for accessing some data

The last one is the most open as there is no guarantee that optimization can and will be found but it is definitely the most interesting and time demanding.

@i10416
Copy link

i10416 commented Dec 10, 2021

What do you think of jdk.incubator.foreign APIs introduced since jdk 174? I think this will reduce a lot of boilerplate in native code while keeping performance.

This project uses them and this article says its performance advantage over JNA.

https://dev.to/markehammons/slinc-update-5afi

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants