In the load pipeline, separate the network request from the post-download CPU work, and throttle them differently #473
Labels
enhancement
New feature or request
performance
Improvements to performance, including reductions in memory usage
I am not sure how much of an impact it has, but our load thread pool is usually saturated by long network requests. Tiles that can be retrieved from the SQL cache however are extremely fast. This creates a conflict where cache retrievals are inevitably waiting on a load thread to finish resolving a network request. I think it ends up being bad scheduling to have very long-running tasks and very fast tasks in the same threads. If we can dedicate a thread pool to only process cache hits, cache loads may become even faster. The network load pool and cache load pool may need to be dynamically sized to not introduce any new bottlenecks.
The text was updated successfully, but these errors were encountered: