Julia parallel task runtime (WIP)
source link: https://www.tuicool.com/articles/hit/eaUrEnR
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
This replaces the existing fork-join threading infrastructure with a parallel task runtime (partr) that implements parallel depth first scheduling . This model fully supports nested parallelism.
The default remains the original threading code. Enable partr by setting JULIA_PARTR := 1
in your Make.user
.
The core idea is simple -- Julia tasks can now be run by any thread. The task scheduler attempts to order task execution depth-first for provably better cache efficiency, and for true nested parallelism.
However, as tasks are an existing thing in Julia and used in a number of places, we're first introducing the infrastructure that will enable parallel tasks with this PR, keeping (hopefully) the serial semantics of the existing task interface. This PR does not introduce any new interface calls for parallel tasks -- those will be in future PRs.
All test-cases pass with JULIA_PARTR
off (as they should). With JULIA_PARTR
on, all test cases are currently passing on Linux and OS-X.
Cc: @JeffBezanson , @vtjnash , @yuyichao , @ViralBShah , @vchuravy , @anton-malakhov .
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK