(POPL 2021) Provably Space Efficient Parallel Functional Programming
Because of its many desirable properties, such as its ability to control effects and thus potentially disastrous race conditions, functional programming offers a viable approach to programming modern multicore computers. Over the past decade several parallel functional languages, typically based on dialects of ML and Haskell, have been developed. These languages, however, have traditionally underperformed procedural languages (such as C and Java). The primary reason for this is their hunger for memory, which only grows with parallelism, causing traditional memory management techniques to buckle under increased demand for memory. Recent work opened a new angle of attack on this problem by identifying a memory property of determinacy-race-free parallel programs, called disentanglement, which limits the knowledge of concurrent computations about each other’s memory allocations. The work has showed some promise in delivering good time scalability.
In this paper, we present provably space-efficient automatic memory management techniques for determinacy- race-free functional parallel programs, allowing both pure and imperative programs where memory may be destructively updated. We prove that for a program with sequential live memory of $R^$, any $P$-processor garbage-collected parallel run requires at most $O(R^ \cdot P)$ memory. We also prove a work bound of $O(W + R^* P)$ for $P$-processor executions, accounting also for the cost of garbage collection. To achieve these results, we integrate thread scheduling with memory management. The idea is to coordinate memory allocation and garbage collection with thread scheduling decisions so that each processor can allocate memory without synchronization and independently collect a portion of memory by consulting a collection policy, which we formulate. The collection policy is fully distributed and does not require communicating with other processors. We show that the approach is practical by implementing it as an extension to the MPL compiler for Parallel ML. Our experimental results confirm our theoretical bounds and show that the techniques perform and scale well.
Thu 16 JunDisplayed time zone: Pacific Time (US & Canada) change
15:30 - 16:50 | |||
15:30 20mTalk | (PLDI 2020) Automatic Generation of Efficient Sparse Tensor Format Conversion Routines SIGPLAN Track Stephen Chou Massachusetts Institute of Technology, Fredrik Kjolstad Stanford University, Saman Amarasinghe MIT CSAIL | ||
15:50 20mTalk | (PLDI 2020) NVTraverse: In NVRAM Data Structures, the Destination is More Important than the Journey SIGPLAN Track Naama Ben-David Carnegie Mellon University, USA, Guy E. Blelloch Carnegie Mellon University, Michal Friedman Technion, Israel, Erez Petrank Technion, Israel, Yuanhao Wei Carnegie Mellon University, USA | ||
16:10 20mTalk | (PLDI 2021) Mirror: Making Lock-Free Data Structures Persistent SIGPLAN Track | ||
16:30 20mTalk | (POPL 2021) Provably Space Efficient Parallel Functional Programming SIGPLAN Track Jatin Arora Carnegie Mellon University, Sam Westrick Carnegie Mellon University, Umut A. Acar Carnegie Mellon University |