Thu 16 Jun 2022 16:30 - 16:50 at Macaw - Storage Chair(s): Albert Cohen

Because of its many desirable properties, such as its ability to control effects and thus potentially disastrous race conditions, functional programming offers a viable approach to programming modern multicore computers. Over the past decade several parallel functional languages, typically based on dialects of ML and Haskell, have been developed. These languages, however, have traditionally underperformed procedural languages (such as C and Java). The primary reason for this is their hunger for memory, which only grows with parallelism, causing traditional memory management techniques to buckle under increased demand for memory. Recent work opened a new angle of attack on this problem by identifying a memory property of determinacy-race-free parallel programs, called disentanglement, which limits the knowledge of concurrent computations about each other’s memory allocations. The work has showed some promise in delivering good time scalability.

In this paper, we present provably space-efficient automatic memory management techniques for determinacy- race-free functional parallel programs, allowing both pure and imperative programs where memory may be destructively updated. We prove that for a program with sequential live memory of $R^$, any $P$-processor garbage-collected parallel run requires at most $O(R^ \cdot P)$ memory. We also prove a work bound of $O(W + R^* P)$ for $P$-processor executions, accounting also for the cost of garbage collection. To achieve these results, we integrate thread scheduling with memory management. The idea is to coordinate memory allocation and garbage collection with thread scheduling decisions so that each processor can allocate memory without synchronization and independently collect a portion of memory by consulting a collection policy, which we formulate. The collection policy is fully distributed and does not require communicating with other processors. We show that the approach is practical by implementing it as an extension to the MPL compiler for Parallel ML. Our experimental results confirm our theoretical bounds and show that the techniques perform and scale well.

Thu 16 Jun

Displayed time zone: Pacific Time (US & Canada) change

15:30 - 16:50
StorageSIGPLAN Track at Macaw
Chair(s): Albert Cohen Google
15:30
20m
Talk
(PLDI 2020) Automatic Generation of Efficient Sparse Tensor Format Conversion Routines
SIGPLAN Track
Stephen Chou Massachusetts Institute of Technology, Fredrik Kjolstad Stanford University, Saman Amarasinghe MIT CSAIL
15:50
20m
Talk
(PLDI 2020) NVTraverse: In NVRAM Data Structures, the Destination is More Important than the Journey
SIGPLAN Track
Naama Ben-David Carnegie Mellon University, USA, Guy E. Blelloch Carnegie Mellon University, Michal Friedman Technion, Israel, Erez Petrank Technion, Israel, Yuanhao Wei Carnegie Mellon University, USA
16:10
20m
Talk
(PLDI 2021) Mirror: Making Lock-Free Data Structures Persistent
SIGPLAN Track
Michal Friedman Technion, Israel, Erez Petrank Technion, Israel, Pedro Ramalhete Cisco Systems
16:30
20m
Talk
(POPL 2021) Provably Space Efficient Parallel Functional Programming
SIGPLAN Track
Jatin Arora Carnegie Mellon University, Sam Westrick Carnegie Mellon University, Umut A. Acar Carnegie Mellon University