Logo image
Communication-Free Data Allocation Techniques for Parallelizing Compilers on Multicomputers
Journal article   Peer reviewed

Communication-Free Data Allocation Techniques for Parallelizing Compilers on Multicomputers

Tzung-Shi Chen and Jang-Ping Sheu
IEEE Transactions on Parallel and Distributed Systems, Vol.5(9), pp.924-938
1994

Abstract

In distributed memory multicomputers, local memory accesses are much faster than those involving interprocessor communication. For the sake of reducing or even eliminating the interprocessor communication, the array elements in programs must be carefully distributed to local memory of processors for parallel execution. In this paper, we devote our efforts to the techniques of allocating array elements of nested loops onto multicomputers in a communication-free fashion for parallelizing compilers. We first analyze the pattern of references among all arrays referenced by a nested loop, and then partition the iteration space into blocks without interblock communication. The arrays can be partitioned under the communication-free criteria with nonduplicate or duplicate data. Finally, a heuristic method for mapping the partitioned array elements and iterations onto the fixed-size multicomputers under the consideration of load balancing is proposed. Based on our methods, the nested loops can execute without any communication overhead on the distributed memory multicomputers. Moreover, the performance of the strategies with nonduplicate and duplicate data for matrix multiplication is studied. © 1994 IEEE

Metrics

1 Record Views

Details

Logo image