Several types of systems of parallel communicating restarting automata are introduced andstudied. The main result shows that, for all types of restarting automata X, centralizedsystems of restarting automata of type X have the same computational power asnon-centralized systems of restarting automata of the same type and the same number ofcomponents. This result is proved by a direct simulation. In addition, it is shown thatfor one-way restarting automata without auxiliary symbols, systems of degree at least twoare more powerful than the component automata themselves. Finally, a lower and an upperbound are given for the expressive power of systems of parallel communicating restartingautomata.