[Parallel] processing is, in sharp contrast to just a [Concurrent] processing, guaranteed to start / perform / finish all thread-level and/or instruction-level tasks executed in a parallel fashion and provides a guaranteed finish of the simultaneously executed code-paths.

- Stackoverflow.com Wiki