Background

This document provides some background to rapidsmpf and the problems it is designed to solve.

Contents:

• Shuffle Architecture
  • “Streaming” collective operations
  • Shuffles
• Streaming execution
  • Concepts
  • Building Actor networks from query plans
  • Key Concepts
• Channels
  • Backpressure
• Actors
  • Actor Types