who affects whom

one causal self-attention head · D = xBxT, E = SA·V

  • this cell
  • read directly
  • further upstream
  • reads it
  • further downstream
  • masked
  • + −  size = magnitude