Interface

• preprare [sync, once]:

  • IN: List[int layer_id]
  • OUT: List[gpu0_buffer_ptr, gpu1_buffer_ptr, …, gpu7_buffer_ptr]

• ready [sync]: until ok

  • IN: int layer_id
  • OUT: return ok
  • ERROR: return others

• release [async]

  • IN: layer id
  • OUT: return ok
  • ERROR: return others

• grad_prepare [sync, once]

  • IN:
  • OUT:

• grad_ready [sync]: return ok when the buffer_ptr is avaliable

  • IN: layer_id
  • OUT: return ok

• grad_release [async]

  • IN: layer_id
  • OUT: return ok