NVIDIA Green Contexts：控制 GPU 工作负载共享
Control How Your GPU Shares Work with Green Contexts
NVIDIA 推出 Green Contexts，用于控制单个进程内多个独立组件之间的 GPU 资源共享。GPU 应用常同时运行延迟敏感的算子和面向吞吐的后台 kernel，或数据预处理与模型推理，资源分配一直较难。
GPU applications increasingly consist of multiple independent components running at the same time within a single process: a latency-sensitive operator...
GPU applications increasingly consist of multiple independent components running at the same time within a single process: a latency-sensitive operator alongside a throughput-oriented background kernel; a data preprocessing stage alongside model inference; or multiple stages of a processing workflow sharing a single GPU. Controlling how GPU resources are shared between them remains difficult.
来源：NVIDIA Developer Blog · developer.nvidia.com