CS_ALearn/openmlsys-zh
1
0
Fork 0
mirror of https://github.com/openmlsys/openmlsys-zh.git synced 2026-04-13 16:59:43 +08:00
Code Issues Projects Releases Wiki Activity

Update Chapter 10 distribute training (#56)

Browse Source
This commit is contained in:
Cheng Lai
2022-03-10 16:15:39 +08:00
committed by GitHub
parent eb1d14dd94
commit dc96a6faab
35 changed files with 6407 additions and 21 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
chapter_distributed_training/collective.md
View File

@@ -6,11 +6,11 @@ Centers），以及如何在数据中心中高效实现集合通讯，从而让
### 在数据中心的梯度计算
![数据中心](../img/ch09/ch10-datacentre.pdf)
![数据中心](../img/ch09/ch10-datacentre.svg)
:width:`800px`
:label:`ch10-datacentre`
:numref:`ch10-datacentre` 描述了一个典型的用于深度学习模型训练的数据中心。数据中心中的训练服务器一般会有多个设备。如需增加服务器，我们会将多个训练服务器放置在一个机柜（Rack）上，同时接入一个架顶交换机（Top
:numref:`ch10-datacentre` 描述了一个典型的用于深度学习模型训练的数据中心。数据中心中的训练服务器一般会有多个设备。如需增加服务器，我们会将多个训练服务器放置在一个机柜（Rack）上，同时接入一个架顶交换机（Top
of Rack
Switch）来连接多个服务器。当一个机柜满的时候，我们可以通过在架顶交换机之间增加骨干交换机（Spine
Switch），接入新的机柜。通过这种方式，我们可以在数据中心内不断增加服务器，从而为神经网络的训练提供海量的算力和内存。目前的商用数据中心可能拥有超过一百万台服务器。
@@ -31,7 +31,7 @@ GPU），而在一个服务器内的多个设备可以通过高速机内网络
为了在数据中心中高效完成梯度平均的操作，我们往往会实现
Allreduce算法。这个算法诞生的背景是：传统计算平均梯度的方法往往是在集群中找出一个设备来收集本地梯度，计算平均梯度，然后再将平均梯度广播到全部的设备。这种做法易于实现，但是其引入了两个问题。首先，多设备共同给这个聚合设备发送数据的时候，在聚合设备上往往会产生严重的带宽不足和网络拥塞。其次，单设备需要负担大量的梯度平均的计算，而受限于单设备上的有限算力，这种平均计算会受限于算力瓶颈。
![Allreduce初始状态和终止状态](../img/ch09/ch10-allreduce-state.pdf)
![Allreduce初始状态和终止状态](../img/ch09/ch10-allreduce-state.svg)
:width:`800px`
:label:`ch10-allreduce-state`
@@ -41,12 +41,12 @@ Allreduce算法。这个算法诞生的背景是：传统计算平均梯度的
= 1 + 2 +
4）。为了计算平均梯度，每个设备只需要在最后将梯度之和除以设备数量即可（分区1的最终结果为7除以3）。
![Allreduce算法的过程](../img/ch09/ch10-allreduce-process.pdf)
![Allreduce算法的过程](../img/ch09/ch10-allreduce-process.svg)
:width:`800px`
:label:`ch10-allreduce-process`
Allreduce算法会把梯度的加和计算拆分成$M-1$个Reduce步骤和$M-1$个Broadcast步骤（其中$M$是节点的数量）。Reduce步骤是为了计算出梯度的和（Summation），Broadcast步骤是为了把梯度之和广播给全部的节点。为了说明这些步骤的执行过程，我们利用
:numref:`ch10-allreduce-process` 。Allreduce算法由Reduce步骤开始，在第一个Reduce步骤中，Allreduce算法会对全部节点进行配对（Pairing），让他们共同完成梯度相加的操作。在 :numref:`ch10-allreduce-process` 的第一个Reduce步骤中，设备1和设备2进行了配对共同对分区1的数据相加。其中，设备2把本地的梯度数据1发送给设备1，设备将接收到1和本地的分区1内的梯度数据：2进行相加，计算出中间（intermediate）梯度相加的结果：3。于此同时，设备1和设备3进行配对，共同完成对分区3的数据相加。而设备3和设备2进行配对，共同完成对于分区2的数据相加。
:numref:`ch10-allreduce-process` 。Allreduce算法由Reduce步骤开始，在第一个Reduce步骤中，Allreduce算法会对全部节点进行配对（Pairing），让他们共同完成梯度相加的操作。在 :numref:`ch10-allreduce-process` 的第一个Reduce步骤中，设备1和设备2进行了配对共同对分区1的数据相加。其中，设备2把本地的梯度数据1发送给设备1，设备将接收到1和本地的分区1内的梯度数据：2进行相加，计算出中间（intermediate）梯度相加的结果：3。于此同时，设备1和设备3进行配对，共同完成对分区3的数据相加。而设备3和设备2进行配对，共同完成对于分区2的数据相加。
在上述Reduce的步骤中，梯度的计算实现了以下几个特性:

16
chapter_distributed_training/methods.md
View File

@@ -4,11 +4,11 @@
### 概述
![单节点训练系统](../img/ch09/ch10-single-node.pdf)
![单节点训练系统](../img/ch09/ch10-single-node.svg)
:width:`800px`
:label:`ch10-single-node`
分布式训练系统的设计目标是：将单节点训练系统转化成**等价的**并行训练系统，从而在不影响模型精度的条件下完成训练过程的加速。一个单节点训练系统往往如:numref:`ch10-single-node`所示。一个训练过程会由多个数据小批次（mini-batch）完成。在图中，一个数据小批次被标示为**数据**。训练系统会利用数据小批次来生成梯度，提升模型精度。这个过程由一个训练**程序**实现。在实际中，这个程序往往实现了一个多层神经网络的执行过程。
分布式训练系统的设计目标是：将单节点训练系统转化成**等价的**并行训练系统，从而在不影响模型精度的条件下完成训练过程的加速。一个单节点训练系统往往如 :numref:`ch10-single-node`所示。一个训练过程会由多个数据小批次（mini-batch）完成。在图中，一个数据小批次被标示为**数据**。训练系统会利用数据小批次来生成梯度，提升模型精度。这个过程由一个训练**程序**实现。在实际中，这个程序往往实现了一个多层神经网络的执行过程。
该神经网络的执行由一个计算图（Computational
Graph）表达。这个图有多个相互连接的算子（Operator），每个算子会拥有计算参数。每个算子往往会实现一个神经网络层（Neural
Network Layer），而参数则代表了这个层在训练中所更新的的权重（Weights）。
@@ -27,7 +27,7 @@ Network Layer），而参数则代表了这个层在训练中所更新的的权
| 多程序 | 多程序单数据：模型并行 | 多程序多数据：混合并行 |
:label:`ch10-parallel-methods`
给定一个单节点训练系统，人们会对**数据**和**程序**分区（Partition），从而完成并行加速。:numref:`ch10-parallel-methods`总结了不同的切分方法。单节点训练系统可以被归类于
给定一个单节点训练系统，人们会对**数据**和**程序**分区（Partition），从而完成并行加速。 :numref:`ch10-parallel-methods`总结了不同的切分方法。单节点训练系统可以被归类于
单程序单数据模式。而假如用户希望使用更多的设备来实现并行计算，他们首先可以选择对数据进行分区，并将同一个程序复制到多个设备上并行执行。这种方式是单程序多数据模式，常被称为**数据并行**（Data
Parallelism）。另一种并行方式是对程序进行分区：程序的算子会被分发给多个设备按照依次完成。这种模式是
多程序单数据模式，常被称为**模型并行**（Model
@@ -38,7 +38,7 @@ Parallelism）。
### 数据并行
![数据并行训练系统](../img/ch09/ch10-data-parallel.pdf)
![数据并行训练系统](../img/ch09/ch10-data-parallel.svg)
:width:`800px`
:label:`ch10-data-parallel`
@@ -51,7 +51,7 @@ Communication）的Allreduce操作来完成。
### 模型并行
![模型并行系统：算子内并行](../img/ch09/ch10-model-parallel-intra-op.pdf)
![模型并行系统：算子内并行](../img/ch09/ch10-model-parallel-intra-op.svg)
:width:`800px`
:label:`ch10-model-parallel-intra-op`
@@ -65,7 +65,7 @@ Parallelism）。
另一种内存不足的场景是：模型的总内存需求超过了单设备的内存容量。在这种场景下，假如我们总共有$N$个算子和$M$个设备，我们可以将算子平摊给这$M$个设备，让每个设备仅需负责$N/M$个算子的前向和反向计算，降低设备的内存开销。这种并行方式是模型并行的另一种应用，被称为**算子间并行**（Inter-operator
Parallelism）。
![模型并行系统：算子间并行](../img/ch09/ch10-model-parallel-inter-op.pdf)
![模型并行系统：算子间并行](../img/ch09/ch10-model-parallel-inter-op.svg)
:width:`800px`
:label:`ch10-model-parallel-inter-op`
@@ -73,8 +73,8 @@ Parallelism）。
### 混合并行
![混合并行系统](../img/ch09/ch10-hybrid-parallel.pdf)
![混合并行系统](../img/ch09/ch10-hybrid-parallel.svg)
:width:`800px`
:label:`ch10-hybrid-parallel`
在训练大型人工智能模型中，我们往往会同时面对算力不足和内存不足。因此，我们需要混合使用数据并行和模型并行，这种方法被称为混合并行。:numref:`ch10-hybrid-parallel`提供了一个由4个设备实现的混合并行的例子。在这个例子中，我们首先实现算子间并行来解决训练程序内存开销过大的问题：该训练程序的算子1和算子2被分摊到了设备1和设备2上。进一步，我们通过数据并行来添加3和设备4，提升系统算力。为了达到这一点，我们对训练数据进行分区（数据分区1和数据分区2），并将模型（算子1和算子2）分配复制到设备3和设备4上生成可以并行执行的程序副本。在前向计算的过程中，设备1和设备3上的算子1副本同时开始，计算结果分别发送（Send）给设备2和设备4完成算子2副本的计算。在反向计算中，设备2和设备4同时开始计算梯度，本地梯度通过Allreduce进行平均。反向计算传递到设备1和设备3上的算子1副本结束。
在训练大型人工智能模型中，我们往往会同时面对算力不足和内存不足。因此，我们需要混合使用数据并行和模型并行，这种方法被称为混合并行。 :numref:`ch10-hybrid-parallel`提供了一个由4个设备实现的混合并行的例子。在这个例子中，我们首先实现算子间并行来解决训练程序内存开销过大的问题：该训练程序的算子1和算子2被分摊到了设备1和设备2上。进一步，我们通过数据并行来添加3和设备4，提升系统算力。为了达到这一点，我们对训练数据进行分区（数据分区1和数据分区2），并将模型（算子1和算子2）分配复制到设备3和设备4上生成可以并行执行的程序副本。在前向计算的过程中，设备1和设备3上的算子1副本同时开始，计算结果分别发送（Send）给设备2和设备4完成算子2副本的计算。在反向计算中，设备2和设备4同时开始计算梯度，本地梯度通过Allreduce进行平均。反向计算传递到设备1和设备3上的算子1副本结束。

8
chapter_distributed_training/overview.md
View File

@@ -4,7 +4,7 @@
接下来，我们详细讨论分布式训练系统的设计动机
![对比机器学习模型参数量增长和计算硬件的算力增长](../img/ch09/ch10-computation-increase.pdf)
![对比机器学习模型参数量增长和计算硬件的算力增长](../img/ch09/ch10-computation-increase.svg)
:width:`800px`
:label:`ch10-computation-increase`
@@ -12,7 +12,7 @@
单处理器的算力不足是促使人们设计分布式训练系统的一个主要原因。一个处理器的算力可以用**每秒钟浮点数操作**（Floating
Point Operations Per Second，FLOPS）来衡量。
如:numref:`ch10-computation-increase`所示，根据摩尔定律（Moore's
如 :numref:`ch10-computation-increase`所示，根据摩尔定律（Moore's
Law），中央处理器的算力每18个月增长2倍。虽然计算加速卡，如GPU和Tensor
Processing
Unit（TPU），针对机器学习计算（如矩阵相乘）提供了大量的算力。这些加速卡的发展最终也受限于摩尔定律，增长速度也停留在每18个月2倍。而与此同时，机器学习模型正在快速发展。短短数年，我们从仅能识别有限物体的AlexNet模型，一路发展到在复杂任务中打败人类的AlphaStar。这期间，模型对于算力需求每18个月增长了35倍。解决处理器性能和算力需求之间的鸿沟
@@ -29,12 +29,12 @@ A100）仅能提供最高80GB的内存。单卡内存空间的增长受到硬件
受限于单节点的有限算力，内存和存储资源，人们把关注投向了日益成熟的云计算数据中心。一个数据中心管理着数十万个计算服务器。随着数据中心的全球部署，人们可以很方便地获得数百个服务器。这些服务器可以通过分布式训练系统来协调和管理，解决训练大型机器学习模型过程遇到的算力，内存和存储不足，从而完成训练过程的加速。
![单节点计算和多节点分布式计算](../img/ch09/ch10-single-vs-multi.pdf)
![单节点计算和多节点分布式计算](../img/ch09/ch10-single-vs-multi.svg)
:width:`800px`
:label:`ch10-single-vs-multi`
在设计分布式训练系统的过程中，我们需要找出有资源瓶颈的计算任务，根据计算任务的特点，将其拆分成多个子任务，然后将子任务分发给多个节点（可以是服务器，机器，或者是加速卡）并行完成。
:numref:`ch10-single-vs-multi`描述了如何将单节点执行转换为分布式执行的一般过程。在机器学习系统中，一个计算任务往往会有一组数据（例如训练样本）或者任务（例如算子）作为输入，利用一个计算节点（例如GPU）生成一组输出（例如梯度）。假如单节点成为瓶颈，我们可以利用分布式计算进行加速。分布式执行一般具有三个步骤：第一步，我们需要将输入进行**切分**。第二步，每个输入部分会分发给不同的计算节点，实现**并行**计算。第三步，每个计算节点的输出，进一步**合并**，最终得到和单节点等价的计算结果。这种切分-并行-合并的模式，本质上实现了分而治之算法（Divide-and-Conquer
:numref:`ch10-single-vs-multi`描述了如何将单节点执行转换为分布式执行的一般过程。在机器学习系统中，一个计算任务往往会有一组数据（例如训练样本）或者任务（例如算子）作为输入，利用一个计算节点（例如GPU）生成一组输出（例如梯度）。假如单节点成为瓶颈，我们可以利用分布式计算进行加速。分布式执行一般具有三个步骤：第一步，我们需要将输入进行**切分**。第二步，每个输入部分会分发给不同的计算节点，实现**并行**计算。第三步，每个计算节点的输出，进一步**合并**，最终得到和单节点等价的计算结果。这种切分-并行-合并的模式，本质上实现了分而治之算法（Divide-and-Conquer
Algorithm）的设计思想：由于每个计算节点只需要负责更小的子任务，因此其可以更快速的完成计算，最终形成对整个计算过程的加速。
### 用户益处

4
chapter_distributed_training/parameter_servers.md
View File

@@ -13,11 +13,11 @@ Perception），训练这种神经网络只需要几个GPU即可。而另一方
feature）和产品特征（Item
feature）构成。这些特征往往是大型向量（Vector）。现代推荐系统需要服务数亿的用户，推荐数以千万的商品。假设用户的特征是1MB，而系统需要服务10亿的用户，那么用户的嵌入表就会有1PB的大小。而这个大小远远超过了一个深度学习服务器所具有的内存。假如我们部署大量的昂贵的深度学习服务器来存储海量嵌入表，那么这些服务器上的加速卡的使用率将会极低，无法实现对于硬件的高效利用。
![参数服务器](../img/ch09/ch10-parameter-servers.pdf)
![参数服务器](../img/ch09/ch10-parameter-servers.svg)
:width:`800px`
:label:`ch10-parameter-servers`
为了解决上述问题，人们往往会在稀疏模型集群中混合部署：训练服务器和参数服务器，从而实现对于计算需求和内存需求分别满足。:numref:`ch10-parameter-servers` 描述了带有参数服务器的机器学习集群。这个集群中含有2个训练服务器和2个参数服务器，训练服务器一般是拥有加速卡的计算优化服务器（Compute-optimised
为了解决上述问题，人们往往会在稀疏模型集群中混合部署：训练服务器和参数服务器，从而实现对于计算需求和内存需求分别满足。 :numref:`ch10-parameter-servers` 描述了带有参数服务器的机器学习集群。这个集群中含有2个训练服务器和2个参数服务器，训练服务器一般是拥有加速卡的计算优化服务器（Compute-optimised
server）。而参数服务器一般是内存优化服务器（Memory-optimised
server），其的内存大小一般远远大于计算优化服务器。在一个稀疏模型中往往拥有神经网络参数和嵌入表参数。神经网络较小，其可以存储在训练服务器内存中。而嵌入表很大，因此需要存储在额外的参数服务器中。参数服务器一般会按照键-值对（Key-value
pairs）的方式来存储参数。常用的键包括用户名（User ID），产品名（Item

4
chapter_distributed_training/pipeline.md
View File

@@ -5,7 +5,7 @@
然而，当这类系统的运行中，计算图中的下游设备需要长期持续处于空闲状态，等待上游设备的计算完成，才可以开始计算，这极大降低了设备的平均使用率。这种现象被称为模型并行空洞（Model
Parallelism Bubble）。
![流水线并行系统。注意！图的F和B任务的编号需要更新！](../img/ch09/ch10-pipeline-parallel.pdf)
![流水线并行系统。注意！图的F和B任务的编号需要更新！](../img/ch09/ch10-pipeline-parallel.svg)
:width:`800px`
:label:`ch10-pipeline-parallel`
@@ -14,7 +14,7 @@ Mini-batch）划分为多个微批量（Micro-batch）。假设一个数据小
propagation）和反向传播（Backwards
propagation），计算出梯度。每个微批量对应的梯度将会缓存，等到全部微批量完成，缓存的梯度会被加和，算出平均梯度，更新模型参数。
:numref:`ch10-pipeline-parallel` 进一步给出了一个流水线并行的执行例子。在本例中，模型参数需要切分给4个设备存储。为了充分利用起来这4个设备，我们将小批量切分为2个微批量。当设备1完成第一个微批量的前向传播后（表示为$F_{0,0}$）后，他会将中间结果发送给设备2，触发响应的前向传播任务（表示为$F_{1,0}$）。与此同时，设备1也可以开始第二个微批量的前向传播任务（表示为$F_{0,1}$）。前向传播会在流水线的最后一个设备--设备3--完成。系统于是开始反向传播。设备4开始第1个微批量的反向传播任务（表示为$B_{3,0}$）。该任务完成后的中间结果会被发送给设备3，触发响应的反向传播任务（表示为$B_{2,0}$）。与此同时，设备4会缓存好对应第1个微批量的梯度，接下来开始第2个微批量计算（表示为$B_{3,1}$）。当设备4完成了全部的反向传播计算后，他会将本地缓存的梯度进行相加，并且除以微批量数量，计算出平均梯度，该梯度用于更新模型参数。
:numref:`ch10-pipeline-parallel` 进一步给出了一个流水线并行的执行例子。在本例中，模型参数需要切分给4个设备存储。为了充分利用起来这4个设备，我们将小批量切分为2个微批量。当设备1完成第一个微批量的前向传播后（表示为$F_{0,0}$）后，他会将中间结果发送给设备2，触发响应的前向传播任务（表示为$F_{1,0}$）。与此同时，设备1也可以开始第二个微批量的前向传播任务（表示为$F_{0,1}$）。前向传播会在流水线的最后一个设备--设备3--完成。系统于是开始反向传播。设备4开始第1个微批量的反向传播任务（表示为$B_{3,0}$）。该任务完成后的中间结果会被发送给设备3，触发响应的反向传播任务（表示为$B_{2,0}$）。与此同时，设备4会缓存好对应第1个微批量的梯度，接下来开始第2个微批量计算（表示为$B_{3,1}$）。当设备4完成了全部的反向传播计算后，他会将本地缓存的梯度进行相加，并且除以微批量数量，计算出平均梯度，该梯度用于更新模型参数。
流水线并行的关键因素是流水线泡沫（Bubble）。当设备完成前向传播后，必须等到全部反向传播开发，在此期间设备会处于空闲状态。在 :numref:`ch10-pipeline-parallel` 中，我们可以看到设备1在完成2个前向传播任务后，要等很多时间才能开始2个传向传播任务。这其中的等待时间即被称为泡沫。为了减少设备的等待时间，一种常见的做法是尽可能的增加微批量的数量，从而让反向传播尽可能早的开始。然而，使用非常小的微批量大小，可能会造成加速器无法被充分利用。因此最优的微批量大小是多种因素的折中。其中最核心的因素是流水线泡沫的大小和加速器的计算能力。

BIN
img/ch09/ch10-allreduce-process.pdf
View File

Binary file not shown.

1132
img/ch09/ch10-allreduce-process.svg Normal file
View File

File diff suppressed because it is too large Load Diff
Side by Side

After

Width:  |  Height:  |  Size: 81 KiB

BIN
img/ch09/ch10-allreduce-state.pdf
View File

Binary file not shown.

732
img/ch09/ch10-allreduce-state.svg Normal file
View File

@@ -0,0 +1,732 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="1176"
height="457.09634"
viewBox="0 0 1176 457.09634"
sodipodi:docname="ch10-allreduce-state.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 883 V 364 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
inkscape:zoom="0.78378348"
inkscape:cx="290.25873"
inkscape:cy="247.51734"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-allreduce-state"
transform="matrix(1.3333333,0,0,-1.3333333,-1.3333325,475.63801)"><g
id="g10" /><g
id="g22"><path
d="m 103.5,300.1664 c 0,8.4685 6.8651,15.3336 15.3336,15.3336 h 155.3328 c 8.4685,0 15.3336,-6.8651 15.3336,-15.3336 V 238.8336 C 289.5,230.3651 282.6349,223.5 274.1664,223.5 H 118.8336 c -8.4685,0 -15.3336,6.8651 -15.3336,15.3336 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,103.5,315.5)"><path
d="M 0,194737.2 C 0,87186.82 87186.65,0 194736.8,0 H 2167463 c 107550,0 194737,87186.82 194737,194737.2 v 778925.6 c 0,107550.2 -87187,194737.2 -194737,194737.2 H 194736.8 C 87186.65,1168400 0,1081213 0,973662.8 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path28" /></g><path
d="m 111.5,278.5 h 56 v -39 h -56 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path30" /><g
id="g32"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,111.5,278.5)"><path
d="M 0,0 H 711200 V 495300 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path34" /></g><g
id="g36"
transform="translate(134.5547,-110)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text40"><tspan
x="0"
y="0"
id="tspan38">2</tspan></text></g><g
id="g42"
transform="translate(113.4134,-72)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text46"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan44">设备</tspan></text></g><g
id="g48"
transform="translate(154.4134,-72)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text52"><tspan
x="0"
y="0"
id="tspan50">1</tspan></text></g><path
d="m 168.5,278.5 h 56 v -39 h -56 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path54" /><g
id="g56"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,168.5,278.5)"><path
d="M 0,0 H 711200 V 495300 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path58" /></g><g
id="g60"
transform="translate(191.3145,-110)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0"
y="0"
id="tspan62">4</tspan></text></g><path
d="m 225.5,278.5 h 55 v -39 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path66" /><g
id="g68"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,225.5,278.5)"><path
d="M 0,0 H 698500 V 495300 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path70" /></g><g
id="g72"
transform="translate(248.0741,-110)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text76"><tspan
x="0"
y="0"
id="tspan74">6</tspan></text></g><path
d="m 1.5,182.333 c 0,8.3765 6.7905,15.167 15.16701,15.167 H 171.333 c 8.3765,0 15.167,-6.7905 15.167,-15.167 v -60.666 c 0,-8.3765 -6.7905,-15.167 -15.167,-15.167 H 16.66701 C 8.2905,106.5 1.5,113.2905 1.5,121.667 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path78" /><g
id="g80"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,1.5,197.5)"><path
d="M 0,192621.4 C 0,86239.53 86239.35,0 192621,0 h 1964258 c 106382,0 192621,86239.53 192621,192621.4 v 770457.2 c 0,106382.4 -86239,192621.4 -192621,192621.4 H 192621 C 86239.35,1155700 0,1069461 0,963078.6 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path82" /></g><path
d="m 9.5,160.5 h 56 v -38 h -56 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path84" /><g
id="g86"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,9.5,160.5)"><path
d="M 0,0 H 711200 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path88" /></g><g
id="g90"
transform="translate(32.40973,-227)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text94"><tspan
x="0"
y="0"
id="tspan92">1</tspan></text></g><g
id="g96"
transform="translate(11.26842,-190)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text100"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan98">设备</tspan></text></g><g
id="g102"
transform="translate(52.26842,-190)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text106"><tspan
x="0"
y="0"
id="tspan104">2</tspan></text></g><path
d="m 66.5,160.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path108" /><g
id="g110"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,66.5,160.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path112" /></g><g
id="g114"
transform="translate(89.16941,-227)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text118"><tspan
x="0"
y="0"
id="tspan116">2</tspan></text></g><path
d="m 123.5,160.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path120" /><g
id="g122"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,123.5,160.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path124" /></g><g
id="g126"
transform="translate(145.9292,-227)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text130"><tspan
x="0"
y="0"
id="tspan128">3</tspan></text></g><path
d="m 201.5,182.333 c 0,8.3765 6.7905,15.167 15.167,15.167 h 154.666 c 8.3765,0 15.167,-6.7905 15.167,-15.167 v -60.666 c 0,-8.3765 -6.7905,-15.167 -15.167,-15.167 H 216.667 c -8.3765,0 -15.167,6.7905 -15.167,15.167 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path132" /><g
id="g134"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,201.5,197.5)"><path
d="M 0,192621.4 C 0,86239.53 86239.35,0 192621,0 h 1964258 c 106382,0 192621,86239.53 192621,192621.4 v 770457.2 c 0,106382.4 -86239,192621.4 -192621,192621.4 H 192621 C 86239.35,1155700 0,1069461 0,963078.6 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path136" /></g><path
d="m 209.5,160.5 h 56 v -38 h -56 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path138" /><g
id="g140"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,209.5,160.5)"><path
d="M 0,0 H 711200 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path142" /></g><g
id="g144"
transform="translate(232.5075,-227)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text148"><tspan
x="0"
y="0"
id="tspan146">4</tspan></text></g><g
id="g150"
transform="translate(211.3663,-190)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text154"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan152">设备</tspan></text></g><g
id="g156"
transform="translate(252.3663,-190)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text160"><tspan
x="0"
y="0"
id="tspan158">3</tspan></text></g><path
d="m 266.5,160.5 h 56 v -38 h -56 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path162" /><g
id="g164"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,266.5,160.5)"><path
d="M 0,0 H 711200 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path166" /></g><g
id="g168"
transform="translate(289.2673,-227)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text172"><tspan
x="0"
y="0"
id="tspan170">8</tspan></text></g><path
d="m 323.5,160.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path174" /><g
id="g176"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,323.5,160.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path178" /></g><g
id="g180"
transform="translate(342.027,-227)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text184"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan182">12</tspan></text></g><path
d="m 599.5,297.333 c 0,8.3765 6.7905,15.167 15.167,15.167 h 154.666 c 8.3765,0 15.167,-6.7905 15.167,-15.167 v -60.666 c 0,-8.3765 -6.7905,-15.167 -15.167,-15.167 H 614.667 c -8.3765,0 -15.167,6.7905 -15.167,15.167 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path186" /><g
id="g188"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,599.5,312.5)"><path
d="M 0,192621.4 C 0,86239.53 86239.35,0 192621,0 h 1964258 c 106382,0 192621,86239.53 192621,192621.4 v 770457.2 c 0,106382.4 -86239,192621.4 -192621,192621.4 H 192621 C 86239.35,1155700 0,1069461 0,963078.6 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path190" /></g><path
d="m 607.5,275.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path192" /><g
id="g194"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,607.5,275.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path196" /></g><g
id="g198"
transform="translate(630.1545,-112)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text202"><tspan
x="0"
y="0"
id="tspan200">7</tspan></text></g><g
id="g204"
transform="translate(609.0132,-75)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text208"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan206">设备</tspan></text></g><g
id="g210"
transform="translate(650.0132,-75)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text214"><tspan
x="0"
y="0"
id="tspan212">1</tspan></text></g><path
d="m 664.5,275.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path216" /><g
id="g218"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,664.5,275.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path220" /></g><g
id="g222"
transform="translate(682.9143,-112)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text226"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan224">14</tspan></text></g><path
d="m 720.5,275.5 h 56 v -38 h -56 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path228" /><g
id="g230"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,720.5,275.5)"><path
d="M 0,0 H 711200 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path232" /></g><g
id="g234"
transform="translate(739.674,-112)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text238"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan236">21</tspan></text></g><path
d="m 496.5,179.333 c 0,8.3765 6.7905,15.167 15.167,15.167 h 155.666 c 8.3765,0 15.167,-6.7905 15.167,-15.167 v -60.666 c 0,-8.3765 -6.7905,-15.167 -15.167,-15.167 H 511.667 c -8.3765,0 -15.167,6.7905 -15.167,15.167 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path240" /><g
id="g242"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,496.5,194.5)"><path
d="M 0,192621.4 C 0,86239.54 86239.39,0 192621.1,0 H 2169579 c 106382,0 192621,86239.54 192621,192621.4 v 770457.2 c 0,106381.4 -86239,192621.4 -192621,192621.4 H 192621.1 C 86239.39,1155700 0,1069460 0,963078.6 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path244" /></g><path
d="m 505.5,157.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path246" /><g
id="g248"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,505.5,157.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path250" /></g><g
id="g252"
transform="translate(528.0096,-230)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text256"><tspan
x="0"
y="0"
id="tspan254">7</tspan></text></g><g
id="g258"
transform="translate(506.8683,-192)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text262"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan260">设备</tspan></text></g><g
id="g264"
transform="translate(547.8683,-192)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text268"><tspan
x="0"
y="0"
id="tspan266">2</tspan></text></g><path
d="m 562.5,157.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path270" /><g
id="g272"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,562.5,157.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path274" /></g><g
id="g276"
transform="translate(580.7692,-230)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text280"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan278">14</tspan></text></g><path
d="m 618.5,157.5 h 56 v -38 h -56 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path282" /><g
id="g284"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,618.5,157.5)"><path
d="M 0,0 H 711200 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path286" /></g><g
id="g288"
transform="translate(637.529,-230)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text292"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan290">21</tspan></text></g><path
d="m 697.5,179.333 c 0,8.3765 6.7905,15.167 15.167,15.167 h 154.666 c 8.3765,0 15.167,-6.7905 15.167,-15.167 v -60.666 c 0,-8.3765 -6.7905,-15.167 -15.167,-15.167 H 712.667 c -8.3765,0 -15.167,6.7905 -15.167,15.167 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path294" /><g
id="g296"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,697.5,194.5)"><path
d="M 0,192621.4 C 0,86239.53 86239.35,0 192621,0 h 1964258 c 106382,0 192621,86239.53 192621,192621.4 v 770457.2 c 0,106382.4 -86239,192621.4 -192621,192621.4 H 192621 C 86239.35,1155700 0,1069461 0,963078.6 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path298" /></g><path
d="m 705.5,157.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path300" /><g
id="g302"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,705.5,157.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path304" /></g><g
id="g306"
transform="translate(728.1074,-230)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text310"><tspan
x="0"
y="0"
id="tspan308">7</tspan></text></g><g
id="g312"
transform="translate(706.9661,-192)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text316"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan314">设备</tspan></text></g><g
id="g318"
transform="translate(747.9661,-192)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text322"><tspan
x="0"
y="0"
id="tspan320">3</tspan></text></g><path
d="m 762.5,157.5 h 55 v -38 h -55 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path324" /><g
id="g326"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,762.5,157.5)"><path
d="M 0,0 H 698500 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path328" /></g><g
id="g330"
transform="translate(780.8671,-230)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text334"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan332">14</tspan></text></g><path
d="m 818.5,157.5 h 56 v -38 h -56 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path336" /><g
id="g338"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,818.5,157.5)"><path
d="M 0,0 H 711200 V 482600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path340" /></g><g
id="g342"
transform="translate(837.6268,-230)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text346"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan344">21</tspan></text></g><path
d="M 412.5,237.75 H 445 V 250.5 L 470.5,225 445,199.5 v 12.75 h -32.5 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path348" /><g
id="g350"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,412.5,250.5)"><path
d="M 0,161924.8 H 412750.6 V 0 L 736600,323850.4 412750.6,647700 V 485775.2 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path352" /></g><g
id="g354"
transform="translate(155.3719,-25)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:bold;font-size:20px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Bold;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text358"><tspan
x="0 20 40 60"
y="0"
sodipodi:role="line"
id="tspan356">初始状态</tspan></text></g><g
id="g360"
transform="translate(649.0545,-24)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:bold;font-size:20px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Bold;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text364"><tspan
x="0 20 40 60"
y="0"
sodipodi:role="line"
id="tspan362">最终状态</tspan></text></g><g
id="g366"
transform="translate(507.0483,-290)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text370"><tspan
x="0 7.9991999 12.9924 24.9876 29.980801 37.98 42.973202 54.968399 58.9716 66.970802 71.963997 83.959198 88.9524 96.951599"
y="0"
sodipodi:role="line"
id="tspan368">7 = 1 + 2 + 4 </tspan></text></g><g
id="g372"
transform="translate(609.0483,-290)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text376"><tspan
x="0"
y="0"
id="tspan374">(</tspan></text></g><g
id="g378"
transform="translate(614.0483,-290)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text382"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan380">分区</tspan></text></g><g
id="g384"
transform="translate(650.0483,-290)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text388"><tspan
x="0"
y="0"
id="tspan386">1</tspan></text></g><g
id="g390"
transform="translate(658.0483,-290)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text394"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan392">计算过程</tspan></text></g><g
id="g396"
transform="translate(730.0483,-290)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text400"><tspan
x="0"
y="0"
id="tspan398">)</tspan></text></g><g
id="g402"
transform="translate(507.0483,-319)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text406"><tspan
x="0 7.9991999 15.9984 21.999599 33.994801 37.998001 45.9972 50.990398 62.9856 67.978798 75.977997 80.971199 92.9664 96.969597 104.9688"
y="0"
sodipodi:role="line"
id="tspan404">14 = 2 + 4 + 8 </tspan></text></g><g
id="g408"
transform="translate(617.0483,-319)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text412"><tspan
x="0"
y="0"
id="tspan410">(</tspan></text></g><g
id="g414"
transform="translate(622.0483,-319)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text418"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan416">分区</tspan></text></g><g
id="g420"
transform="translate(658.0483,-319)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text424"><tspan
x="0"
y="0"
id="tspan422">2</tspan></text></g><g
id="g426"
transform="translate(666.0483,-319)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text430"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan428">计算过程</tspan></text></g><g
id="g432"
transform="translate(738.0483,-319)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text436"><tspan
x="0"
y="0"
id="tspan434">)</tspan></text></g><g
id="g438"
transform="translate(506.679,-347)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text442"><tspan
x="0 7.9991999 15.9984 21.999599 33.994801 37.998001 45.9972 50.990398 62.9856 67.978798 75.977997 80.971199 92.9664 96.969597 104.9688 112.968"
y="0"
sodipodi:role="line"
id="tspan440">21 = 3 + 6 + 12 </tspan></text></g><g
id="g444"
transform="translate(625.679,-347)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text448"><tspan
x="0"
y="0"
id="tspan446">(</tspan></text></g><g
id="g450"
transform="translate(630.679,-347)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text454"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan452">分区</tspan></text></g><g
id="g456"
transform="translate(666.679,-347)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text460"><tspan
x="0"
y="0"
id="tspan458">3</tspan></text></g><g
id="g462"
transform="translate(674.679,-347)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text466"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan464">计算过程</tspan></text></g><g
id="g468"
transform="translate(746.679,-347)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text472"><tspan
x="0"
y="0"
id="tspan470">)</tspan></text></g><g
id="g474"
transform="translate(405.2823,-100)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text478"><tspan
x="0 12.0006 16.999201 21.997801 28.9944 36.999001 45.993599 54.988201 61.984798"
y="0"
sodipodi:role="line"
id="tspan476">Allreduce</tspan></text></g><g
id="g480"
transform="translate(12.3878,-284)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text484"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan482">分区</tspan></text></g><g
id="g486"
transform="translate(48.38779,-284)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text490"><tspan
x="0"
y="0"
id="tspan488">1</tspan></text></g><g
id="g492"
transform="translate(67.5878,-284)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text496"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan494">分区</tspan></text></g><g
id="g498"
transform="translate(103.5878,-284)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text502"><tspan
x="0"
y="0"
id="tspan500">2</tspan></text></g><g
id="g504"
transform="translate(127.5878,-284)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text508"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan506">分区</tspan></text></g><g
id="g510"
transform="translate(163.5878,-284)"><text
transform="matrix(1,0,0,-1,0,364)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text514"><tspan
x="0"
y="0"
id="tspan512">3</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 43 KiB

BIN
img/ch09/ch10-averaged-gradient.pdf
View File

Binary file not shown.

435
img/ch09/ch10-averaged-gradient.svg Normal file
View File

@@ -0,0 +1,435 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="850.44928"
height="374.93619"
viewBox="0 0 850.44928 374.93618"
sodipodi:docname="ch10-averaged-gradient.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns:xlink="http://www.w3.org/1999/xlink"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 650 V 298 H 0 Z"
id="path16" /></clipPath><mask
maskUnits="userSpaceOnUse"
x="0"
y="0"
width="1"
height="1"
id="mask54"><image
width="1"
height="1"
preserveAspectRatio="none"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAD4AAAAqCAAAAADO7bcVAAAAAXNCSVQI5gpbmQAAAllJREFUSIntk91PE0EUxc98dNquGygtRRCKlUIBwWAlgpJoYuKDD/7HxhejIiCJoPIVIQKl9LtYaGl3Z2d8AIzdFWt87nmavZPfPWfuzAIddXSd6L9ucAaAUoBw8qsYjAeuwZmLvt9Tt1k80KRmqta4Ks6kzGNNDSgPzls/1cl84pUVTmaVEdUr8iJgZFzl+uCfriw32uGHQ4PhPNPL1mA4c2nmnyHfqekb6ya9Gbe/C4e1+qOkxbklHRCulQOIe+Za31Zj0jxcqnnSt+IMxLfZFF1VDYmpWPBoy+Gj/R+K9qNKIr1U8xy9dXRsJNL/OJDvG9ssK1v4BZp53Br+WFTW+MD5Yl23wWkocONmQc6m9zTDadennawkYveMReeNnDlsSodS2tqDtDajQ0+++e0IThXpDu29lwAlYjSZ2zgzJuIBp3ZW2an+3qD17I5WKnOsggvrVb5g7imAiViSrxZs1NfTzwUzKs0We/fkoRuWRmnoK+89yivQxHCdhSbGOLcdPzt/i1wTf8UByn2FVPo225YAygeY52/lSOp1WbzMZ6Xr6rw4i0xs55pz4aOiAlRJc02YZoRzBku1ezaE3QmtF8n+Q73hAIAGEJxVITHVpH5vUhdOe3lsMUMHxhWd+5yVF271ZZlIrVV80bY4j1sr2UBy9ORddPppPZc+cEA4M6VQhu3j3t/ehdtfRPVu7HQpa5UKD6IDFQJAiJhDd3tCjFLixt0FMWkU83VHAURErbIEfM/wRgKAeLG/Jr35XXE4u2p5YUZ7LkdGQn+45fYinkVHHXX0n/oJ/lnwjtc5nYUAAAAASUVORK5CYII="
id="image56" /></mask><mask
maskUnits="userSpaceOnUse"
x="0"
y="0"
width="1"
height="1"
id="mask68"><image
width="1"
height="1"
preserveAspectRatio="none"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACIAAAAqCAAAAADzf9ZzAAAAAXNCSVQI5gpbmQAAAHVJREFUOI1jYBgFtAOM6Hx2hp//UYWY0bhCNjwv/6GKMaGqkDYTY0G3CEUJI6/YmS8YbkHR8//jBeb/GEpQLfr/B1MFmhKsYMCUMDKihze6EiYuFm5WNCWoEcAkqcPGyv3qL6rBaKYwMzL8+0PYfaNgFNAWAAAFIhHYGrcC+QAAAABJRU5ErkJggg=="
id="image70" /></mask><mask
maskUnits="userSpaceOnUse"
x="0"
y="0"
width="1"
height="1"
id="mask112"><image
width="1"
height="1"
preserveAspectRatio="none"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAD0AAAAqCAAAAAAl2gwWAAAAAXNCSVQI5gpbmQAAAlZJREFUSIntk1tPU0EUhddcOr14AqWlCEJrpVBAMFiJoCSamPjgg//Y+GJQBCQRVG4RIlBK78VCS885c2Z8AAw9JZQf0PU0s5Nvr32ZATrqyC16xzhnACgFCCf/g/6472aaueCnPXWbxX0mNVK1xlVwOmUcaxqActO8+apO5hIfrFAyqwIRvSIvyguPqVwfvFOV5UYb+nBoMJRnetkaDGUurbzT5A81PKPdpDejbqVhrf4taXFuSQeEa+UA4omx1rfVmDAOl2ru0ptpBuLZNEVXVUNiMuo/2nL4SP/Xov2ikkgv1dxtN0+NDYf7X/ryfaObZWULr4CZx4PYt6KyxgbOF+v6dpoGfffuF+RMek8znHZ938lKInbPWGQukDNihnQopU0pSHMuOvTqt9cO41SR7uDeFwlQIkaSuY2zwHjc59TOKjvVa3xz345WKnOs/PPrVT5v7CmAiWiSrxZs1NfTbwULVMzr5u6ZQzcsjdLQL957lFegiVidBcdHObcdLztfQM7EbTRAuaeQSj9k2xJA+QBzfEEOpz6Wxft8VjbvrJVm4fHtnDkbOioqQJU014RpRjhnsFSb10LYo+B6kew/1xsOAGgA/hkVFJMm9bY4uWjay6OLGTowpujsj6y88Kovy0RqreKJtKN53FrJ+pIjJ58jU6/rufSBA8KZIYUK2B7e8s1dtP1TVB9HT5eyVqnwLDJQIQCEiDp0tyfIKCUu2n0XE4Fivu4ogIiIVZaA5w0+SQAQ7/bXZEvxrmI4u8p4YUV7LqdFgjest61Iy6Gjjjq6s/4BUyfwjnJesYgAAAAASUVORK5CYII="
id="image114" /></mask><mask
maskUnits="userSpaceOnUse"
x="0"
y="0"
width="1"
height="1"
id="mask126"><image
width="1"
height="1"
preserveAspectRatio="none"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACEAAAAqCAAAAAAYSG1wAAAAAXNCSVQI5gpbmQAAALlJREFUOI3tkT0LwjAURW/atNShCB2UWhBaiovgor/AyR8vDm4OOih+IFSHgA4JjYNL7tBOuvUuIS+H8x4vQJdfx+erF0Q+LJUEA6NZ3942ymXY0Zufd7qMT7VTk6TIjgdTpWmomwhUSsO8Y1fBRP20QJhcDYnJYQFZ6m0LAXhpvn5YNEckq1y2vEPEy0LCoxVwl2hxv9hgULgIKeV0qCaQ2R5NRJjVY0CIlzsq/YsIvqehlXXp8ud8ABu/La4jm0WAAAAAAElFTkSuQmCC"
id="image128" /></mask><mask
maskUnits="userSpaceOnUse"
x="0"
y="0"
width="1"
height="1"
id="mask212"><image
width="1"
height="1"
preserveAspectRatio="none"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAD0AAAAqCAAAAAAl2gwWAAAAAXNCSVQI5gpbmQAAAlZJREFUSIntk1tPU0EUhddcOr14AqWlCEJrpVBAMFiJoCSamPjgg//Y+GJQBCQRVG4RIlBK78VCS885c2Z8AAw9JZQf0PU0s5Nvr32ZATrqyC16xzhnACgFCCf/g/6472aaueCnPXWbxX0mNVK1xlVwOmUcaxqActO8+apO5hIfrFAyqwIRvSIvyguPqVwfvFOV5UYb+nBoMJRnetkaDGUurbzT5A81PKPdpDejbqVhrf4taXFuSQeEa+UA4omx1rfVmDAOl2ru0ptpBuLZNEVXVUNiMuo/2nL4SP/Xov2ikkgv1dxtN0+NDYf7X/ryfaObZWULr4CZx4PYt6KyxgbOF+v6dpoGfffuF+RMek8znHZ938lKInbPWGQukDNihnQopU0pSHMuOvTqt9cO41SR7uDeFwlQIkaSuY2zwHjc59TOKjvVa3xz345WKnOs/PPrVT5v7CmAiWiSrxZs1NfTbwULVMzr5u6ZQzcsjdLQL957lFegiVidBcdHObcdLztfQM7EbTRAuaeQSj9k2xJA+QBzfEEOpz6Wxft8VjbvrJVm4fHtnDkbOioqQJU014RpRjhnsFSb10LYo+B6kew/1xsOAGgA/hkVFJMm9bY4uWjay6OLGTowpujsj6y88Kovy0RqreKJtKN53FrJ+pIjJ58jU6/rufSBA8KZIYUK2B7e8s1dtP1TVB9HT5eyVqnwLDJQIQCEiDp0tyfIKCUu2n0XE4Fivu4ogIiIVZaA5w0+SQAQ7/bXZEvxrmI4u8p4YUV7LqdFgjest61Iy6Gjjjq6s/4BUyfwjnJesYgAAAAASUVORK5CYII="
id="image214" /></mask><mask
maskUnits="userSpaceOnUse"
x="0"
y="0"
width="1"
height="1"
id="mask226"><image
width="1"
height="1"
preserveAspectRatio="none"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACEAAAAqCAAAAAAYSG1wAAAAAXNCSVQI5gpbmQAAAMBJREFUOI3tkcsKwjAQRScm0YLFjbgoIhYUxAf4/7/gB7ioC+sDRASLpRYSp43bmUILgsveXe6c3JlMAFr9W6JylErgp4EQg02gb7ucepIReptGLnw/HfEUi9D3K+Zhxm7xDHyhnpsDUq/DCFd2V2ur2XA8A+QiyKajc1FPuDS+eONHRkblXQCMNTH4tE2VAIDC5a6WkBJADk1SEo/tQ87UEf1wz3bKCOgtJ0k/OtGnVP5FeV1rsYQmicZqq1a/6wsvajoAU7Q9BQAAAABJRU5ErkJggg=="
id="image228" /></mask></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:snap-text-baseline="false"
inkscape:zoom="0.76211537"
inkscape:cx="667.22182"
inkscape:cy="115.46808"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g22" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-averaged-gradient"
transform="matrix(1.3333333,0,0,-1.3333333,0,396.99999)"><g
id="g10" /><g
id="g22"><path
d="M 93,274.3332 C 93,277.4629 95.53709,280 98.66675,280 H 167.3333 C 170.4629,280 173,277.4629 173,274.3332 V 251.6668 C 173,248.5371 170.4629,246 167.3333,246 H 98.66675 C 95.53709,246 93,248.5371 93,251.6668 Z"
style="fill:#def2eb;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="translate(114.6859,-40)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text30"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan28">模型</tspan></text></g><path
d="m 222,274.3332 c 0,3.1297 2.5371,5.6668 5.6668,5.6668 h 80.6664 C 311.4629,280 314,277.4629 314,274.3332 V 251.6668 C 314,248.5371 311.4629,246 308.3332,246 H 227.6668 C 224.5371,246 222,248.5371 222,251.6668 Z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path32" /><g
id="g34"
transform="translate(232.3546,-40)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text38"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan36">本地梯度</tspan></text></g><path
d="m 380,274.3333 c 0,3.1296 2.5371,5.6667 5.6667,5.6667 H 558.3333 C 561.4629,280 564,277.4629 564,274.3333 V 251.6667 C 564,248.5371 561.4629,246 558.3333,246 H 385.6667 C 382.5371,246 380,248.5371 380,251.6667 Z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path40" /><g
id="g42"
transform="translate(435.5474,-40)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text46"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan44">平均梯度</tspan></text></g><path
d="m 173.5,263 40.8545,-10e-5 v -1 L 173.5,262 Z m 39.8545,2.4999 10,-3 -10,-3 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path48" /><path
d="m 314.5,263 56.2069,-10e-5 v -1 L 314.5,262 Z m 55.2069,2.4999 10,-3 -10,-3 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path50" /><g
id="g52"
transform="matrix(62,0,0,42,0,240)"><image
width="1"
height="1"
preserveAspectRatio="none"
transform="matrix(1,0,0,-1,0,1)"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAD4AAAAqCAYAAADrhujJAAAABHNCSVQICAgIfAhkiAAAAEtJREFUaIHtzzEBACAMwLCBf88gY0caBe2ZmTegux2wpXFN45rGNY1rGtc0rmlc07imcU3jmsY1jWsa1zSuaVzTuKZxTeOaxjWNaz6MiQFTg6TksQAAAABJRU5ErkJggg=="
mask="url(#mask54)"
id="image58" /></g><g
id="g60"
transform="translate(12.42319,-39)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan62">设备</tspan></text></g><g
id="g66"
transform="matrix(34,0,0,42,36,240)"><image
width="1"
height="1"
preserveAspectRatio="none"
transform="matrix(1,0,0,-1,0,1)"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACIAAAAqCAYAAADWFImvAAAABHNCSVQICAgIfAhkiAAAAEFJREFUWIXtzjEBwCAQALEH/57bieUMwJAoyJqZbx6wbwcOkRIpkRIpkRIpkRIpkRIpkRIpkRIpkRIpkRIpkRKpHyeOAVPaBYvcAAAAAElFTkSuQmCC"
mask="url(#mask68)"
id="image72" /></g><g
id="g74"
transform="translate(48.42319,-39)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text78"><tspan
x="0"
y="0"
id="tspan76">1</tspan></text></g><path
d="m 564.662,262.6276 h 16.285 l -0.25,-0.25 V 297.5 l 0.25,-0.25 H 133.5 l 0.25,0.25 v -9 h -0.5 v 9.25 H 581.197 V 262.1276 H 564.662 Z M 136.5,289.5 l -3,-10 -3,10 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path80" /><path
d="m 96,206.1666 c 0,3.2217 2.61171,5.8334 5.8334,5.8334 h 68.3332 C 173.3883,212 176,209.3883 176,206.1666 V 182.8334 C 176,179.6117 173.3883,177 170.1666,177 H 101.8334 C 98.61171,177 96,179.6117 96,182.8334 Z"
style="fill:#def2eb;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path82" /><g
id="g84"
transform="translate(117.7066,-109)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text88"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan86">模型</tspan></text></g><path
d="m 225,206.1666 c 0,3.2217 2.6117,5.8334 5.8334,5.8334 h 80.3332 C 314.3883,212 317,209.3883 317,206.1666 V 182.8334 C 317,179.6117 314.3883,177 311.1666,177 H 230.8334 C 227.6117,177 225,179.6117 225,182.8334 Z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path90" /><g
id="g92"
transform="translate(235.3753,-109)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text96"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan94">本地梯度</tspan></text></g><path
d="m 383,206.1665 c 0,3.2217 2.6118,5.8335 5.8335,5.8335 h 172.333 c 3.2218,0 5.8335,-2.6118 5.8335,-5.8335 v -23.333 C 567,179.6118 564.3883,177 561.1665,177 H 388.8335 C 385.6118,177 383,179.6118 383,182.8335 Z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path98" /><g
id="g100"
transform="translate(438.568,-109)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text104"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan102">平均梯度</tspan></text></g><path
d="m 176.5,195 40.8545,-1e-4 v -1 L 176.5,194 Z m 39.8545,2.4999 10,-3 -10,-3 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path106" /><path
d="m 317.5,195 56.2069,-1e-4 v -1 L 317.5,194 Z m 55.2069,2.4999 10,-3 -10,-3 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path108" /><g
id="g110"
transform="matrix(61,0,0,42,1,172)"><image
width="1"
height="1"
preserveAspectRatio="none"
transform="matrix(1,0,0,-1,0,1)"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAD0AAAAqCAYAAAAAsVPKAAAABHNCSVQICAgIfAhkiAAAAEtJREFUaIHtzzEBACAMwLCBf88gY0caBe2ZmTeYux2woWlF04qmFU0rmlY0rWha0bSiaUXTiqYVTSuaVjStaFrRtKJpRdOKphVNKz7I6gFTPvQz4AAAAABJRU5ErkJggg=="
mask="url(#mask112)"
id="image116" /></g><g
id="g118"
transform="translate(12.96098,-108)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text122"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan120">设备</tspan></text></g><g
id="g124"
transform="matrix(33,0,0,42,37,172)"><image
width="1"
height="1"
preserveAspectRatio="none"
transform="matrix(1,0,0,-1,0,1)"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACEAAAAqCAYAAAA9IzKsAAAABHNCSVQICAgIfAhkiAAAAD5JREFUWIXtzkERgDAABLED/57LawcJ/SQK8mw7u+y9HdgkfhKRiEQkIhGJSEQiEpGIRCQiEYlIRCISkYhEPmPvAVNUz9k9AAAAAElFTkSuQmCC"
mask="url(#mask126)"
id="image130" /></g><g
id="g132"
transform="translate(48.96098,-108)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text136"><tspan
x="0"
y="0"
id="tspan134">2</tspan></text></g><path
d="m 567.662,194.6276 h 16.285 l -0.25,-0.25 V 229.5 l 0.25,-0.25 H 136.5 l 0.25,0.25 v -9 h -0.5 v 9.25 H 584.197 V 194.1276 H 567.662 Z M 139.5,221.5 l -3,-10 -3,10 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path138" /><g
id="g140"
transform="translate(359.2237,-235)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text144"><tspan
x="0 18 36 54 72 90 108 126"
y="0"
sodipodi:role="line"
id="tspan142">计算平均梯度步骤</tspan></text></g><g
id="g146"
transform="translate(503.2237,-235)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text150"><tspan
x="0"
y="0"
id="tspan148">：</tspan></text></g><g
id="g152"
transform="translate(359.2237,-257)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text156"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan154">1.</tspan></text></g><g
id="g158"
transform="translate(386.2237,-257)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text162"><tspan
x="0 18 36 54 72 90"
y="0"
sodipodi:role="line"
id="tspan160">收集本地梯度</tspan></text></g><g
id="g164"
transform="translate(494.2237,-257)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text168"><tspan
x="0 18 36 54 72 90 108 126"
y="0"
sodipodi:role="line"
id="tspan166">，并计算平均梯度</tspan></text></g><g
id="g170"
transform="translate(359.2237,-279)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text174"><tspan
x="0 7.9991999"
y="0"
sodipodi:role="line"
id="tspan172">2.</tspan></text></g><g
id="g176"
transform="translate(386.2237,-279)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text180"><tspan
x="0 18 36 54 72 90 108 126 144 162 180"
sodipodi:role="line"
id="tspan178"
y="0">⼴播平局梯度到全部设备</tspan></text></g><path
d="m 96,131.1666 c 0,3.2217 2.61171,5.8334 5.8334,5.8334 h 68.3332 C 173.3883,137 176,134.3883 176,131.1666 V 107.8334 C 176,104.6117 173.3883,102 170.1666,102 H 101.8334 C 98.61171,102 96,104.6117 96,107.8334 Z"
style="fill:#def2eb;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path182" /><g
id="g184"
transform="translate(117.7066,-184)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text188"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan186">模型</tspan></text></g><path
d="m 225,131.1666 c 0,3.2217 2.6117,5.8334 5.8334,5.8334 h 80.3332 C 314.3883,137 317,134.3883 317,131.1666 V 107.8334 C 317,104.6117 314.3883,102 311.1666,102 H 230.8334 C 227.6117,102 225,104.6117 225,107.8334 Z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path190" /><g
id="g192"
transform="translate(235.3754,-184)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text196"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan194">本地梯度</tspan></text></g><path
d="m 383,131.1665 c 0,3.2217 2.6118,5.8335 5.8335,5.8335 h 172.333 c 3.2218,0 5.8335,-2.6118 5.8335,-5.8335 v -23.333 C 567,104.6118 564.3883,102 561.1665,102 H 388.8335 C 385.6118,102 383,104.6118 383,107.8335 Z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path198" /><g
id="g200"
transform="translate(438.5681,-184)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text204"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan202">平均梯度</tspan></text></g><path
d="m 176.5,120 40.8545,-1e-4 v -1 L 176.5,119 Z m 39.8545,2.4999 10,-3 -10,-3 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path206" /><path
d="m 317.5,120 56.2069,-1e-4 v -1 L 317.5,119 Z m 55.2069,2.4999 10,-3 -10,-3 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path208" /><g
id="g210"
transform="matrix(61,0,0,42,1,97)"><image
width="1"
height="1"
preserveAspectRatio="none"
transform="matrix(1,0,0,-1,0,1)"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAD0AAAAqCAYAAAAAsVPKAAAABHNCSVQICAgIfAhkiAAAAEtJREFUaIHtzzEBACAMwLCBf88gY0caBe2ZmTeYux2woWlF04qmFU0rmlY0rWha0bSiaUXTiqYVTSuaVjStaFrRtKJpRdOKphVNKz7I6gFTPvQz4AAAAABJRU5ErkJggg=="
mask="url(#mask212)"
id="image216" /></g><g
id="g218"
transform="translate(12.96106,-183)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text222"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan220">设备</tspan></text></g><g
id="g224"
transform="matrix(33,0,0,42,37,97)"><image
width="1"
height="1"
preserveAspectRatio="none"
transform="matrix(1,0,0,-1,0,1)"
xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACEAAAAqCAYAAAA9IzKsAAAABHNCSVQICAgIfAhkiAAAAD5JREFUWIXtzkERgDAABLED/57LawcJ/SQK8mw7u+y9HdgkfhKRiEQkIhGJSEQiEpGIRCQiEYlIRCISkYhEPmPvAVNUz9k9AAAAAElFTkSuQmCC"
mask="url(#mask226)"
id="image230" /></g><g
id="g232"
transform="translate(48.96106,-183)"><text
transform="matrix(1,0,0,-1,0,298)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text236"><tspan
x="0"
y="0"
id="tspan234">3</tspan></text></g><path
d="m 567.662,119.6276 h 16.285 l -0.25,-0.25 V 154.5 l 0.25,-0.25 H 136.5 l 0.25,0.25 v -9 h -0.5 v 9.25 H 584.197 V 119.1276 H 567.662 Z M 139.5,146.5 l -3,-10 -3,10 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path238" /><g
id="g240"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,348,263)"><path
d="M 0,0 1,1821273"
style="fill:none;stroke:#2e75b6;stroke-width:25400;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path242" /></g><path
d="m 384.6971,82.14824 -29.7662,46.50216 0.8423,0.5391 29.7661,-46.50214 z M 353.3645,126.4603 350.5,136.5 l 7.9179,-6.805 z"
style="fill:#ff0000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path244" /><path
d="m 344,262.5 c 0,1.933 1.567,3.5 3.5,3.5 1.933,0 3.5,-1.567 3.5,-3.5 0,-1.933 -1.567,-3.5 -3.5,-3.5 -1.933,0 -3.5,1.567 -3.5,3.5 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path246" /><path
d="m 345,194.5 c 0,1.933 1.567,3.5 3.5,3.5 1.933,0 3.5,-1.567 3.5,-3.5 0,-1.933 -1.567,-3.5 -3.5,-3.5 -1.933,0 -3.5,1.567 -3.5,3.5 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path248" /><path
d="m 344,119.5 c 0,1.933 1.567,3.5 3.5,3.5 1.933,0 3.5,-1.567 3.5,-3.5 0,-1.933 -1.567,-3.5 -3.5,-3.5 -1.933,0 -3.5,1.567 -3.5,3.5 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path250" /></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 27 KiB

BIN
img/ch09/ch10-computation-increase.pdf
View File

Binary file not shown.

91
img/ch09/ch10-computation-increase.svg Normal file
View File

File diff suppressed because one or more lines are too long
Side by Side

After

Width:  |  Height:  |  Size: 353 KiB

BIN
img/ch09/ch10-data-parallel.pdf
View File

Binary file not shown.

539
img/ch09/ch10-data-parallel.svg Normal file
View File

@@ -0,0 +1,539 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="929.85919"
height="522.151"
viewBox="0 0 929.85919 522.151"
sodipodi:docname="ch10-data-parallel.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 709 V 414 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="0.9210322"
inkscape:cx="413.12345"
inkscape:cy="275.77755"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-data-parallel"
transform="matrix(1.3333333,0,0,-1.3333333,-15.477411,541.54816)"><g
id="g10" /><g
id="g22"><path
d="m 84.5,352.3325 c 0,13.8996 11.26785,25.1675 25.1675,25.1675 h 573.6651 c 13.8996,0 25.1674,-11.2679 25.1674,-25.1675 V 251.6675 C 708.5,237.7678 697.2322,226.5 683.3326,226.5 H 109.6675 C 95.76785,226.5 84.5,237.7678 84.5,251.6675 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,84.5,377.5)"><path
d="M 0,319626.8 C 0,143101.8 143101.7,0 319626.7,0 H 7605174 c 176524,0 319626,143101.8 319626,319626.8 V 1598073 c 0,176525 -143102,319627 -319626,319627 H 319626.7 C 143101.7,1917700 0,1774598 0,1598073 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path28" /></g><path
d="m 472.5,368.5 h 72 v -90 h -72 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path30" /><g
id="g32"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,472.5,368.5)"><path
d="M 0,0 H 914400 V 1143000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path34" /></g><path
d="m 608.5,369.5 h 72 v -90 h -72 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path36" /><g
id="g38"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,608.5,369.5)"><path
d="M 0,0 H 914400 V 1143000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path40" /></g><path
d="m 337.5,368.5 h 73 v -90 h -73 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path42" /><g
id="g44"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,337.5,368.5)"><path
d="M 0,0 H 927100 V 1143000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path46" /></g><path
d="m 106.5,365.5 h 113 v -86 h -113 z"
style="fill:#ffffff;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path48" /><g
id="g50"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,106.5,365.5)"><path
d="M 0,0 H 1435100 V 1092200 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path52" /></g><g
id="g54"
transform="translate(351.0344,-97)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text58"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan56">算⼦</tspan></text></g><g
id="g60"
transform="translate(387.0344,-97)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0"
y="0"
id="tspan62">1</tspan></text></g><g
id="g66"
transform="translate(485.2252,-97)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text70"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan68">算⼦</tspan></text></g><g
id="g72"
transform="translate(521.2252,-97)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text76"><tspan
x="0"
y="0"
id="tspan74">2</tspan></text></g><g
id="g78"
transform="translate(620.965,-97)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text82"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan80">算⼦</tspan></text></g><g
id="g84"
transform="translate(656.965,-97)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text88"><tspan
x="0"
y="0"
id="tspan86">3</tspan></text></g><g
id="g90"
transform="translate(12.20717,-118)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text94"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan92">设备</tspan></text></g><g
id="g96"
transform="translate(48.20716,-118)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text100"><tspan
x="0"
y="0"
id="tspan98">1</tspan></text></g><path
d="m 328.5,271.5 h 95 v -36 h -95 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path102" /><g
id="g104"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,328.5,271.5)"><path
d="M 0,0 H 1206500 V 457200 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path106" /></g><g
id="g108"
transform="translate(352.6288,-167)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text112"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan110">梯度</tspan></text></g><g
id="g114"
transform="translate(388.6288,-167)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text118"><tspan
x="0"
y="0"
id="tspan116">1</tspan></text></g><path
d="m 462.5,270.5 h 96 v -37 h -96 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path120" /><g
id="g122"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,462.5,270.5)"><path
d="M 0,0 H 1219200 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path124" /></g><g
id="g126"
transform="translate(487.2839,-167)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text130"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan128">梯度</tspan></text></g><g
id="g132"
transform="translate(523.2839,-167)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text136"><tspan
x="0"
y="0"
id="tspan134">2</tspan></text></g><path
d="m 595.5,269.5 h 95 v -37 h -95 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path138" /><g
id="g140"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,595.5,269.5)"><path
d="M 0,0 H 1206500 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path142" /></g><g
id="g144"
transform="translate(620.9015,-169)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text148"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan146">梯度</tspan></text></g><g
id="g150"
transform="translate(656.9015,-169)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text154"><tspan
x="0"
y="0"
id="tspan152">3</tspan></text></g><path
d="m 106.5,366.5 h 113 v -42 h -113 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path156" /><g
id="g158"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,106.5,366.5)"><path
d="M 0,0 H 1435100 V 533400 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path160" /></g><g
id="g162"
transform="translate(124.4777,-74)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text166"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan164">数据分区</tspan></text></g><g
id="g168"
transform="translate(196.4777,-74)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text172"><tspan
x="0"
y="0"
id="tspan170">1</tspan></text></g><path
d="m 221.5,344.75 105.4246,-10e-5 v -4.5 L 221.5,340.25 Z m 103.1746,4.4999 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path174" /><path
d="m 410.5,344.75 51.1478,-10e-5 v -4.5 L 410.5,340.25 Z m 48.8978,4.4999 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path176" /><path
d="m 544.5,344.75 51.1478,-10e-5 v -4.5 L 544.5,340.25 Z m 48.8978,4.4999 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path178" /><path
d="M 604.8978,300.2499 553.75,300.25 v 4.5 l 51.1478,-10e-5 z M 556,295.75 l -13.5,6.75 13.5,6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path180" /><path
d="M 469.8978,298.2499 418.75,298.25 v 4.5 l 51.1478,-10e-5 z M 421,293.75 l -13.5,6.75 13.5,6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path182" /><path
d="m 83.5,164.166 c 0,13.9916 11.3424,25.334 25.334,25.334 h 573.3321 c 13.9915,0 25.3339,-11.3424 25.3339,-25.334 V 62.83402 c 0,-13.99159 -11.3424,-25.33401 -25.3339,-25.33401 H 108.834 c -13.9916,0 -25.334,11.34242 -25.334,25.33401 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path184" /><g
id="g186"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,83.5,189.5)"><path
d="M 0,321742 C 0,144048.8 144048.5,0 321741.3,0 H 7603059 c 177693,0 321741,144048.8 321741,321742 v 1286916 c 0,177693 -144048,321742 -321741,321742 H 321741.3 C 144048.5,1930400 0,1786351 0,1608658 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path188" /></g><path
d="m 471.5,137.5 h 72 v -90 h -72 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path190" /><g
id="g192"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,471.5,137.5)"><path
d="M 0,0 H 914400 V 1143000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path194" /></g><path
d="m 607.5,137.5 h 72 v -89 h -72 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path196" /><g
id="g198"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,607.5,137.5)"><path
d="M 0,0 H 914400 V 1130300 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path200" /></g><path
d="m 336.5,137.5 h 73 v -90 h -73 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path202" /><g
id="g204"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,336.5,137.5)"><path
d="M 0,0 H 927100 V 1143000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path206" /></g><path
d="m 105.5,134.5 h 113 v -86 h -113 z"
style="fill:#ffffff;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path208" /><g
id="g210"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,105.5,134.5)"><path
d="M 0,0 H 1435100 V 1092200 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path212" /></g><g
id="g214"
transform="translate(348.7747,-328)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text218"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan216">算⼦</tspan></text></g><g
id="g220"
transform="translate(384.7747,-328)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text224"><tspan
x="0"
y="0"
id="tspan222">1</tspan></text></g><g
id="g226"
transform="translate(485.3655,-328)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text230"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan228">算⼦</tspan></text></g><g
id="g232"
transform="translate(521.3655,-328)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text236"><tspan
x="0"
y="0"
id="tspan234">2</tspan></text></g><g
id="g238"
transform="translate(619.9053,-328)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text242"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan240">算⼦</tspan></text></g><g
id="g244"
transform="translate(655.9053,-328)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text248"><tspan
x="0"
y="0"
id="tspan246">3</tspan></text></g><path
d="m 328.5,183.5 h 95 v -37 h -95 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path250" /><g
id="g252"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,328.5,183.5)"><path
d="M 0,0 H 1206500 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path254" /></g><g
id="g256"
transform="translate(352.6288,-254)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text260"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan258">梯度</tspan></text></g><g
id="g262"
transform="translate(388.6288,-254)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text266"><tspan
x="0"
y="0"
id="tspan264">1</tspan></text></g><path
d="m 462.5,182.5 h 96 v -37 h -96 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path268" /><g
id="g270"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,462.5,182.5)"><path
d="M 0,0 H 1219200 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path272" /></g><g
id="g274"
transform="translate(488.4839,-256)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text278"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan276">梯度</tspan></text></g><g
id="g280"
transform="translate(524.4839,-256)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text284"><tspan
x="0"
y="0"
id="tspan282">2</tspan></text></g><path
d="m 595.5,180.5 h 95 v -37 h -95 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path286" /><g
id="g288"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,595.5,180.5)"><path
d="M 0,0 H 1206500 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path290" /></g><g
id="g292"
transform="translate(620.9015,-257)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text296"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan294">梯度</tspan></text></g><g
id="g298"
transform="translate(656.9015,-257)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text302"><tspan
x="0"
y="0"
id="tspan300">3</tspan></text></g><path
d="m 105.5,90.5 h 113 v -42 h -113 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path304" /><g
id="g306"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,105.5,90.5)"><path
d="M 0,0 H 1435100 V 533400 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path308" /></g><g
id="g310"
transform="translate(121.0906,-349)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text314"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan312">数据分区</tspan></text></g><g
id="g316"
transform="translate(193.0906,-349)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text320"><tspan
x="0"
y="0"
id="tspan318">2</tspan></text></g><path
d="m 220.5,66.75 105.4246,-7e-5 v -4.5 L 220.5,62.25 Z m 103.1746,4.49993 13.5,-6.75001 -13.5,-6.74999 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path322" /><path
d="m 409.5,67.75 51.1478,-6e-5 v -4.5 L 409.5,63.25 Z m 48.8978,4.49994 13.5,-6.75002 -13.5,-6.74998 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path324" /><path
d="m 543.5,66.75 51.1478,-6e-5 v -4.5 L 543.5,62.25 Z m 48.8978,4.49994 13.5,-6.75002 -13.5,-6.74998 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path326" /><path
d="m 605.8978,109.2499 -51.1478,1e-4 v 4.5 l 51.1478,-1e-4 z M 557,104.75 l -13.5,6.75 13.5,6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path328" /><path
d="m 470.8978,108.2499 -51.1478,1e-4 v 4.5 l 51.1478,-1e-4 z M 422,103.75 l -13.5,6.75 13.5,6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path330" /><g
id="g332"
transform="translate(11.22134,-300)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text336"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan334">设备</tspan></text></g><g
id="g338"
transform="translate(47.22134,-300)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text342"><tspan
x="0"
y="0"
id="tspan340">2</tspan></text></g><path
d="M 377,191.4653 377.0001,228 h -3 L 374,191.4653 Z m -6,1.5 4.5,-9 4.5,9 z m 9.0001,33.5347 -4.5,9 -4.5,-9 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path344" /><path
d="M 512,189.4653 512.0001,226 h -3 L 509,189.4653 Z m -6,1.5 4.5,-9 4.5,9 z m 9.0001,33.5347 -4.5,9 -4.5,-9 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path346" /><path
d="M 644,188.4653 644.0001,225 h -3 L 641,188.4653 Z m -6,1.5 4.5,-9 4.5,9 z m 9.0001,33.5347 -4.5,9 -4.5,-9 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path348" /><g
id="g350"
transform="translate(233.9832,-202)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text354"><tspan
x="0 12.0006 16.999201 21.997801 28.9944 36.999001 45.993599 54.988201 61.984798"
y="0"
sodipodi:role="line"
id="tspan352">Allreduce</tspan></text></g><g
id="g356"
transform="translate(205.9832,-224)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text360"><tspan
x="0 18 36 54 72 90 108"
y="0"
sodipodi:role="line"
id="tspan358">（计算平均值）</tspan></text></g><g
id="g362"
transform="translate(466.7052,-23)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text366"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan364">程序副本</tspan></text></g><g
id="g368"
transform="translate(464.2724,-397)"><text
transform="matrix(1,0,0,-1,0,414)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text372"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan370">程序副本</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 31 KiB

BIN
img/ch09/ch10-datacentre.pdf
View File

Binary file not shown.

185
img/ch09/ch10-datacentre.svg Normal file
View File

File diff suppressed because one or more lines are too long
Side by Side

After

Width:  |  Height:  |  Size: 209 KiB

BIN
img/ch09/ch10-hybrid-parallel.pdf
View File

Binary file not shown.

560
img/ch09/ch10-hybrid-parallel.svg Normal file
View File

@@ -0,0 +1,560 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="1032.3997"
height="474.17447"
viewBox="0 0 1032.3997 474.17447"
sodipodi:docname="ch10-hybrid-parallel.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 799 V 379 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="0.86352878"
inkscape:cx="424.42129"
inkscape:cy="372.88856"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-hybrid-parallel"
transform="matrix(1.3333333,0,0,-1.3333333,-16.464185,493.54816)"><g
id="g10" /><g
id="g22"><path
d="m 448.5,162.1663 c 0,13.4391 10.8946,24.3337 24.3337,24.3337 h 231.3326 c 13.4391,0 24.3337,-10.8946 24.3337,-24.3337 V 64.83374 C 728.5,51.39459 717.6054,40.5 704.1663,40.5 H 472.8337 C 459.3946,40.5 448.5,51.39459 448.5,64.83374 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,448.5,186.5)"><path
d="M 0,309038.5 C 0,138361.3 138361.2,0 309038.3,0 H 3246962 c 170677,0 309038,138361.3 309038,309038.5 V 1545161 c 0,170678 -138361,309039 -309038,309039 H 309038.3 C 138361.2,1854200 0,1715839 0,1545161 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path28" /></g><path
d="m 451.5,322.4996 c 0,11.5982 9.4022,21.0004 21.0003,21.0004 h 237.9994 c 11.5981,0 21.0003,-9.4022 21.0003,-21.0004 V 238.5004 C 731.5,226.9022 722.0978,217.5 710.4997,217.5 H 472.5003 c -11.5981,0 -21.0003,9.4022 -21.0003,21.0004 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path30" /><g
id="g32"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,451.5,343.5)"><path
d="M 0,266704.5 C 0,119407.7 119407.4,0 266703.9,0 H 3289296 c 147297,0 266704,119407.7 266704,266704.5 V 1333495 c 0,147297 -119407,266705 -266704,266705 H 266703.9 C 119407.4,1600200 0,1480792 0,1333495 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path34" /></g><path
d="m 83.5,322.4994 c 0,11.5983 9.40227,21.0006 21.0006,21.0006 h 274.9988 c 11.5983,0 21.0006,-9.4023 21.0006,-21.0006 V 238.5006 C 400.5,226.9023 391.0977,217.5 379.4994,217.5 H 104.5006 C 92.90227,217.5 83.5,226.9023 83.5,238.5006 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path36" /><g
id="g38"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,83.5,343.5)"><path
d="M 0,266707.4 C 0,119408.9 119408.8,0 266707.1,0 H 3759193 c 147298,0 266707,119408.9 266707,266707.4 V 1333493 c 0,147298 -119409,266707 -266707,266707 H 266707.1 C 119408.8,1600200 0,1480791 0,1333493 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path40" /></g><g
id="g42"
transform="translate(11.96142,-90)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text46"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan44">设备</tspan></text></g><g
id="g48"
transform="translate(47.96142,-90)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text52"><tspan
x="0"
y="0"
id="tspan50">1</tspan></text></g><path
d="m 83.5,163.8329 c 0,13.6233 11.04383,24.6671 24.6671,24.6671 h 265.6658 c 13.6233,0 24.6671,-11.0438 24.6671,-24.6671 V 65.16713 C 398.5,51.54385 387.4562,40.5 373.8329,40.5 H 108.1671 C 94.54383,40.5 83.5,51.54385 83.5,65.16713 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path54" /><g
id="g56"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,83.5,188.5)"><path
d="M 0,313272.5 C 0,140256.9 140256.6,0 313271.9,0 H 3687228 c 173016,0 313272,140256.9 313272,313272.5 V 1566327 c 0,173016 -140256,313273 -313272,313273 H 313271.9 C 140256.6,1879600 0,1739343 0,1566327 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path58" /></g><g
id="g60"
transform="translate(12.3048,-283)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan62">设备</tspan></text></g><g
id="g66"
transform="translate(48.3048,-283)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text70"><tspan
x="0"
y="0"
id="tspan68">3</tspan></text></g><path
d="m 316.1082,180.3532 0.5873,40.6259 -2.9997,0.0434 -0.5872,-40.6259 z m -5.9777,1.5866 4.3695,-9.0641 4.6296,8.934 z m 9.543,37.4961 -4.3695,9.0641 -4.6296,-8.934 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path72" /><path
d="m 589.0037,181.062 0.0188,37.9373 -3,0.001 -0.0188,-37.9372 3,-0.001 z m -5.9992,1.503 4.4955,-9.0022 4.5045,8.9977 -9,0.005 z m 9.0173,34.9328 -4.4956,9.0022 -4.5044,-8.9978 9,-0.004 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path74" /><g
id="g76"
transform="translate(320.3829,-183)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text80"><tspan
x="0 12.0006 16.0002 19.9998 25.999201 36 46.000801 56.001598 65.001602"
y="0"
sodipodi:role="line"
id="tspan78">Allreduce</tspan></text></g><path
d="m 225.5,320.75 26.5683,-10e-5 v -4.5 L 225.5,316.25 Z m 24.3183,4.4999 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path82" /><path
d="m 367.5,316.75 120.4126,-10e-5 v -4.5 L 367.5,312.25 Z m 118.1626,4.4999 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path84" /><path
d="m 221.5,72.75 25.147,-5e-5 v -4.5 L 221.5,68.25 Z m 22.897,4.49995 13.5,-6.75003 -13.5,-6.74997 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path86" /><path
d="m 363.5,73.75 118.9914,-7e-5 v -4.5 L 363.5,69.25 Z m 116.7413,4.49993 13.5,-6.75001 -13.5,-6.74999 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path88" /><path
d="m 263.5,265.5 h 104 v -37 h -104 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path90" /><g
id="g92"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,263.5,265.5)"><path
d="M 0,0 H 1320800 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path94" /></g><g
id="g96"
transform="translate(289.9471,-138)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text100"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan98">梯度</tspan></text></g><g
id="g102"
transform="translate(330.9471,-138)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text106"><tspan
x="0"
y="0"
id="tspan104">1</tspan></text></g><path
d="m 528.5,263.5 h 117 v -37 h -117 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path108" /><g
id="g110"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,528.5,263.5)"><path
d="M 0,0 H 1485900 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path112" /></g><g
id="g114"
transform="translate(565.3602,-140)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text118"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan116">梯度</tspan></text></g><g
id="g120"
transform="translate(601.3602,-140)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text124"><tspan
x="0"
y="0"
id="tspan122">2</tspan></text></g><path
d="m 264.5,173.5 h 100 v -37 h -100 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path126" /><g
id="g128"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,264.5,173.5)"><path
d="M 0,0 H 1270000 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path130" /></g><g
id="g132"
transform="translate(290.6458,-232)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text136"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan134">梯度</tspan></text></g><g
id="g138"
transform="translate(326.6458,-232)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text142"><tspan
x="0"
y="0"
id="tspan140">1</tspan></text></g><path
d="m 528.5,173.5 h 117 v -37 h -117 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path144" /><g
id="g146"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,528.5,173.5)"><path
d="M 0,0 H 1485900 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path148" /></g><g
id="g150"
transform="translate(565.3339,-231)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text154"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan152">梯度</tspan></text></g><g
id="g156"
transform="translate(601.3339,-231)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text160"><tspan
x="0"
y="0"
id="tspan158">2</tspan></text></g><path
d="M 499.1625,294.75 378.75,294.7499 v -4.5 l 120.4125,10e-5 z M 381,299.2499 l -13.5,-6.75 13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path162" /><path
d="m 493.8602,97.75 -123.1103,-7e-5 v -4.5 l 123.1103,7e-5 z M 373,102.2499 359.5,95.49992 373,88.74993 Z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path164" /><g
id="g166"
transform="translate(741.5074,-90)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text170"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan168">设备</tspan></text></g><g
id="g172"
transform="translate(777.5074,-90)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text176"><tspan
x="0"
y="0"
id="tspan174">2</tspan></text></g><g
id="g178"
transform="translate(741.5073,-283)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text182"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan180">设备</tspan></text></g><g
id="g184"
transform="translate(777.5073,-283)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text188"><tspan
x="0"
y="0"
id="tspan186">4</tspan></text></g><path
d="m 109.5,335.5 h 116 v -63 h -116 z"
style="fill:#ffffff;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path190" /><g
id="g192"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,109.5,335.5)"><path
d="M 0,0 H 1473200 V 800100 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path194" /></g><path
d="m 109.5,122.5 h 111 v -66 h -111 z"
style="fill:#ffffff;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path196" /><g
id="g198"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,109.5,122.5)"><path
d="M 0,0 H 1409700 V 838200 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path200" /></g><path
d="m 109.5,86.5 h 111 v -31 h -111 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path202" /><g
id="g204"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,109.5,86.5)"><path
d="M 0,0 H 1409700 V 393700 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path206" /></g><g
id="g208"
transform="translate(125.1799,-313)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text212"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan210">数据分区</tspan></text></g><g
id="g214"
transform="translate(197.1799,-313)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text218"><tspan
x="0"
y="0"
id="tspan216">2</tspan></text></g><path
d="m 109.5,335.5 h 116 v -33 h -116 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path220" /><g
id="g222"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,109.5,335.5)"><path
d="M 0,0 H 1473200 V 419100 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path224" /></g><g
id="g226"
transform="translate(128.6735,-69)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text230"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan228">数据分区</tspan></text></g><g
id="g232"
transform="translate(205.6735,-69)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text236"><tspan
x="0"
y="0"
id="tspan234">1</tspan></text></g><g
id="g238"
transform="translate(406.0215,-42)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text242"><tspan
x="0 9 19.000799 29.0016"
y="0"
sodipodi:role="line"
id="tspan240">send</tspan></text></g><path
d="m 263.5,335.5 h 104 v -63 h -104 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path244" /><g
id="g246"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,263.5,335.5)"><path
d="M 0,0 H 1320800 V 800100 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path248" /></g><g
id="g250"
transform="translate(289.1145,-81)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text254"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan252">算⼦</tspan></text></g><g
id="g256"
transform="translate(325.1145,-81)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text260"><tspan
x="0"
y="0"
id="tspan258">1</tspan></text></g><path
d="m 262.5,122.5 h 100 v -66 h -100 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path262" /><g
id="g264"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,262.5,122.5)"><path
d="M 0,0 H 1270000 V 838200 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path266" /></g><g
id="g268"
transform="translate(286.2876,-297)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text272"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan270">算⼦</tspan></text></g><g
id="g274"
transform="translate(322.2876,-297)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text278"><tspan
x="0"
y="0"
id="tspan276">1</tspan></text></g><path
d="m 499.5,334.5 h 178 v -62 h -178 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path280" /><g
id="g282"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,499.5,334.5)"><path
d="M 0,0 H 2260600 V 787400 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path284" /></g><g
id="g286"
transform="translate(560.4364,-81)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text290"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan288">算⼦</tspan></text></g><g
id="g292"
transform="translate(596.4364,-81)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text296"><tspan
x="0"
y="0"
id="tspan294">2</tspan></text></g><path
d="m 494.5,122.5 h 178 v -64 h -178 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path298" /><g
id="g300"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,494.5,122.5)"><path
d="M 0,0 H 2260600 V 812800 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path302" /></g><g
id="g304"
transform="translate(562.7028,-293)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text308"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan306">算⼦</tspan></text></g><g
id="g310"
transform="translate(598.7028,-293)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text314"><tspan
x="0"
y="0"
id="tspan312">2</tspan></text></g><g
id="g316"
transform="translate(257.4024,-24)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text320"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan318">程序分区</tspan></text></g><g
id="g322"
transform="translate(329.4024,-24)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text326"><tspan
x="0"
y="0"
id="tspan324">1</tspan></text></g><g
id="g328"
transform="translate(339.4024,-24)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text332"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan330">副本</tspan></text></g><g
id="g334"
transform="translate(524.6193,-28)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text338"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan336">程序分区</tspan></text></g><g
id="g340"
transform="translate(596.6193,-28)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text344"><tspan
x="0"
y="0"
id="tspan342">2</tspan></text></g><g
id="g346"
transform="translate(606.6193,-28)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text350"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan348">副本</tspan></text></g><g
id="g352"
transform="translate(525.8193,-362)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text356"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan354">程序分区</tspan></text></g><g
id="g358"
transform="translate(597.8193,-362)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text362"><tspan
x="0"
y="0"
id="tspan360">2</tspan></text></g><g
id="g364"
transform="translate(607.8193,-362)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text368"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan366">副本</tspan></text></g><g
id="g370"
transform="translate(258.384,-362)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text374"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan372">程序分区</tspan></text></g><g
id="g376"
transform="translate(330.384,-362)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text380"><tspan
x="0"
y="0"
id="tspan378">1</tspan></text></g><g
id="g382"
transform="translate(340.384,-362)"><text
transform="matrix(1,0,0,-1,0,379)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text386"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan384">副本</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 32 KiB

BIN
img/ch09/ch10-model-parallel-inter-op.pdf
View File

Binary file not shown.

249
img/ch09/ch10-model-parallel-inter-op.svg Normal file
View File

@@ -0,0 +1,249 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="997.37134"
height="451.50781"
viewBox="0 0 997.37134 451.50781"
sodipodi:docname="ch10-model-parallel-inter-op.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 783 V 361 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="0.64319923"
inkscape:cx="647.5443"
inkscape:cy="250.31124"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-model-parallel-inter-op"
transform="matrix(1.3333333,0,0,-1.3333333,-15.269851,470.8815)"><g
id="g10" /><g
id="g22"><path
d="m 77.5,304.3327 c 0,11.6904 9.4769,21.1673 21.16725,21.1673 H 628.3328 c 11.6903,0 21.1672,-9.4769 21.1672,-21.1673 V 219.6673 C 649.5,207.9769 640.0231,198.5 628.3328,198.5 H 98.66725 C 86.9769,198.5 77.5,207.9769 77.5,219.6673 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,77.5,325.5)"><path
d="M 0,268824.6 C 0,120356.9 120356.7,0 268824.1,0 H 6995576 c 148467,0 268824,120356.9 268824,268824.6 V 1344075 c 0,148468 -120357,268825 -268824,268825 H 268824.1 C 120356.7,1612900 0,1492543 0,1344075 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path28" /></g><path
d="m 100.5,308.5 h 72 v -93 h -72 z"
style="fill:#ffffff;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path30" /><g
id="g32"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,100.5,308.5)"><path
d="M 0,0 H 914400 V 1181100 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path34" /></g><g
id="g36"
transform="translate(11.06567,-104)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text40"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan38">设备</tspan></text></g><g
id="g42"
transform="translate(47.06567,-104)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text46"><tspan
x="0"
y="0"
id="tspan44">1</tspan></text></g><path
d="m 77.5,138.8331 c 0,11.414 9.25285,20.6669 20.66682,20.6669 H 628.8332 c 11.414,0 20.6668,-9.2529 20.6668,-20.6669 V 56.16687 C 649.5,44.75287 640.2472,35.5 628.8332,35.5 H 98.16682 C 86.75285,35.5 77.5,44.75287 77.5,56.16687 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path48" /><g
id="g50"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,77.5,159.5)"><path
d="M 0,262469.3 C 0,117511.5 117511.2,0 262468.6,0 H 7001932 c 144957,0 262468,117511.5 262468,262469.3 V 1312331 c 0,144958 -117511,262469 -262468,262469 H 262468.6 C 117511.2,1574800 0,1457289 0,1312331 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path52" /></g><g
id="g54"
transform="translate(11.06567,-267)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text58"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan56">设备</tspan></text></g><g
id="g60"
transform="translate(47.06567,-267)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0"
y="0"
id="tspan62">2</tspan></text></g><path
d="m 100.5,309.5 h 72 v -94 h -72 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path66" /><g
id="g68"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,100.5,309.5)"><path
d="M 0,0 H 914400 V 1193800 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path70" /></g><g
id="g72"
transform="translate(117.6847,-103)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text76"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan74">数据</tspan></text></g><path
d="m 259.5,308.5 h 357 v -93 h -357 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path78" /><g
id="g80"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,259.5,308.5)"><path
d="M 0,0 H 4533900 V 1181100 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path82" /></g><g
id="g84"
transform="translate(415.6091,-103)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text88"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan86">算⼦</tspan></text></g><g
id="g90"
transform="translate(451.6091,-103)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text94"><tspan
x="0"
y="0"
id="tspan92">1</tspan></text></g><path
d="m 259.5,145.5 h 359 v -91 h -359 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path96" /><g
id="g98"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,259.5,145.5)"><path
d="M 0,0 H 4559300 V 1155700 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path100" /></g><g
id="g102"
transform="translate(414.8385,-270)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text106"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan104">算⼦</tspan></text></g><g
id="g108"
transform="translate(450.8385,-270)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text112"><tspan
x="0"
y="0"
id="tspan110">2</tspan></text></g><path
d="m 172.5062,264.75 75.6872,-0.2098 -0.0125,-4.5 -75.6871,0.2098 z m 73.4497,4.2964 13.4813,-6.7874 -13.5187,-6.7126 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path114" /><path
d="M 618.1843,265.75 H 670.75 V 172.5607 H 207.5 l 2.2497,2.2891 1.3598,-78.31075 -2.2497,2.21095 h 37.7058 v -4.5 h -39.9171 l -1.4379,82.8107 H 668.5 l -2.25,-2.25 V 263.5 l 2.25,-2.25 h -50.3157 z m -373.8687,-162.5 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path116" /><g
id="g118"
transform="translate(699.2319,-84)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text122"><tspan
x="0 9 16.992001 27"
y="0"
sodipodi:role="line"
id="tspan120">Send</tspan></text></g><g
id="g124"
transform="translate(663.2319,-106)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text128"><tspan
x="0 18 36 54 72 90"
y="0"
sodipodi:role="line"
id="tspan126">（发送数据）</tspan></text></g><g
id="g130"
transform="translate(130.2561,-195)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text134"><tspan
x="0 10.9998 18.993601 25.9974 33.991199 38.997002 46.990799"
y="0"
sodipodi:role="line"
id="tspan132">Receive</tspan></text></g><g
id="g136"
transform="translate(103.2561,-217)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text140"><tspan
x="0 18 36 54 72 90"
y="0"
sodipodi:role="line"
id="tspan138">（接收数据）</tspan></text></g><g
id="g142"
transform="translate(358.2626,-344)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text146"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan144">程序分区</tspan></text></g><g
id="g148"
transform="translate(430.2626,-344)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text152"><tspan
x="0"
y="0"
id="tspan150">2</tspan></text></g><g
id="g154"
transform="translate(358.2625,-23)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text158"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan156">程序分区</tspan></text></g><g
id="g160"
transform="translate(430.2625,-23)"><text
transform="matrix(1,0,0,-1,0,361)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text164"><tspan
x="0"
y="0"
id="tspan162">1</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 14 KiB

BIN
img/ch09/ch10-model-parallel-intra-op.pdf
View File

Binary file not shown.

346
img/ch09/ch10-model-parallel-intra-op.svg Normal file
View File

@@ -0,0 +1,346 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="272"
height="108"
viewBox="0 0 272 108"
sodipodi:docname="ch10-model-parallel-intra-op.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 699 V 365 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="0.72103004"
inkscape:cx="-35.366071"
inkscape:cy="188.61905"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g22" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-model-parallel-intra-op"
transform="matrix(1.3333333,0,0,-1.3333333,-376.66666,387.33332)"><g
id="g10" /><g
id="g22"><path
d="M 76.5,304.4994 C 76.5,317.2023 86.79769,327.5 99.50053,327.5 H 675.4995 c 12.7028,0 23.0005,-10.2977 23.0005,-23.0006 V 212.5006 C 698.5,199.7977 688.2023,189.5 675.4995,189.5 H 99.50053 C 86.79769,189.5 76.5,199.7977 76.5,212.5006 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,76.5,327.5)"><path
d="M 0,292107.2 C 0,130780.8 130780.7,0 292106.8,0 H 7607294 c 161325,0 292106,130780.8 292106,292107.2 V 1460493 c 0,161326 -130781,292107 -292106,292107 H 292106.8 C 130780.7,1752600 0,1621819 0,1460493 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path28" /></g><path
d="m 599.5,291.5 h 72 v -82 h -72 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path30" /><g
id="g32"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,599.5,291.5)"><path
d="M 0,0 H 914400 V 1041400 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path34" /></g><path
d="m 282.5,290.5 h 204 v -81 h -204 z"
style="fill:#ffffff;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path36" /><g
id="g38"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,282.5,290.5)"><path
d="M 0,0 H 2590800 V 1028700 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path40" /></g><path
d="m 98.5,290.5 h 72 v -81 h -72 z"
style="fill:#ffffff;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path42" /><g
id="g44"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,98.5,290.5)"><path
d="M 0,0 H 914400 V 1028700 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path46" /></g><g
id="g48"
transform="translate(611.9691,-118)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text52"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan50">算⼦</tspan></text></g><g
id="g54"
transform="translate(647.9691,-118)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text58"><tspan
x="0"
y="0"
id="tspan56">2</tspan></text></g><g
id="g60"
transform="translate(11.91087,-120)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan62">设备</tspan></text></g><g
id="g66"
transform="translate(47.91087,-120)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text70"><tspan
x="0"
y="0"
id="tspan68">1</tspan></text></g><path
d="M 76.5,151.4994 C 76.5,164.2023 86.79769,174.5 99.50053,174.5 H 675.4995 c 12.7028,0 23.0005,-10.2977 23.0005,-23.0006 V 59.50057 c 0,-12.70286 -10.2977,-23.00056 -23.0005,-23.00056 H 99.50053 C 86.79769,36.50001 76.5,46.79771 76.5,59.50057 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path72" /><g
id="g74"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,76.5,174.5)"><path
d="M 0,292107.2 C 0,130780.8 130780.7,0 292106.8,0 H 7607294 c 161325,0 292106,130780.8 292106,292107.2 V 1460493 c 0,161326 -130781,292107 -292106,292107 H 292106.8 C 130780.7,1752600 0,1621819 0,1460493 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path76" /></g><g
id="g78"
transform="translate(14.94685,-272)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text82"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan80">设备</tspan></text></g><g
id="g84"
transform="translate(50.94685,-272)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text88"><tspan
x="0"
y="0"
id="tspan86">2</tspan></text></g><path
d="m 98.5,291.5 h 72 v -82 h -72 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path90" /><g
id="g92"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,98.5,291.5)"><path
d="M 0,0 H 914400 V 1041400 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path94" /></g><g
id="g96"
transform="translate(115.8845,-119)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text100"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan98">数据</tspan></text></g><path
d="m 282.5,290.5 h 102 v -81 h -102 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path102" /><g
id="g104"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,282.5,290.5)"><path
d="M 0,0 H 1295400 V 1028700 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path106" /></g><g
id="g108"
transform="translate(311.0483,-119)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text112"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan110">分区</tspan></text></g><g
id="g114"
transform="translate(347.0483,-119)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text118"><tspan
x="0"
y="0"
id="tspan116">1</tspan></text></g><path
d="m 281.5,134.5 h 204 v -78 h -204 z"
style="fill:#ffffff;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path120" /><g
id="g122"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,281.5,134.5)"><path
d="M 0,0 H 2590800 V 990600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path124" /></g><path
d="m 383.5,134.5 h 102 v -78 h -102 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path126" /><g
id="g128"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,383.5,134.5)"><path
d="M 0,0 H 1295400 V 990600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path130" /></g><g
id="g132"
transform="translate(413.9496,-276)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text136"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan134">分区</tspan></text></g><g
id="g138"
transform="translate(449.9496,-276)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text142"><tspan
x="0"
y="0"
id="tspan140">2</tspan></text></g><g
id="g144"
transform="translate(194.7052,-138)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text148"><tspan
x="0 10.9998 18.003599 27.0054 36.007198 45.008999 52.012798 61.014599 68.018402"
y="0"
sodipodi:role="line"
id="tspan146">Broadcast</tspan></text></g><g
id="g150"
transform="translate(195.7052,-160)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text154"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan152">（⼴播）</tspan></text></g><path
d="m 170.5101,252.75 100.1402,-0.449 -0.0202,-4.5 -100.1402,0.449 z m 97.9104,4.061 13.4696,-6.8104 -13.5301,-6.6895 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path156" /><path
d="m 172.3316,251.8069 104.1661,-145.989 -3.6632,-2.6137 -104.1661,145.9889 z m 106.5224,-141.5438 2.3465,-14.90995 -13.3359,7.06875 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path158" /><path
d="M 487.3168,94.33215 593.8032,240.0888 590.1696,242.7434 483.6832,96.98676 Z m 108.7926,141.28515 2.5135,14.8827 -13.4142,-6.9188 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path160" /><path
d="m 486.5148,247.5079 101.6879,0.6682 -0.0296,4.4999 -101.6879,-0.6682 z m 99.4675,-3.8465 13.4553,6.8386 -13.544,6.6611 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path162" /><g
id="g164"
transform="translate(505.24,-137)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text168"><tspan
x="0 14.0004 22.996799 29.005199 39.009602 47.015999"
y="0"
sodipodi:role="line"
id="tspan166">Gather</tspan></text></g><g
id="g170"
transform="translate(508.24,-159)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text174"><tspan
x="0"
y="0"
id="tspan172">(</tspan></text></g><g
id="g176"
transform="translate(513.24,-159)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text180"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan178">合并</tspan></text></g><g
id="g182"
transform="translate(549.24,-159)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text186"><tspan
x="0"
y="0"
id="tspan184">)</tspan></text></g><g
id="g188"
transform="translate(368.2626,-62)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text192"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan190">算⼦</tspan></text></g><g
id="g194"
transform="translate(404.2626,-62)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text198"><tspan
x="0"
y="0"
id="tspan196">1</tspan></text></g><g
id="g200"
transform="translate(368.4133,-216)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text204"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan202">算⼦</tspan></text></g><g
id="g206"
transform="translate(404.4133,-216)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text210"><tspan
x="0"
y="0"
id="tspan208">1</tspan></text></g><g
id="g212"
transform="translate(380.2,-23)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text216"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan214">程序分区</tspan></text></g><g
id="g218"
transform="translate(452.2,-23)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text222"><tspan
x="0"
y="0"
id="tspan220">1</tspan></text></g><g
id="g224"
transform="translate(381.4626,-348)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text228"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan226">程序分区</tspan></text></g><g
id="g230"
transform="translate(453.4626,-348)"><text
transform="matrix(1,0,0,-1,0,365)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text234"><tspan
x="0"
y="0"
id="tspan232">2</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 20 KiB

BIN
img/ch09/ch10-parameter-server-replication.pdf
View File

Binary file not shown.

224
img/ch09/ch10-parameter-server-replication.svg Normal file
View File

@@ -0,0 +1,224 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="779.24609"
height="442.80597"
viewBox="0 0 779.24609 442.80597"
sodipodi:docname="ch10-parameter-server-replication.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 609 V 342 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="0.78837719"
inkscape:cx="331.69402"
inkscape:cy="273.98053"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-parameter-server-replication"
transform="matrix(1.3333333,0,0,-1.3333333,-16.622627,442.80598)"><g
id="g10" /><g
id="g22"><path
d="M 16.5,278.3332 C 16.5,294.9939 30.00611,308.5 46.66674,308.5 H 532.3333 c 16.6606,0 30.1667,-13.5061 30.1667,-30.1668 V 157.6668 C 562.5,141.0061 548.9939,127.5 532.3333,127.5 H 46.66674 C 30.00611,127.5 16.5,141.0061 16.5,157.6668 Z"
style="fill:#ededed;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,16.5,308.5)"><path
d="M 0,383117.9 C 0,171527.7 171527.6,0 383117.6,0 H 6551083 c 211590,0 383117,171527.7 383117,383117.9 V 1915582 c 0,211590 -171527,383118 -383117,383118 H 383117.6 C 171527.6,2298700 0,2127172 0,1915582 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path28" /></g><path
d="M 124.5,56.33316 C 124.5,62.50043 129.4996,67.5 135.6668,67.5 H 252.3332 C 258.5004,67.5 263.5,62.50043 263.5,56.33316 V 11.66684 C 263.5,5.499564 258.5004,0.4999987 252.3332,0.4999987 H 135.6668 c -6.1672,0 -11.1668,4.9995653 -11.1668,11.1668413 z"
style="fill:#e2f0d9;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path30" /><g
id="g32"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,124.5,67.5)"><path
d="M 0,141818.9 C 0,63494.5 63494.36,0 141818.6,0 H 1623481 c 78325,0 141819,63494.5 141819,141818.9 v 567262.2 c 0,78324.4 -63494,141818.9 -141819,141818.9 H 141818.6 C 63494.36,850900 0,787405.5 0,709081.1 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path34" /></g><g
id="g36"
transform="translate(159.4874,-313)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text40"><tspan
x="0 16.0002 24.9984 30.990601 38.980801 47.979 53.971199 58.9734"
y="0"
sodipodi:role="line"
id="tspan38">Worker 1</tspan></text></g><path
d="m 224.5,168.8333 c 0,3.1296 2.5371,5.6667 5.6667,5.6667 h 127.6666 c 3.1296,0 5.6667,-2.5371 5.6667,-5.6667 v -22.6666 c 0,-3.1296 -2.5371,-5.6667 -5.6667,-5.6667 H 230.1667 c -3.1296,0 -5.6667,2.5371 -5.6667,5.6667 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path42" /><g
id="g44"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,224.5,174.5)"><path
d="M 0,71967.31 C 0,32220.86 32220.84,0 71967.25,0 H 1693333 c 39746,0 71967,32220.86 71967,71967.31 V 359832.7 c 0,39746.4 -32221,71967.3 -71967,71967.3 H 71967.25 C 32220.84,431800 0,399579.1 0,359832.7 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path46" /></g><g
id="g48"
transform="translate(242.4272,-190)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text52"><tspan
x="0 7.9991999 17.006399 26.013599 35.020802 39.023998 48.0312 57.038399 61.041599 70.048798 79.056 87.055199 96.062401"
y="0"
sodipodi:role="line"
id="tspan50">Load balancer</tspan></text></g><path
d="m 61.5,276.1665 c 0,5.1548 4.17874,9.3335 9.33349,9.3335 H 192.1665 c 5.1548,0 9.3335,-4.1787 9.3335,-9.3335 v -37.333 c 0,-5.1548 -4.1787,-9.3335 -9.3335,-9.3335 H 70.83349 c -5.15475,0 -9.33349,4.1787 -9.33349,9.3335 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path54" /><g
id="g56"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,61.5,285.5)"><path
d="M 0,118535.3 C 0,53070.05 53070.05,0 118535.3,0 H 1659465 c 65465,0 118535,53070.05 118535,118535.3 v 474129.4 c 0,65465.3 -53070,118535.3 -118535,118535.3 H 118535.3 C 53070.05,711200 0,658130 0,592664.7 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path58" /></g><g
id="g60"
transform="translate(104.388,-90)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0 10.0008 18.993601 27.986401 31.9932 36 44.0028"
y="0"
sodipodi:role="line"
id="tspan62">Replica</tspan></text></g><path
d="m 224.5,274.1664 c 0,5.1548 4.1788,9.3336 9.3336,9.3336 h 120.3329 c 5.1547,0 9.3335,-4.1788 9.3335,-9.3336 v -37.3328 c 0,-5.1548 -4.1788,-9.3336 -9.3335,-9.3336 H 233.8336 c -5.1548,0 -9.3336,4.1788 -9.3336,9.3336 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path66" /><g
id="g68"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,224.5,283.5)"><path
d="M 0,118536.2 C 0,53070.48 53070.43,0 118536.1,0 H 1646764 c 65466,0 118536,53070.48 118536,118536.2 v 474127.6 c 0,65465.7 -53070,118536.2 -118536,118536.2 H 118536.1 C 53070.43,711200 0,658129.5 0,592663.8 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path70" /></g><g
id="g72"
transform="translate(266.4898,-92)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text76"><tspan
x="0 10.0008 18.993601 27.986401 31.9932 36 44.0028"
y="0"
sodipodi:role="line"
id="tspan74">Replica</tspan></text></g><path
d="m 386.5,274.1664 c 0,5.1548 4.1788,9.3336 9.3336,9.3336 h 120.3329 c 5.1547,0 9.3335,-4.1788 9.3335,-9.3336 v -37.3328 c 0,-5.1548 -4.1788,-9.3336 -9.3335,-9.3336 H 395.8336 c -5.1548,0 -9.3336,4.1788 -9.3336,9.3336 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path78" /><g
id="g80"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,386.5,283.5)"><path
d="M 0,118536.2 C 0,53070.48 53070.43,0 118536.1,0 H 1646764 c 65466,0 118536,53070.48 118536,118536.2 v 474127.6 c 0,65465.7 -53070,118536.2 -118536,118536.2 H 118536.1 C 53070.43,711200 0,658129.5 0,592663.8 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path82" /></g><g
id="g84"
transform="translate(428.5915,-92)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text88"><tspan
x="0 10.0008 18.993601 27.986401 31.9932 36 44.0028"
y="0"
sodipodi:role="line"
id="tspan86">Replica</tspan></text></g><path
d="m 293.1229,141.6059 -4.8472,-3.5362 0.884,-1.2118 4.8472,3.5362 z m -8.4826,-6.1884 -4.8472,-3.5363 0.8841,-1.2118 4.8472,3.5363 z m -8.4825,-6.1884 -4.8472,-3.5363 0.8841,-1.2118 4.8471,3.5363 z m -8.4826,-6.1885 -4.8471,-3.5362 0.884,-1.2118 4.8472,3.5363 z m -8.4825,-6.1884 -4.8472,-3.5362 0.8841,-1.2118 4.8471,3.5362 z m -8.4825,-6.1884 -4.8472,-3.5362 0.884,-1.2118 4.8472,3.5362 z m -8.4826,-6.1884 -4.8472,-3.5363 0.8841,-1.21174 4.8472,3.53624 z m -8.4825,-6.18843 -4.8472,-3.53624 0.8841,-1.21179 4.8471,3.53624 z m -8.4826,-6.18842 -4.8471,-3.53624 0.884,-1.21179 4.8472,3.53624 z m -8.4825,-6.18842 -4.8472,-3.53624 0.8841,-1.21179 4.8471,3.53624 z m -8.4826,-6.18842 -4.8471,-3.53623 0.884,-1.21179 4.8472,3.53623 z m -8.4825,-6.18841 -2.2178,-1.61798 0.8841,-1.21179 2.2178,1.61797 z m -2.7359,0.78919 -3.079,-5.95981 6.6153,1.11265 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path90" /><path
d="m 293.415,141.6247 4.9979,-3.3198 -0.83,-1.2495 -4.9979,3.3199 z m 8.7463,-5.8096 4.9978,-3.3199 -0.8299,-1.2494 -4.9979,3.3198 z m 8.7463,-5.8097 4.9978,-3.3198 -0.8299,-1.2495 -4.9979,3.3198 z m 8.7462,-5.8097 4.9979,-3.3198 -0.8299,-1.2495 -4.9979,3.3198 z m 8.7463,-5.8097 4.9979,-3.3198 -0.8299,-1.2495 -4.9979,3.3198 z m 8.7463,-5.8097 4.9979,-3.3198 -0.8299,-1.2495 -4.9979,3.3199 z m 8.7463,-5.8097 4.9979,-3.3198 -0.83,-1.2494 -4.9978,3.3198 z m 8.7463,-5.8096 4.9979,-3.31986 -0.83,-1.24947 -4.9978,3.31981 z m 8.7463,-5.80973 4.9979,-3.31982 -0.83,-1.24946 -4.9979,3.31981 z m 8.7463,-5.80968 4.9979,-3.31982 -0.83,-1.24946 -4.9979,3.31981 z m 8.7463,-5.80968 4.9979,-3.31982 -0.83,-1.24946 -4.9979,3.31981 z m 8.7463,-5.80968 4.9978,-3.31982 -0.8299,-1.24947 -4.9979,3.31982 z m 8.7463,-5.80969 0.2326,-0.15454 -0.8299,-1.24947 -0.2327,0.15454 z m 0.6447,2.2729 3.338,-5.81876 -6.6578,0.82088 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path92" /><path
d="M 333.5,56.33316 C 333.5,62.50043 338.4996,67.5 344.6668,67.5 H 461.3332 C 467.5004,67.5 472.5,62.50043 472.5,56.33316 V 11.66684 C 472.5,5.499564 467.5004,0.4999987 461.3332,0.4999987 H 344.6668 c -6.1672,0 -11.1668,4.9995653 -11.1668,11.1668413 z"
style="fill:#e2f0d9;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path94" /><g
id="g96"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,333.5,67.5)"><path
d="M 0,141818.9 C 0,63494.5 63494.36,0 141818.6,0 H 1623481 c 78325,0 141819,63494.5 141819,141818.9 v 567262.2 c 0,78324.4 -63494,141818.9 -141819,141818.9 H 141818.6 C 63494.36,850900 0,787405.5 0,709081.1 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path98" /></g><g
id="g100"
transform="translate(368.4054,-313)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text104"><tspan
x="0 16.0002 24.9984 30.990601 38.980801 47.979 53.971199 58.9734"
y="0"
sodipodi:role="line"
id="tspan102">Worker 2</tspan></text></g><path
d="M 132.8991,230.041 192.7311,75.30161 189.933,74.21968 130.1009,228.959 Z m 62.0891,-152.25834 -0.9513,-10.01723 -7.443,6.77145 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path106" /><path
d="M 454.8242,227.9703 404.4274,75.3497 407.2761,74.40903 457.673,227.0297 Z M 402.049,77.71454 403.5,67.7574 l 7.0951,7.13512 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path108" /><g
id="g110"
transform="translate(11.1574,-258)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:bold;font-size:18px;font-family:Arial;-inkscape-font-specification:Arial-BoldMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text114"><tspan
x="0 12.0006 22.9932 27.9918"
y="0"
sodipodi:role="line"
id="tspan112">Pull</tspan></text></g><g
id="g116"
transform="translate(49.1574,-258)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text120"><tspan
x="0 10.0008 25.0056 35.006401 45.007198 55.007999 65.008797 69.015602 79.016403 89.017197 94.014 99.010803 109.0116 119.0124 123.0192"
y="0"
sodipodi:role="line"
id="tspan118">embedding table</tspan></text></g><g
id="g122"
transform="translate(426.6187,-256)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:bold;font-size:18px;font-family:Arial;-inkscape-font-specification:Arial-BoldMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text126"><tspan
x="0 12.0006 22.9932 27.9918"
y="0"
sodipodi:role="line"
id="tspan124">Pull</tspan></text></g><g
id="g128"
transform="translate(464.6187,-256)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text132"><tspan
x="0 10.0008 25.0056 35.006401 45.007198 55.007999 65.008797 69.015602 79.016403 89.017197 94.014 99.010803 109.0116 119.0124 123.0192"
y="0"
sodipodi:role="line"
id="tspan130">embedding table</tspan></text></g><g
id="g134"
transform="translate(193.866,-158)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text138"><tspan
x="0 12.9996 21.999599 32.000401 42.001202 57.000599 61.000198 70.000198 80.000999 84.000603 88.000198 97.000198 102.0006 111.0006 121.0014 131.0022 141.00301 150.00301 160.0038 165.0042 171.0036 181.00439 191.0052 195.00481 199.00439 208.00439 218.0052"
y="0"
sodipodi:role="line"
id="tspan136">Dynamically choose replica </tspan></text></g><g
id="g140"
transform="translate(162.2196,-23)"><text
transform="matrix(1,0,0,-1,0,342)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text144"><tspan
x="0 12.0006 22.0014 28.000799 38.001598 53.000999 63.001801 68.002197 78.002998 84.002403 89.0028 101.0034 111.0042 117.0036 126.0036 136.00439 142.0038 147.0042 160.0038 170.00459 180.0054 184.005 188.00459 197.00459 207.0054 212.0058 216.0054 226.0062 236.007 241.0074 255.0078 261.0072 271.008 281.00879"
y="0"
sodipodi:role="line"
id="tspan142">Parameter Server Replication Group</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 17 KiB

BIN
img/ch09/ch10-parameter-servers.pdf
View File

Binary file not shown.

202
img/ch09/ch10-parameter-servers.svg Normal file
View File

@@ -0,0 +1,202 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="560.59259"
height="321.81696"
viewBox="0 0 560.59259 321.81696"
sodipodi:docname="ch10-parameter-servers.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0.1090903 H 444 V 257.99999 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="1.0450581"
inkscape:cx="157.40751"
inkscape:cy="152.14465"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-parameter-servers"
transform="matrix(1.3333333,0,0,-1.3333333,-15.941313,343.12426)"><g
id="g10" /><g
id="g22"><path
d="m 57.36361,245.0179 c 0,6.1858 5.01452,11.2003 11.20025,11.2003 H 185.3634 c 6.1857,0 11.2002,-5.0145 11.2002,-11.2003 v -44.7994 c 0,-6.1858 -5.0145,-11.2003 -11.2002,-11.2003 H 68.56386 c -6.18573,0 -11.20025,5.0145 -11.20025,11.2003 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:evenodd;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,57.36361,256.2182)"><path
d="M 0,142243.2 C 0,63684.46 63684.39,0 142243.1,0 H 1625597 c 78559,0 142243,63684.46 142243,142243.2 v 568953.6 c 0,78558.8 -63684,142243.2 -142243,142243.2 H 142243.1 C 63684.39,853440 0,789755.6 0,711196.8 Z"
style="fill:none;stroke:#000000;stroke-width:28575;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path28" /></g><g
id="g30"
transform="matrix(0.2181818,0,0,0.2181818,77.67966,-40.69089)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text34"><tspan
x="0 82.501991 165.00398 247.50597 330.00797"
y="0"
sodipodi:role="line"
id="tspan32">参数服务器</tspan></text></g><g
id="g36"
transform="matrix(0.2181818,0,0,0.2181818,167.6797,-40.69089)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text40"><tspan
x="0"
y="0"
id="tspan38">1</tspan></text></g><path
d="m 253.5091,245.0179 c 0,6.1858 5.0145,11.2003 11.2002,11.2003 H 381.727 c 6.1857,0 11.2002,-5.0145 11.2002,-11.2003 v -44.7994 c 0,-6.1858 -5.0145,-11.2003 -11.2002,-11.2003 H 264.7093 c -6.1857,0 -11.2002,5.0145 -11.2002,11.2003 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:evenodd;stroke:none"
id="path42" /><g
id="g44"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,253.5091,256.2182)"><path
d="M 0,142243.6 C 0,63684.61 63684.51,0 142243.3,0 H 1628368 c 78559,0 142243,63684.61 142243,142243.6 v 568952.9 c 0,78558.9 -63684,142243.5 -142243,142243.5 H 142243.3 C 63684.51,853440 0,789755.4 0,711196.5 Z"
style="fill:none;stroke:#000000;stroke-width:28575;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path46" /></g><g
id="g48"
transform="matrix(0.2181818,0,0,0.2181818,273.9655,-40.69089)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text52"><tspan
x="0 82.501991 165.00398 247.50597 330.00797"
y="0"
sodipodi:role="line"
id="tspan50">参数服务器</tspan></text></g><g
id="g54"
transform="matrix(0.2181818,0,0,0.2181818,363.9655,-40.69089)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text58"><tspan
x="0"
y="0"
id="tspan56">2</tspan></text></g><path
d="m 57.36361,115.1634 c 0,6.2058 5.03081,11.2366 11.23663,11.2366 H 185.327 c 6.2058,0 11.2366,-5.0308 11.2366,-11.2366 V 70.21846 c 0,-6.20582 -5.0308,-11.23664 -11.2366,-11.23664 H 68.60024 c -6.20582,0 -11.23663,5.03082 -11.23663,11.23664 z"
style="fill:#e2f0d9;fill-opacity:1;fill-rule:evenodd;stroke:none"
id="path60" /><g
id="g62"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,57.36361,126.4)"><path
d="M 0,142705.4 C 0,63891.38 63891.27,0 142705.1,0 H 1625135 c 78814,0 142705,63891.38 142705,142705.4 v 570800.2 c 0,78814 -63891,142705.4 -142705,142705.4 H 142705.1 C 63891.27,856211 0,792319.6 0,713505.6 Z"
style="fill:none;stroke:#000000;stroke-width:28575;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path64" /></g><g
id="g66"
transform="matrix(0.2181818,0,0,0.2181818,77.67974,-170.7273)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text70"><tspan
x="0 82.501991 165.00398 247.50597 330.00797"
y="0"
sodipodi:role="line"
id="tspan68">训练服务器</tspan></text></g><g
id="g72"
transform="matrix(0.2181818,0,0,0.2181818,167.6797,-170.7273)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text76"><tspan
x="0"
y="0"
id="tspan74">1</tspan></text></g><path
d="m 253.5091,115.1634 c 0,6.2058 5.0307,11.2366 11.2365,11.2366 h 116.9451 c 6.2058,0 11.2365,-5.0308 11.2365,-11.2366 V 70.21839 c 0,-6.20579 -5.0307,-11.23657 -11.2365,-11.23657 H 264.7456 c -6.2058,0 -11.2365,5.03078 -11.2365,11.23657 z"
style="fill:#e2f0d9;fill-opacity:1;fill-rule:evenodd;stroke:none"
id="path78" /><g
id="g80"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,253.5091,126.4)"><path
d="M 0,142704.4 C 0,63890.94 63890.84,0 142704.2,0 H 1627907 c 78813,0 142704,63890.94 142704,142704.4 v 570802.2 c 0,78813.4 -63891,142704.4 -142704,142704.4 H 142704.2 C 63890.84,856211 0,792320 0,713506.6 Z"
style="fill:none;stroke:#000000;stroke-width:28575;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path82" /></g><g
id="g84"
transform="matrix(0.2181818,0,0,0.2181818,273.9655,-170.7273)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text88"><tspan
x="0 82.501991 165.00398 247.50597 330.00797"
y="0"
sodipodi:role="line"
id="tspan86">训练服务器</tspan></text></g><g
id="g90"
transform="matrix(0.2181818,0,0,0.2181818,363.9655,-170.7273)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text94"><tspan
x="0"
y="0"
id="tspan92">2</tspan></text></g><path
d="m 100.8159,189.4546 1e-4,-57.1161 h -2.24999 l -8e-5,57.1161 z m 2.2501,-55.991 -3.37499,-6.75 -3.37501,6.7499 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path96" /><path
d="m 141.1114,126.3258 v 57.5038 h 2.25 v -57.5038 z m -2.25,56.3788 3.375,6.75 3.375,-6.75 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path98" /><path
d="m 299.4611,190.5282 -191.0289,-59.7925 0.6721,-2.1473 191.0289,59.7925 z m -190.6274,-57.3093 -5.4337,-5.2372 7.45,-1.2046 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path100" /><path
d="m 142.5686,125.2512 198.839,61.4672 -0.6645,2.1497 -198.839,-61.4673 z m 198.4288,58.9854 5.4521,5.218 -7.4457,1.2309 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path102" /><path
d="m 301.325,189.4546 1e-4,-57.1161 h -2.25 l -1e-4,57.1161 z m 2.2501,-55.991 -3.375,-6.75 -3.375,6.7499 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path104" /><path
d="m 100.464,190.0916 189.3526,-59.4015 -0.6734,-2.1468 -189.3527,59.4015 z m 188.9528,-56.9179 5.4303,-5.2407 -7.4508,-1.1998 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path106" /><path
d="m 347.7977,126.7135 10e-5,57.1161 h -2.25 l -10e-5,-57.1161 z m 2.2501,55.9911 -3.375,6.75 -3.375,-6.75 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path108" /><path
d="m 345.959,125.6382 -198.6768,61.0879 0.6613,2.1507 198.6767,-61.088 z m -198.2626,58.6066 -5.46,5.2098 7.4438,1.2421 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path110" /><g
id="g112"
transform="matrix(0.2181818,0,0,0.2181818,11.7084,-104.6182)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text116"><tspan
x="0 82.501991 165.00398 247.50597"
y="0"
sodipodi:role="line"
id="tspan114">拉取参数</tspan></text></g><g
id="g118"
transform="matrix(0.2181818,0,0,0.2181818,360.3608,-106.8)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text122"><tspan
x="0 82.501991 165.00398 247.50597"
y="0"
sodipodi:role="line"
id="tspan120">推送参数</tspan></text></g><path
d="m 126.275,53.79316 v -13.5 h 198.5357 v 12.5 h -2.25 v -11.375 l 1.125,1.125 H 127.4 l 1.125,-1.125 v 12.375 z m 4.5,-1.125 -3.375,6.75 -3.375,-6.75 z m 196.2857,-1 -3.375,6.75 -3.375,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path124" /><g
id="g126"
transform="matrix(0.2181818,0,0,0.2181818,190.1605,-241.6363)"><text
transform="matrix(1,0,0,-1,0,1182)"
style="font-variant:normal;font-weight:normal;font-size:83px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text130"><tspan
x="0 56.149494 78.51799 100.88649 130.64198 166.12448 208.49597 251.44847 285.27097"
y="0"
sodipodi:role="line"
id="tspan128">Allreduce</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 13 KiB

BIN
img/ch09/ch10-pipeline-parallel.pdf
View File

Binary file not shown.

589
img/ch09/ch10-pipeline-parallel.svg Normal file
View File

@@ -0,0 +1,589 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="1090.656"
height="313.41534"
viewBox="0 0 1090.656 313.41534"
sodipodi:docname="ch10-pipeline-parallel.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 833 V 256 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="0.83401244"
inkscape:cx="489.80085"
inkscape:cy="182.25148"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-pipeline-parallel"
transform="matrix(1.3333333,0,0,-1.3333333,-16.010641,330.62369)"><g
id="g10" /><g
id="g22"><path
d="m 186,90 h 56 V 57 h -56 z"
style="fill:#bdd7ee;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="translate(205.7981,-188)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text30"><tspan
x="0"
y="0"
id="tspan28">F</tspan></text></g><g
id="g32"
transform="translate(215.7981,-191)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text36"><tspan
x="0"
y="0"
id="tspan34">0</tspan></text></g><path
d="m 241,123 h 57 V 90 h -57 z"
style="fill:#bdd7ee;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path38" /><g
id="g40"
transform="translate(261.4467,-155)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text44"><tspan
x="0"
y="0"
id="tspan42">F</tspan></text></g><g
id="g46"
transform="translate(271.4467,-158)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text50"><tspan
x="0"
y="0"
id="tspan48">1</tspan></text></g><path
d="m 298,157 h 56 v -33 h -56 z"
style="fill:#bdd7ee;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path52" /><g
id="g54"
transform="translate(318.0303,-121)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text58"><tspan
x="0"
y="0"
id="tspan56">F</tspan></text></g><g
id="g60"
transform="translate(328.0303,-124)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0"
y="0"
id="tspan62">2</tspan></text></g><path
d="m 354,191 h 57 v -34 h -57 z"
style="fill:#bdd7ee;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path66" /><g
id="g68"
transform="translate(374.6138,-87)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text72"><tspan
x="0"
y="0"
id="tspan70">F</tspan></text></g><g
id="g74"
transform="translate(384.6138,-90)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text78"><tspan
x="0"
y="0"
id="tspan76">3</tspan></text></g><path
d="m 470,191 h 62 v -34 h -62 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path80" /><g
id="g82"
transform="translate(491.7736,-87)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text86"><tspan
x="0"
y="0"
id="tspan84">B</tspan></text></g><g
id="g88"
transform="translate(502.7736,-90)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text92"><tspan
x="0"
y="0"
id="tspan90">3</tspan></text></g><path
d="m 532,157 h 75 v -33 h -75 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path94" /><g
id="g96"
transform="translate(560.2103,-121)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text100"><tspan
x="0"
y="0"
id="tspan98">B</tspan></text></g><g
id="g102"
transform="translate(571.2103,-124)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text106"><tspan
x="0"
y="0"
id="tspan104">2</tspan></text></g><path
d="m 607,123 h 74 V 90 h -74 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path108" /><g
id="g110"
transform="translate(634.7817,-155)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text114"><tspan
x="0"
y="0"
id="tspan112">B</tspan></text></g><g
id="g116"
transform="translate(645.7817,-158)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text120"><tspan
x="0"
y="0"
id="tspan118">1</tspan></text></g><path
d="m 681,90 h 75 V 57 h -75 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path122" /><g
id="g124"
transform="translate(709.3531,-188)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text128"><tspan
x="0"
y="0"
id="tspan126">B</tspan></text></g><g
id="g130"
transform="translate(720.3531,-191)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text134"><tspan
x="0"
y="0"
id="tspan132">0</tspan></text></g><path
d="m 242,90 h 57 V 57 h -57 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path136" /><g
id="g138"
transform="translate(262.0973,-188)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text142"><tspan
x="0"
y="0"
id="tspan140">F</tspan></text></g><g
id="g144"
transform="translate(272.0973,-191)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text148"><tspan
x="0"
y="0"
id="tspan146">0</tspan></text></g><path
d="m 299,123 h 56 V 90 h -56 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path150" /><g
id="g152"
transform="translate(318.7902,-155)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text156"><tspan
x="0"
y="0"
id="tspan154">F</tspan></text></g><g
id="g158"
transform="translate(328.7902,-158)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text162"><tspan
x="0"
y="0"
id="tspan160">1</tspan></text></g><path
d="m 354,157 h 57 v -33 h -57 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path164" /><g
id="g166"
transform="translate(374.6138,-121)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text170"><tspan
x="0"
y="0"
id="tspan168">F</tspan></text></g><g
id="g172"
transform="translate(384.6138,-124)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text176"><tspan
x="0"
y="0"
id="tspan174">2</tspan></text></g><path
d="m 412,191 h 56 v -34 h -56 z"
style="fill:#deebf7;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path178" /><g
id="g180"
transform="translate(431.8127,-87)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text184"><tspan
x="0"
y="0"
id="tspan182">F</tspan></text></g><g
id="g186"
transform="translate(441.8127,-90)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text190"><tspan
x="0"
y="0"
id="tspan188">3</tspan></text></g><path
d="m 532,191 h 74 v -34 h -74 z"
style="fill:#d0cece;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path192" /><g
id="g194"
transform="translate(559.7794,-87)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text198"><tspan
x="0"
y="0"
id="tspan196">B</tspan></text></g><g
id="g200"
transform="translate(570.7794,-90)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text204"><tspan
x="0"
y="0"
id="tspan202">3</tspan></text></g><path
d="m 607,157 h 74 v -33 h -74 z"
style="fill:#d0cece;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path206" /><g
id="g208"
transform="translate(634.7817,-121)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text212"><tspan
x="0"
y="0"
id="tspan210">B</tspan></text></g><g
id="g214"
transform="translate(645.7817,-124)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text218"><tspan
x="0"
y="0"
id="tspan216">2</tspan></text></g><path
d="m 680,123 h 75 V 90 h -75 z"
style="fill:#d0cece;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path220" /><g
id="g222"
transform="translate(708.7025,-155)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text226"><tspan
x="0"
y="0"
id="tspan224">B</tspan></text></g><g
id="g228"
transform="translate(719.7025,-158)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text232"><tspan
x="0"
y="0"
id="tspan230">1</tspan></text></g><path
d="m 756,90 h 74 V 57 h -74 z"
style="fill:#d0cece;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path234" /><g
id="g236"
transform="translate(783.9246,-188)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text240"><tspan
x="0"
y="0"
id="tspan238">B</tspan></text></g><g
id="g242"
transform="translate(794.9246,-191)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:12px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text246"><tspan
x="0"
y="0"
id="tspan244">0</tspan></text></g><g
id="g248"
transform="translate(76.85417,-189)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text252"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan250">设备</tspan></text></g><g
id="g254"
transform="translate(112.8542,-189)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text258"><tspan
x="0"
y="0"
id="tspan256">1</tspan></text></g><g
id="g260"
transform="translate(76.85417,-155)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text264"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan262">设备</tspan></text></g><g
id="g266"
transform="translate(112.8542,-155)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text270"><tspan
x="0"
y="0"
id="tspan268">2</tspan></text></g><g
id="g272"
transform="translate(76.87843,-120)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text276"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan274">设备</tspan></text></g><g
id="g278"
transform="translate(112.8784,-120)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text282"><tspan
x="0"
y="0"
id="tspan280">3</tspan></text></g><g
id="g284"
transform="translate(76.85417,-86)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text288"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan286">设备</tspan></text></g><g
id="g290"
transform="translate(112.8542,-86)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text294"><tspan
x="0"
y="0"
id="tspan292">4</tspan></text></g><g
id="g296"
transform="translate(69.05582,-240)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text300"><tspan
x="0 18 36 54 72 90"
y="0"
sodipodi:role="line"
id="tspan298">将数据切分为</tspan></text></g><g
id="g302"
transform="translate(177.0558,-240)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:bold;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Bold;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text306"><tspan
x="0 18 36"
y="0"
sodipodi:role="line"
id="tspan304">微批次</tspan></text></g><g
id="g308"
transform="translate(231.0558,-240)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text312"><tspan
x="0"
y="0"
id="tspan310">（</tspan></text></g><g
id="g314"
transform="translate(249.0558,-240)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text318"><tspan
x="0 14.9994 20.008801 27.016199 34.023602"
y="0"
sodipodi:role="line"
id="tspan316">Micro</tspan></text></g><g
id="g320"
transform="translate(292.0558,-240)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text324"><tspan
x="0"
y="0"
id="tspan322">-</tspan></text></g><g
id="g326"
transform="translate(298.0558,-240)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text330"><tspan
x="0 9 18 23.993999 30.996"
y="0"
sodipodi:role="line"
id="tspan328">batch</tspan></text></g><g
id="g332"
transform="translate(339.0558,-240)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text336"><tspan
x="0 18 36 54 72 90 108"
y="0"
sodipodi:role="line"
id="tspan334">）来构建流⽔线</tspan></text></g><path
d="m 182,215.125 639.0713,-1e-4 v -2.25 L 182,212.875 Z m 637.9462,2.2499 6.75,-3.375 -6.75,-3.375 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path338" /><g
id="g340"
transform="translate(781.6303,-23)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text344"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan342">时间</tspan></text></g><g
id="g346"
transform="translate(182.8676,-77)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text350"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan348">前向计算</tspan></text></g><g
id="g352"
transform="translate(715.5527,-75)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text356"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan354">后向计算</tspan></text></g><path
d="m 36.5,183.5 h 25 v -16 h -25 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path358" /><g
id="g360"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,36.5,183.5)"><path
d="M 0,0 H 317500 V 203200 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path362" /></g><path
d="m 36.5,146.5 h 25 v -16 h -25 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path364" /><g
id="g366"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,36.5,146.5)"><path
d="M 0,0 H 317500 V 203200 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path368" /></g><path
d="m 36.5,114.5 h 25 v -16 h -25 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path370" /><g
id="g372"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,36.5,114.5)"><path
d="M 0,0 H 317500 V 203200 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path374" /></g><path
d="m 36.5,79.5 h 25 v -16 h -25 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path376" /><g
id="g378"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,36.5,79.5)"><path
d="M 0,0 H 317500 V 203200 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path380" /></g><g
id="g382"
transform="translate(11.8322,-49)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text386"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan384">模型分区</tspan></text></g><g
id="g388"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,168.5,98.5)"><path
d="M 0,105834.6 C 0,47383.77 47383.72,0 105834.5,0 H 1646765 c 58451,0 105835,47383.77 105835,105834.6 v 423330.8 c 0,58450.8 -47384,105834.6 -105835,105834.6 H 105834.5 C 47383.72,635000 0,587616.2 0,529165.4 Z"
style="fill:none;stroke:#c00000;stroke-width:38100;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:114300, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path390" /></g><path
d="m 49.125,79.82118 6e-5,13.55382 -2.25,1e-5 -6e-5,-13.55382 z M 51.37505,92.24999 48.00008,99 44.62505,92.25002 Z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path392" /><path
d="m 46.87508,114.5194 -5e-5,10.8556 h 2.25 l 5e-5,-10.8555 z M 44.62503,124.25 48,131 l 3.37503,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path394" /><path
d="m 49.125,147.0624 6e-5,15.3126 h -2.25 l -6e-5,-15.3126 z m 2.25005,14.1876 -3.37497,6.75 -3.37503,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path396" /><g
id="g398"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,453.5,201.5)"><path
d="M 0,107952 C 0,48331.76 48331.76,0 107952,0 h 1003296 c 59620,0 107952,48331.76 107952,107952 v 431796 c 0,59620.3 -48332,107952 -107952,107952 H 107952 C 48331.76,647700 0,599368.3 0,539748 Z"
style="fill:none;stroke:#c00000;stroke-width:38100;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:114300, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path400" /></g><g
id="g402"
transform="translate(362.4592,-24)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:bold;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Bold;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text406"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan404">重新计算</tspan></text></g><g
id="g408"
transform="translate(434.4592,-24)"><text
transform="matrix(1,0,0,-1,0,256)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text412"><tspan
x="0 18 36 54 72 90 108 126 144 162"
y="0"
sodipodi:role="line"
id="tspan410">激活值来减少内存开销</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 32 KiB

BIN
img/ch09/ch10-recommendation-model.pdf
View File

Binary file not shown.

454
img/ch09/ch10-recommendation-model.svg Normal file
View File

@@ -0,0 +1,454 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="1169.1067"
height="485.94922"
viewBox="0 0 1169.1067 485.94922"
sodipodi:docname="ch10-recommendation-model.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 903 V 387 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="0.79109039"
inkscape:cx="530.28074"
inkscape:cy="251.55153"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-recommendation-model"
transform="matrix(1.3333333,0,0,-1.3333333,-17.714845,501.17967)"><g
id="g10" /><g
id="g22"><path
d="m 423.5,348.5 h 230 v -17 h -230 z"
style="fill:#fbe5d6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,423.5,348.5)"><path
d="M 0,0 H 2921000 V 215900 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path28" /></g><g
id="g30"
transform="translate(654.1775,-47)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text34"><tspan
x="0 12 16 24 28 37 42 50 54 63 67 72 76 85 89 98 103 112 120 124 128 137 146 154"
y="0"
sodipodi:role="line"
id="tspan32">History of Interactions </tspan></text></g><g
id="g36"
transform="translate(671.1775,-66)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text40"><tspan
x="0 4 9.0080004 21.007999 30.016001 39.023998 48.032001 52.032001 61.040001 70.047997 74.047997 83.056 86.047997 90.047997 94.047997 103.056 116.064"
y="0"
sodipodi:role="line"
id="tspan38">/ Candidate Items</tspan></text></g><path
d="m 544,327.5 10e-5,-13.022 -3.0001,-1e-4 V 327.5 Z m 3,-11.522 -4.4999,-9 -4.5001,8.9999 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path42" /><path
d="m 354.5,283.1662 c 0,13.9915 11.3423,25.3338 25.3338,25.3338 h 133.3324 c 13.9915,0 25.3338,-11.3423 25.3338,-25.3338 V 181.8338 C 538.5,167.8423 527.1577,156.5 513.1662,156.5 H 379.8338 c -13.9915,0 -25.3338,11.3423 -25.3338,25.3338 z"
style="fill:#f8cbad;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path44" /><g
id="g46"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,354.5,308.5)"><path
d="M 0,321739.7 C 0,144047.8 144047.6,0 321739.3,0 H 2015061 c 177691,0 321739,144047.8 321739,321739.7 V 1608660 c 0,177692 -144048,321740 -321739,321740 H 321739.3 C 144047.6,1930400 0,1786352 0,1608660 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path48" /></g><g
id="g50"
transform="translate(403.2841,-150)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text54"><tspan
x="0 8 16 24 32 46 50 57.007999 60 68 76"
y="0"
sodipodi:role="line"
id="tspan52">1000M x 100</tspan></text></g><g
id="g56"
transform="translate(392.2841,-169)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text60"><tspan
x="0 10 16 24 30 34 42 55.007999 63.007999 71.008003 79.008003 87.008003 91.008003 99.008003"
y="0"
sodipodi:role="line"
id="tspan58">User Embedding</tspan></text></g><path
d="m 555.5,302.1665 c 0,4.0502 3.2833,7.3335 7.3335,7.3335 h 157.333 c 4.0502,0 7.3335,-3.2833 7.3335,-7.3335 v -29.333 c 0,-4.0502 -3.2833,-7.3335 -7.3335,-7.3335 h -157.333 c -4.0502,0 -7.3335,3.2833 -7.3335,7.3335 z"
style="fill:#f8cbad;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path62" /><g
id="g64"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,555.5,309.5)"><path
d="M 0,93135.72 C 0,41698.28 41698.23,0 93135.61,0 H 2091264 c 51438,0 93136,41698.28 93136,93135.72 V 465664.3 c 0,51437.4 -41698,93135.7 -93136,93135.7 H 93135.61 C 41698.23,558800 0,517101.7 0,465664.3 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path66" /></g><g
id="g68"
transform="translate(606.428,-95)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text72"><tspan
x="0 8 16 30 34 41.007999 44 52 60"
y="0"
sodipodi:role="line"
id="tspan70">10M x 100</tspan></text></g><g
id="g74"
transform="translate(587.428,-114)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text78"><tspan
x="0 4 8.9919996 16.992001 30 34 42 55.007999 63.007999 71.008003 79.008003 87.008003 91.008003 99.008003"
y="0"
sodipodi:role="line"
id="tspan76">Item Embedding</tspan></text></g><path
d="m 555.5,249.1665 c 0,4.0502 3.2833,7.3335 7.3335,7.3335 h 157.333 c 4.0502,0 7.3335,-3.2833 7.3335,-7.3335 v -29.333 c 0,-4.0502 -3.2833,-7.3335 -7.3335,-7.3335 h -157.333 c -4.0502,0 -7.3335,3.2833 -7.3335,7.3335 z"
style="fill:#f8cbad;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path80" /><g
id="g82"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,555.5,256.5)"><path
d="M 0,93135.72 C 0,41698.28 41698.23,0 93135.61,0 H 2091264 c 51438,0 93136,41698.28 93136,93135.72 V 465664.3 c 0,51437.4 -41698,93135.7 -93136,93135.7 H 93135.61 C 41698.23,558800 0,517101.7 0,465664.3 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path84" /></g><g
id="g86"
transform="translate(598.4281,-148)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text90"><tspan
x="0 10 16 24 30 34 43.007999 51.007999 59.007999 64 72 79.008003 84"
y="0"
sodipodi:role="line"
id="tspan88">User Context </tspan></text></g><g
id="g92"
transform="translate(604.4281,-167)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text96"><tspan
x="0 8 21.007999 29.007999 37.007999 45.007999 53.007999 57.007999 65.008003"
y="0"
sodipodi:role="line"
id="tspan94">Embedding</tspan></text></g><path
d="m 555.5,193.1665 c 0,4.0502 3.2833,7.3335 7.3335,7.3335 h 157.333 c 4.0502,0 7.3335,-3.2833 7.3335,-7.3335 v -29.333 c 0,-4.0502 -3.2833,-7.3335 -7.3335,-7.3335 h -157.333 c -4.0502,0 -7.3335,3.2833 -7.3335,7.3335 z"
style="fill:#f8cbad;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path98" /><g
id="g100"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,555.5,200.5)"><path
d="M 0,93135.72 C 0,41698.28 41698.23,0 93135.61,0 H 2091264 c 51438,0 93136,41698.28 93136,93135.72 V 465664.3 c 0,51437.4 -41698,93135.7 -93136,93135.7 H 93135.61 C 41698.23,558800 0,517101.7 0,465664.3 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path102" /></g><g
id="g104"
transform="translate(598.4281,-203)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text108"><tspan
x="0 4 8.9919996 16.992001 30 34 43.007999 51.007999 59.007999 64 72 79.008003 84"
y="0"
sodipodi:role="line"
id="tspan106">Item Context </tspan></text></g><g
id="g110"
transform="translate(604.4281,-222)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text114"><tspan
x="0 8 21.007999 29.007999 37.007999 45.007999 53.007999 57.007999 65.008003"
y="0"
sodipodi:role="line"
id="tspan112">Embedding</tspan></text></g><path
d="m 361.5,138.1665 c 0,4.6025 3.731,8.3335 8.3334,8.3335 h 345.3332 c 4.6024,0 8.3334,-3.731 8.3334,-8.3335 v -33.333 C 723.5,100.231 719.769,96.5 715.1666,96.5 H 369.8334 c -4.6024,0 -8.3334,3.731 -8.3334,8.3335 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path116" /><g
id="g118"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,361.5,146.5)"><path
d="M 0,105835 C 0,47383.95 47383.82,0 105834.7,0 H 4491565 c 58451,0 105835,47383.95 105835,105835 v 423330 c 0,58451.1 -47384,105835 -105835,105835 H 105834.7 C 47383.82,635000 0,587616.1 0,529165 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path120" /></g><path
d="m 392.5,139.5 h 300 v -11 h -300 z"
style="fill:#ed7d31;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path122" /><g
id="g124"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,392.5,139.5)"><path
d="M 0,0 H 3810000 V 139700 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path126" /></g><path
d="m 424.5,118.5 h 239 v -11 h -239 z"
style="fill:#ed7d31;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path128" /><g
id="g130"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,424.5,118.5)"><path
d="M 0,0 H 3035300 V 139700 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path132" /></g><path
d="m 463.5,78.5 h 157 v -15 h -157 z"
style="fill:#fbe5d6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path134" /><g
id="g136"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,463.5,78.5)"><path
d="M 0,0 H 1993900 V 190500 H 0 Z"
style="fill:none;stroke:#2f528f;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path138" /></g><path
d="m 543.9996,99.53309 0.3528,-15.98875 -2.9992,-0.06618 -0.3528,15.98875 z m 3.319,-14.42294 -4.3003,-9.09708 -4.6975,8.89854 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path140" /><g
id="g142"
transform="translate(630.2726,-322)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text146"><tspan
x="0 12 21 29 38 51 64 73 82 91 100 104 108 117 126 134 138 142 147 159 168 177"
y="0"
sodipodi:role="line"
id="tspan144">Recommendations / Rank</tspan></text></g><g
id="g148"
transform="translate(741.0651,-156)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text152"><tspan
x="0 10.0008 20.0016 30.002399 39.002399 44.0028 58.003201 70.003799"
y="0"
sodipodi:role="line"
id="tspan150">100s GB </tspan></text></g><g
id="g154"
transform="translate(816.0651,-156)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text158"><tspan
x="0"
y="0"
id="tspan156">–</tspan></text></g><g
id="g160"
transform="translate(831.0651,-156)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text164"><tspan
x="0 10.0008 20.0016 29.0016 34.001999 45.001801"
y="0"
sodipodi:role="line"
id="tspan162">10s TB</tspan></text></g><g
id="g166"
transform="translate(741.0651,-273)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text170"><tspan
x="0 10.0008 20.0016 29.0016 34.001999 48.002399 60.002998"
y="0"
sodipodi:role="line"
id="tspan168">10s GB </tspan></text></g><g
id="g172"
transform="translate(806.0651,-273)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text176"><tspan
x="0"
y="0"
id="tspan174">–</tspan></text></g><g
id="g178"
transform="translate(821.0651,-273)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text182"><tspan
x="0 10.0008 20.0016 30.002399 39.002399 44.0028 58.003201"
y="0"
sodipodi:role="line"
id="tspan180">100s GB</tspan></text></g><g
id="g184"
transform="translate(447.3055,-351)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text188"><tspan
x="0"
y="0"
id="tspan186">•</tspan></text></g><g
id="g190"
transform="translate(470.3055,-351)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text194"><tspan
x="0 10.9998 16.999201 27 41.999401 52.000198 62.000999 72.001801 82.002602 92.003403 101.0034 106.0038 121.0032 131.004 146.0034 156.0042 162.0036 171.0036 176.004 185.004 195.00481 204.00481"
y="0"
sodipodi:role="line"
id="tspan192">Tremendous memory cost</tspan></text></g><g
id="g196"
transform="translate(447.3055,-372)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text200"><tspan
x="0"
y="0"
id="tspan198">•</tspan></text></g><g
id="g202"
transform="translate(470.3055,-372)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text206"><tspan
x="0 12.0006 27 37.000801 41.000401 45 50.000401 59.000401 69.001198 84.000603 94.001404 104.0022 109.0026 119.0034 124.0038 128.0034 138.0042 148.005 153.0054 162.0054 172.0062 181.0062"
y="0"
sodipodi:role="line"
id="tspan204">Small computation cost</tspan></text></g><path
d="m 78.5,344.5 h 84 v -33 h -84 z"
style="fill:#e2f0d9;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path208" /><g
id="g210"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,78.5,344.5)"><path
d="M 0,0 H 1066800 V 419100 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path212" /></g><g
id="g214"
transform="translate(99.07492,-64)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Calibri;-inkscape-font-specification:Calibri;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text218"><tspan
x="0 4 17.007999 25.007999 33.007999"
y="0"
sodipodi:role="line"
id="tspan216">Image</tspan></text></g><path
d="M 21,260.166 C 21,277.1951 34.80485,291 51.83399,291 H 184.166 C 201.1952,291 215,277.1951 215,260.166 V 136.834 C 215,119.8049 201.1952,106 184.166,106 H 51.83399 C 34.80485,106 21,119.8049 21,136.834 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path220" /><g
id="g222"
transform="translate(76.05567,-314)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:16px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text226"><tspan
x="0 12 16 25 33 41 45 49 53 61 70 74 78 87"
y="0"
sodipodi:role="line"
id="tspan224">Classification</tspan></text></g><path
d="m 77.5,277.5 h 84 v -17 h -84 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path228" /><g
id="g230"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,77.5,277.5)"><path
d="M 0,0 H 1066800 V 215900 H 0 Z"
style="fill:none;stroke:#70ad47;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path232" /></g><path
d="m 90.5,253.5 h 60 v -16 h -60 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path234" /><g
id="g236"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,90.5,253.5)"><path
d="M 0,0 H 762000 V 203200 H 0 Z"
style="fill:none;stroke:#70ad47;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path238" /></g><path
d="m 36.5,157.5 h 165 v -17 h -165 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path240" /><g
id="g242"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,36.5,157.5)"><path
d="M 0,0 H 2095500 V 215900 H 0 Z"
style="fill:none;stroke:#70ad47;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path244" /></g><path
d="m 90.5,230.5 h 60 v -17 h -60 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path246" /><g
id="g248"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,90.5,230.5)"><path
d="M 0,0 H 762000 V 215900 H 0 Z"
style="fill:none;stroke:#70ad47;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path250" /></g><path
d="m 77.5,207.5 h 84 v -17 h -84 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path252" /><g
id="g254"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,77.5,207.5)"><path
d="M 0,0 H 1066800 V 215900 H 0 Z"
style="fill:none;stroke:#70ad47;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path256" /></g><path
d="m 63.5,181.5 h 111 v -17 h -111 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path258" /><g
id="g260"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,63.5,181.5)"><path
d="M 0,0 H 1409700 V 215900 H 0 Z"
style="fill:none;stroke:#70ad47;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path262" /></g><path
d="m 64.5,132.5 h 111 v -17 h -111 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path264" /><g
id="g266"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,64.5,132.5)"><path
d="M 0,0 H 1409700 V 215900 H 0 Z"
style="fill:none;stroke:#70ad47;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path268" /></g><path
d="m 119.75,309 1e-4,-21.637 h -1.5 L 118.25,309 Z m 2.2501,-20.637 -3,-6 -3,6 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path270" /><path
d="m 117.75,116 1e-4,-18.38685 h -1.5 L 116.25,116 Z m 2.2501,-17.38684 -3,-6.00001 -3,5.99999 z"
style="fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path272" /><g
id="g274"
transform="translate(20.75323,-349)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text278"><tspan
x="0"
y="0"
id="tspan276">•</tspan></text></g><g
id="g280"
transform="translate(43.75323,-349)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text284"><tspan
x="0 14.9994 25.0002 35.000999 45.001801 51.001202 61.001999 66.002403 76.003197 81.003601 96.002998 106.0038 121.0032 131.004 137.0034 146.0034 151.0038 160.0038 170.00459 179.00459"
y="0"
sodipodi:role="line"
id="tspan282">Moderate memory cost</tspan></text></g><g
id="g286"
transform="translate(20.75323,-370)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text290"><tspan
x="0"
y="0"
id="tspan288">•</tspan></text></g><g
id="g292"
transform="translate(43.75323,-370)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text296"><tspan
x="0 10.0008 20.0016 26.000999 36.001801 46.002602 51.002998 60.002998 70.003799 85.003197 95.003998 105.0048 110.0052 120.006 125.0064 129.006 139.00681 149.0076 154.008 163.008 173.0088 182.0088"
y="0"
sodipodi:role="line"
id="tspan294">Large computation cost</tspan></text></g><g
id="g298"
transform="translate(11.91504,-28)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text302"><tspan
x="0 12.9996 23.000401 33.001202 39.000599 49.0014 53.000999 58.0014 68.002197 78.002998 83.003403 96.002998 106.0038 112.0032 121.0032 126.0036 131.004 137.0034 147.0042 151.0038 161.00459 165.0042 175.005 185.0058 190.0062 199.0062 208.0062 217.0062 222.00661 232.0074"
y="0"
sodipodi:role="line"
id="tspan300">Neural network training system</tspan></text></g><g
id="g304"
transform="translate(449.7736,-24)"><text
transform="matrix(1,0,0,-1,0,387)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:Arial;-inkscape-font-specification:ArialMT;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text308"><tspan
x="0 12.9996 23.000401 32.000401 42.001202 57.000599 72 82.000801 92.001602 102.0024 112.0032 117.0036 121.0032 131.004 141.00481 146.0052 155.0052 164.0052 173.0052 178.0056 188.00639"
y="0"
sodipodi:role="line"
id="tspan306">Recommendation system</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 28 KiB

BIN
img/ch09/ch10-single-node.pdf
View File

Binary file not shown.

309
img/ch09/ch10-single-node.svg Normal file
View File

@@ -0,0 +1,309 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="1052.9974"
height="346.66837"
viewBox="0 0 1052.9975 346.66837"
sodipodi:docname="ch10-single-node.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 802 V 260 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
inkscape:zoom="0.85170225"
inkscape:cx="554.77134"
inkscape:cy="187.85908"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-single-node"
transform="matrix(1.3333333,0,0,-1.3333333,-16.336198,346.66818)"><g
id="g10" /><g
id="g22"><path
d="m 82.5,216.3324 c 0,23.8408 19.3268,43.1676 43.1675,43.1676 h 632.665 c 23.8407,0 43.1675,-19.3268 43.1675,-43.1676 V 43.66758 C 801.5,19.82678 782.1732,0.4999909 758.3325,0.4999909 H 125.6675 C 101.8268,0.4999909 82.5,19.82678 82.5,43.66758 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,82.5,259.5)"><path
d="M 0,548228.3 C 0,245450.2 245449.8,0 548227.5,0 H 8583072 c 302778,0 548228,245450.2 548228,548228.3 V 2741072 c 0,302778 -245450,548228 -548228,548228 H 548227.5 C 245449.8,3289300 0,3043850 0,2741072 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path28" /></g><path
d="m 491.5,204.5 h 72 v -138 h -72 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path30" /><g
id="g32"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,491.5,204.5)"><path
d="M 0,0 H 914400 V 1752600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path34" /></g><path
d="m 653.5,205.5 h 72 v -138 h -72 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path36" /><g
id="g38"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,653.5,205.5)"><path
d="M 0,0 H 914400 V 1752600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path40" /></g><path
d="m 330.5,204.5 h 72 v -138 h -72 z"
style="fill:#a9d18e;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path42" /><g
id="g44"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,330.5,204.5)"><path
d="M 0,0 H 914400 V 1752600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path46" /></g><path
d="m 108.5,204.5 h 72 v -138 h -72 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path48" /><g
id="g50"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,108.5,204.5)"><path
d="M 0,0 H 914400 V 1752600 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path52" /></g><g
id="g54"
transform="translate(345.5718,-125)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text58"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan56">算⼦</tspan></text></g><g
id="g60"
transform="translate(381.5718,-125)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0"
y="0"
id="tspan62">1</tspan></text></g><g
id="g66"
transform="translate(331.5718,-147)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text70"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan68">（参数）</tspan></text></g><g
id="g72"
transform="translate(505.8641,-125)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text76"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan74">算⼦</tspan></text></g><g
id="g78"
transform="translate(541.8641,-125)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text82"><tspan
x="0"
y="0"
id="tspan80">2</tspan></text></g><g
id="g84"
transform="translate(491.8641,-147)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text88"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan86">（参数）</tspan></text></g><g
id="g90"
transform="translate(665.4562,-125)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text94"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan92">算⼦</tspan></text></g><g
id="g96"
transform="translate(701.4562,-125)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text100"><tspan
x="0"
y="0"
id="tspan98">3</tspan></text></g><g
id="g102"
transform="translate(651.4562,-147)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text106"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan104">（参数）</tspan></text></g><g
id="g108"
transform="translate(488.5967,-34)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:bold;font-size:20px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Bold;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text112"><tspan
x="0 20"
y="0"
sodipodi:role="line"
id="tspan110">程序</tspan></text></g><g
id="g114"
transform="translate(210.1814,-64)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text118"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan116">前向</tspan></text></g><g
id="g120"
transform="translate(601.0888,-184)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text124"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan122">反向</tspan></text></g><g
id="g126"
transform="translate(123.1056,-132)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:bold;font-size:20px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Bold;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text130"><tspan
x="0 20"
y="0"
sodipodi:role="line"
id="tspan128">数据</tspan></text></g><g
id="g132"
transform="translate(11.86543,-140)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text136"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan134">设备</tspan></text></g><g
id="g138"
transform="translate(47.86543,-140)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text142"><tspan
x="0"
y="0"
id="tspan140">1</tspan></text></g><path
d="m 180.5,181.75 129.4448,-1e-4 v -4.5 L 180.5,177.25 Z m 127.1948,4.4999 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path144" /><path
d="m 402.5,181.75 75.7035,-1e-4 v -4.5 L 402.5,177.25 Z m 73.4535,4.4999 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path146" /><path
d="m 563.5,180.75 78.6561,-1e-4 v -4.5 L 563.5,176.25 Z m 76.4061,4.4999 13.5,-6.75 -13.5,-6.75 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path148" /><path
d="m 653.3761,100.7499 -77.6501,-0.80835 0.0469,-4.49976 77.65,0.80833 z m -75.4471,3.7148 -13.429,-6.89013 13.5696,-6.60911 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path150" /><path
d="m 491.2052,99.75 -77.4552,-7e-5 v -4.5 l 77.4552,7e-5 z M 416,104.2499 402.5,97.49992 416,90.74993 Z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path152" /><path
d="m 319.5,56.5 h 93 v -37 h -93 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path154" /><g
id="g156"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,319.5,56.5)"><path
d="M 0,0 H 1181100 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path158" /></g><g
id="g160"
transform="translate(343.4833,-226)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text164"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan162">梯度</tspan></text></g><g
id="g166"
transform="translate(379.4833,-226)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text170"><tspan
x="0"
y="0"
id="tspan168">1</tspan></text></g><path
d="m 478.5,56.5 h 93 v -37 h -93 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path172" /><g
id="g174"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,478.5,56.5)"><path
d="M 0,0 H 1181100 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path176" /></g><g
id="g178"
transform="translate(504.7962,-227)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text182"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan180">梯度</tspan></text></g><g
id="g184"
transform="translate(540.7962,-227)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text188"><tspan
x="0"
y="0"
id="tspan186">2</tspan></text></g><path
d="m 640.5,57.5 h 93 v -37 h -93 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path190" /><g
id="g192"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,640.5,57.5)"><path
d="M 0,0 H 1181100 V 469900 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path194" /></g><g
id="g196"
transform="translate(664.2755,-227)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text200"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan198">梯度</tspan></text></g><g
id="g202"
transform="translate(700.2755,-227)"><text
transform="matrix(1,0,0,-1,0,260)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-SC;-inkscape-font-specification:STSongti-SC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text206"><tspan
x="0"
y="0"
id="tspan204">3</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 17 KiB

BIN
img/ch09/ch10-single-vs-multi.pdf
View File

Binary file not shown.

339
img/ch09/ch10-single-vs-multi.svg Normal file
View File

@@ -0,0 +1,339 @@
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!-- Created with Inkscape (http://www.inkscape.org/) -->
<svg
version="1.1"
id="svg2"
xml:space="preserve"
width="1210.6666"
height="389.91666"
viewBox="0 0 1210.6666 389.91665"
sodipodi:docname="ch10-single-vs-multi.svg"
inkscape:version="1.1.1 (3bf5ae0d25, 2021-09-20)"
xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg"><defs
id="defs6"><clipPath
clipPathUnits="userSpaceOnUse"
id="clipPath18"><path
d="M 0,0 H 914 V 310 H 0 Z"
id="path16" /></clipPath></defs><sodipodi:namedview
id="namedview4"
pagecolor="#ffffff"
bordercolor="#666666"
borderopacity="1.0"
inkscape:pageshadow="2"
inkscape:pageopacity="0.0"
inkscape:pagecheckerboard="0"
showgrid="false"
fit-margin-top="0"
fit-margin-left="0"
fit-margin-right="0"
fit-margin-bottom="0"
inkscape:zoom="0.53460062"
inkscape:cx="416.19854"
inkscape:cy="192.66719"
inkscape:window-width="1920"
inkscape:window-height="1137"
inkscape:window-x="1912"
inkscape:window-y="-8"
inkscape:window-maximized="1"
inkscape:current-layer="g8" /><g
id="g8"
inkscape:groupmode="layer"
inkscape:label="ch10-single-vs-multi"
transform="matrix(1.3333333,0,0,-1.3333333,-7.999998,407.99999)"><g
id="g10" /><g
id="g22"><path
d="m 6.5,224.6663 c 0,7.0879 5.74582,12.8337 12.83364,12.8337 H 167.6664 c 7.0878,0 12.8336,-5.7458 12.8336,-12.8337 V 173.3336 C 180.5,166.2458 174.7542,160.5 167.6664,160.5 H 19.33364 C 12.24582,160.5 6.5,166.2458 6.5,173.3336 Z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path24" /><g
id="g26"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,6.5,237.5)"><path
d="M 0,162987.4 C 0,72971.93 72971.88,0 162987.3,0 H 2046813 c 90015,0 162987,72971.93 162987,162987.4 v 651925.3 c 0,90015.4 -72972,162987.3 -162987,162987.3 H 162987.3 C 72971.88,977900 0,904928.1 0,814912.7 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path28" /></g><path
d="m 6.5,305.5 h 174 v -30 H 6.5 Z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path30" /><g
id="g32"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,6.5,305.5)"><path
d="M 0,0 H 2209800 V 381000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path34" /></g><path
d="m 544.5,305.5 h 57 v -31 h -57 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path36" /><g
id="g38"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,544.5,305.5)"><path
d="M 0,0 H 723900 V 393700 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path40" /></g><path
d="m 605.5,305.5 h 57 v -31 h -57 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path42" /><g
id="g44"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,605.5,305.5)"><path
d="M 0,0 H 723900 V 393700 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path46" /></g><path
d="m 6.5,119.5 h 174 v -30 H 6.5 Z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path48" /><g
id="g50"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,6.5,119.5)"><path
d="M 0,0 H 2209800 V 381000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path52" /></g><g
id="g54"
transform="translate(53.74378,-116)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text58"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan56">计算节点</tspan></text></g><g
id="g60"
transform="translate(72.88779,-23)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text64"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan62">输入</tspan></text></g><g
id="g66"
transform="translate(66.13496,-210)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text70"><tspan
x="0 18"
y="0"
sodipodi:role="line"
id="tspan68">输出</tspan></text></g><path
d="M 97.25,275 V 262.0899 H 102 L 92.5,237 83,262.0899 h 4.75 V 275 Z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path72" /><path
d="M 97.25,160 V 146.0898 H 102 L 92.5,121 83,146.0898 h 4.75 V 160 Z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path74" /><g
id="g76"
transform="translate(12.7774,-293)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:20px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text80"><tspan
x="0"
y="0"
id="tspan78">（</tspan></text></g><g
id="g82"
transform="translate(32.7774,-293)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:20px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text86"><tspan
x="0"
y="0"
id="tspan84">a</tspan></text></g><g
id="g88"
transform="translate(42.7774,-293)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:20px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text92"><tspan
x="0"
y="0"
id="tspan90">）</tspan></text></g><g
id="g94"
transform="translate(62.7774,-293)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:20px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text98"><tspan
x="0 20 40 60 80"
y="0"
sodipodi:role="line"
id="tspan96">单节点执⾏</tspan></text></g><path
d="m 357.5,222.6663 c 0,7.0879 5.7458,12.8337 12.8336,12.8337 h 148.3328 c 7.0878,0 12.8336,-5.7458 12.8336,-12.8337 V 171.3336 C 531.5,164.2458 525.7542,158.5 518.6664,158.5 H 370.3336 c -7.0878,0 -12.8336,5.7458 -12.8336,12.8336 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path100" /><g
id="g102"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,357.5,235.5)"><path
d="M 0,162987.4 C 0,72971.93 72971.88,0 162987.3,0 H 2046813 c 90015,0 162987,72971.93 162987,162987.4 v 651925.3 c 0,90015.4 -72972,162987.3 -162987,162987.3 H 162987.3 C 72971.88,977900 0,904928.1 0,814912.7 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path104" /></g><g
id="g106"
transform="translate(400.5202,-118)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text110"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan108">计算节点</tspan></text></g><g
id="g112"
transform="translate(477.5202,-118)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text116"><tspan
x="0"
y="0"
id="tspan114">1</tspan></text></g><path
d="m 549.5,222.6663 c 0,7.0879 5.7458,12.8337 12.8336,12.8337 h 148.3328 c 7.0878,0 12.8336,-5.7458 12.8336,-12.8337 V 171.3336 C 723.5,164.2458 717.7542,158.5 710.6664,158.5 H 562.3336 c -7.0878,0 -12.8336,5.7458 -12.8336,12.8336 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path118" /><g
id="g120"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,549.5,235.5)"><path
d="M 0,162987.4 C 0,72971.93 72971.88,0 162987.3,0 H 2046813 c 90015,0 162987,72971.93 162987,162987.4 v 651925.3 c 0,90015.4 -72972,162987.3 -162987,162987.3 H 162987.3 C 72971.88,977900 0,904928.1 0,814912.7 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path122" /></g><path
d="m 666.5,305.5 h 58 v -30 h -58 z"
style="fill:#9dc3e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path124" /><g
id="g126"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,666.5,305.5)"><path
d="M 0,0 H 736600 V 381000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path128" /></g><g
id="g130"
transform="translate(591.9943,-119)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text134"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan132">计算节点</tspan></text></g><g
id="g136"
transform="translate(668.9943,-119)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text140"><tspan
x="0"
y="0"
id="tspan138">2</tspan></text></g><path
d="m 739.5,222.6663 c 0,7.0879 5.7458,12.8337 12.8336,12.8337 h 148.3328 c 7.0878,0 12.8336,-5.7458 12.8336,-12.8337 V 171.3336 C 913.5,164.2458 907.7542,158.5 900.6664,158.5 H 752.3336 c -7.0878,0 -12.8336,5.7458 -12.8336,12.8336 z"
style="fill:#e7e6e6;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path142" /><g
id="g144"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,739.5,235.5)"><path
d="M 0,162987.4 C 0,72971.93 72971.88,0 162987.3,0 H 2046813 c 90015,0 162987,72971.93 162987,162987.4 v 651925.3 c 0,90015.4 -72972,162987.3 -162987,162987.3 H 162987.3 C 72971.88,977900 0,904928.1 0,814912.7 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:50800, 38100;stroke-dashoffset:0;stroke-opacity:1"
id="path146" /></g><g
id="g148"
transform="translate(784.5895,-120)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text152"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan150">计算节点</tspan></text></g><g
id="g154"
transform="translate(861.5895,-120)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text158"><tspan
x="0"
y="0"
id="tspan156">3</tspan></text></g><path
d="m 541.5,109.5 h 58 v -30 h -58 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path160" /><g
id="g162"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,541.5,109.5)"><path
d="M 0,0 H 736600 V 381000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path164" /></g><path
d="m 603.5,109.5 h 57 v -30 h -57 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path166" /><g
id="g168"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,603.5,109.5)"><path
d="M 0,0 H 723900 V 381000 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path170" /></g><path
d="m 664.5,110.5 h 57 v -31 h -57 z"
style="fill:#afabab;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path172" /><g
id="g174"
transform="matrix(7.874016e-5,0,0,-7.874016e-5,664.5,110.5)"><path
d="M 0,0 H 723900 V 393700 H 0 Z"
style="fill:none;stroke:#000000;stroke-width:12700;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:8;stroke-dasharray:none;stroke-opacity:1"
id="path176" /></g><path
d="m 543.5989,265.8866 -16.202,-13.1273 3.0251,-3.7336 -25.7713,-8.5115 13.671,23.446 3.0251,-3.7336 16.202,13.1273 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path178" /><path
d="M 637.25,273 V 259.0898 H 642 L 632.5,234 623,259.0898 h 4.75 V 273 Z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path180" /><path
d="m 729.2845,272.8375 15.5861,-12.7986 3.0495,3.7137 13.517,-23.5351 -25.715,8.6803 3.0495,3.7137 -15.5861,12.7986 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path182" /><g
id="g184"
transform="translate(456.0262,-26)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text188"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan186">切分输入</tspan></text></g><path
d="m 512.5196,152.6016 14.7431,-14.7469 3.3983,3.3974 11.1488,-24.745 -24.742,11.1553 3.3983,3.3974 -14.7431,14.747 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path190" /><path
d="M 636.25,154 V 141.0899 H 641 L 631.5,116 622,141.0899 h 4.75 V 154 Z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path192" /><path
d="m 759.1565,146.595 -13.9554,-14.5595 3.4691,-3.3251 -24.5018,-11.6736 10.6255,24.9742 3.4691,-3.3252 13.9554,14.5594 z"
style="fill:#4472c4;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="path194" /><g
id="g196"
transform="translate(454.8528,-223)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text200"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan198">合并输出</tspan></text></g><g
id="g202"
transform="translate(500.6803,-293)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:20px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text206"><tspan
x="0"
y="0"
id="tspan204">（</tspan></text></g><g
id="g208"
transform="translate(520.6803,-293)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:20px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text212"><tspan
x="0"
y="0"
id="tspan210">b</tspan></text></g><g
id="g214"
transform="translate(530.6803,-293)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:20px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text218"><tspan
x="0"
y="0"
id="tspan216">）</tspan></text></g><g
id="g220"
transform="translate(550.6803,-293)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:20px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text224"><tspan
x="0 20 40 60 80 100 120 140"
y="0"
sodipodi:role="line"
id="tspan222">分布式多节点执⾏</tspan></text></g><g
id="g226"
transform="translate(269.4391,-117)"><text
transform="matrix(1,0,0,-1,0,310)"
style="font-variant:normal;font-weight:normal;font-size:18px;font-family:STSongti-TC;-inkscape-font-specification:STSongti-TC-Regular;writing-mode:lr-tb;fill:#000000;fill-opacity:1;fill-rule:nonzero;stroke:none"
id="text230"><tspan
x="0 18 36 54"
y="0"
sodipodi:role="line"
id="tspan228">并⾏计算</tspan></text></g></g></g></svg>
Side by Side

After

Width:  |  Height:  |  Size: 20 KiB