pytorch:分批训练

92 阅读 0 评论 61 点赞

我是靠谱客的博主疯狂面包，这篇文章主要介绍pytorch:分批训练，现在分享给大家，希望可以做个参考。

复制代码

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
在这里插入代码import torch
import torch.utils.data as Data#批处理模块

torch.manual_seed(1)    # reproducible

BATCH_SIZE = 5#每小批5个
# BATCH_SIZE = 8

x = torch.linspace(1, 10, 10)       # this is x data (torch tensor)
y = torch.linspace(10, 1, 10)       # this is y data (torch tensor)

torch_dataset = Data.TensorDataset(x, y)
loader = Data.DataLoader(#使训练分批
    dataset=torch_dataset,      # torch TensorDataset format
    batch_size=BATCH_SIZE,      # mini batch size
    shuffle=True,               # 训练时随机打乱数据再抽样
    num_workers=2,              # subprocesses for loading data
)


def show_batch():
    for epoch in range(3):   # 训练整个数据集三次（每次都是拆分成小组训练）
        for step, (batch_x, batch_y) in enumerate(loader):  # for each training step
            # train your data...
            print('Epoch: ', epoch, '| Step: ', step, '| batch x: ',
                  batch_x.numpy(), '| batch y: ', batch_y.numpy())


if __name__ == '__main__':
    show_batch()片