Code - VQ-VAE (Vector Quantised Variational AutoEncoder) 的实现源码

欢迎关注我的CSDN：https://spike.blog.csdn.net/
本文地址：https://spike.blog.csdn.net/article/details/135936848

VQ-VAE，即Vector Quantized Variational AutoEncoder，向量量化变分自编码器。VQ-VAE 的创新之处是引入了一个向量量化（VQ）层，将连续的编码器输出映射到离散的潜在空间。VQ层由一组可学习的向量组成，称为代码本（Codebook）。每个编码向量都会被替换为代码本中与最近的向量，从而实现量化。这样，VQ-VAE 可以把图片编码成离散向量。

VQ-VAE 的优点是可以生成高质量的数据，并且在数据表示上引入离散性。离散性有利于捕捉一些自然界的模态，如语言、推理、规划等。而且，离散向量也更容易被其他模型处理。VQ-VAE 的训练过程包括三个部分：编码器、解码器和代码本。编码器和解码器的训练目标是最小化重建误差，即让原始图片和重建图片尽可能相似。代码本的训练目标是最小化代码本损失，即让代码本中的向量向各自最近的编码向量靠近。此外，还有一个承诺损失（Commitment Loss），用来训练编码器，防止编码向量频繁在各个代码本向量之间跳动。

论文：Neural Discrete Representation Learning，神经离散表示学习，NIPS 2017

  • Paper - Neural Discrete Representation Learning (VQ-VAE) 论文简读

判断 GPU 或 CPU 环境：

device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
print(f"[Info] device: {device}")

CIFAR10 数据集：

training_data = datasets.CIFAR10(root="data", train=True, download=True,
                                 transform=transforms.Compose([
                                      transforms.ToTensor(),
                                      transforms.Normalize((0.5,0.5,0.5), (1.0,1.0,1.0))
                                 ]))

validation_data = datasets.CIFAR10(root="data", train=False, download=True,
                                   transform=transforms.Compose([
                                      transforms.ToTensor(),
                                      transforms.Normalize((0.5,0.5,0.5), (1.0,1.0,1.0))
                                   ]))

训练数据的方差var：

data_variance = np.var(training_data.data / 255.0)
print(f"[Info] data_variance: {data_variance}")
# recon_error = F.mse_loss(data_recon, data) / data_variance, 用于图像重构loss的缩放

Loss:

The total loss is actually composed of three components

  1. reconstruction loss: which optimizes the decoder and encoder
  2. codebook loss: due to the fact that gradients bypass the embedding, we use a dictionary learning algorithm which uses an l 2 l_{2} l2​ error to move the embedding vectors e i e_{i} ei​ towards the encoder output
  3. commitment loss: since the volume of the embedding space is dimensionless, it can grow arbirtarily if the embeddings e i e_{i} ei​ do not train as fast as the encoder parameters, and thus we add a commitment loss to make sure that the encoder commits to an embedding

Loss:
Loss

sg = stop gradient

Codebook Loss 初始化是均匀分布 (Uniform)：

self._embedding.weight.data.uniform_(-1/self._num_embeddings, 1/self._num_embeddings)

距离计算欧式距离：

# Flatten input, 转换成二维张量
flat_input = inputs.view(-1, self._embedding_dim)

# Calculate distances, 欧式距离，或者是，余弦距离
distances = (torch.sum(flat_input**2, dim=1, keepdim=True) 
            + torch.sum(self._embedding.weight**2, dim=1)
            - 2 * torch.matmul(flat_input, self._embedding.weight.t()))

转换成 One-Hot 格式：

encoding_indices = torch.argmin(distances, dim=1).unsqueeze(1)  # 最小索引
encodings = torch.zeros(encoding_indices.shape[0], self._num_embeddings, device=inputs.device)
encodings.scatter_(1, encoding_indices, 1)  # 转换成 one-hot 形式

Codebook(self._embedding.weight) 与 One-Hot(encodings) 相乘，获得量化特征：

quantized = torch.matmul(encodings, self._embedding.weight).view(input_shape)

Latent特征，e_latent_loss 更新 inputs，即 encoder 网络，q_latent_loss 更新 Codebook (self._embedding)，即

  • detach() 即 stop gradient 操作
# Loss
e_latent_loss = F.mse_loss(quantized.detach(), inputs)  # commitment loss
q_latent_loss = F.mse_loss(quantized, inputs.detach())  # detach = stop gradient
loss = q_latent_loss + self._commitment_cost * e_latent_loss

梯度复制：

# 梯度复制的技巧, quantized的梯度与inputs的梯度连接
quantized = inputs + (quantized - inputs).detach()  # trick 通过常数, 让编码器和解码器连续, 可导

困惑度计算：

# 困惑度, 即信息熵, 检测指标, 困惑度越大, 信息熵越高, 表明训练越充分
avg_probs = torch.mean(encodings, dim=0)
perplexity = torch.exp(-torch.sum(avg_probs * torch.log(avg_probs + 1e-10)))

Encoder 的输出维度是 num_hiddens，128维，调用 _pre_vq_conv (Conv2d)，升维操作，至 embedding_dim，64维，即：

def forward(self, x):
    # print(f"[Info] x: {x.shape}")
    z = self._encoder(x)
    # print(f"[Info] z: {z.shape}")
    z = self._pre_vq_conv(z)  # 需改维度
    # print(f"[Info] z: {z.shape}")
    loss, quantized, perplexity, _ = self._vq_vae(z)
    # print(f"[Info] quantized: {quantized.shape}")
    x_recon = self._decoder(quantized)
    # print(f"[Info] x_recon: {x_recon.shape}")

    return loss, x_recon, perplexity

特征维度，z是inputs，需要与quantized的维度相等，即：

[Info] x: torch.Size([256, 3, 32, 32])
[Info] z: torch.Size([256, 128, 8, 8])
[Info] z: torch.Size([256, 64, 8, 8])
[Info] quantized: torch.Size([256, 64, 8, 8])
[Info] x_recon: torch.Size([256, 3, 32, 32])

EMA 更新技巧：

if self.training:
    self._ema_cluster_size = self._ema_cluster_size * self._decay + \
                             (1 - self._decay) * torch.sum(encodings, 0)

    # Laplace smoothing of the cluster size
    n = torch.sum(self._ema_cluster_size.data)
    self._ema_cluster_size = (
        (self._ema_cluster_size + self._epsilon)
        / (n + self._num_embeddings * self._epsilon) * n)

    dw = torch.matmul(encodings.t(), flat_input)
    self._ema_w = nn.Parameter(self._ema_w * self._decay + (1 - self._decay) * dw)

    self._embedding.weight = nn.Parameter(self._ema_w / self._ema_cluster_size.unsqueeze(1))

随着训练的提升，Perplexity逐渐提升，从1提升至423.421，即15000 iterations

Loss平滑：

train_res_recon_error_smooth = savgol_filter(train_res_recon_error, 201, 7)
train_res_perplexity_smooth = savgol_filter(train_res_perplexity, 201, 7)

Loss

使用 UMap 观察 Codebook 的分布：

import umap.umap_ as umap
proj = umap.UMAP(n_neighbors=3,
                 min_dist=0.1,
                 metric='cosine').fit_transform(model._vq_vae._embedding.weight.data.cpu())
plt.scatter(proj[:,0], proj[:,1], alpha=0.3)

Cookbook

完整源码：

#!/usr/bin/env python
# -- coding: utf-8 --
"""
Copyright (c) 2024. All rights reserved.
Created by C. L. Wang on 2024/1/30
"""


from __future__ import print_function

import os

import matplotlib.pyplot as plt
import numpy as np
import torch
import torch.nn as nn
import torch.nn.functional as F
import torch.optim as optim
import torchvision.datasets as datasets
import torchvision.transforms as transforms
import umap.umap_ as umap
from scipy.signal import savgol_filter
from six.moves import xrange
from torch.utils.data import DataLoader
from torchvision.utils import make_grid

# --------------- 数据部分 --------------- #
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
print(f"[Info] device: {device}")
training_data = datasets.CIFAR10(root="data", train=True, download=True,
                                 transform=transforms.Compose([
                                      transforms.ToTensor(),
                                      transforms.Normalize((0.5,0.5,0.5), (1.0,1.0,1.0))
                                  ]))
validation_data = datasets.CIFAR10(root="data", train=False, download=True,
                                   transform=transforms.Compose([
                                      transforms.ToTensor(),
                                      transforms.Normalize((0.5,0.5,0.5), (1.0,1.0,1.0))
                                   ]))
data_variance = np.var(training_data.data / 255.0)
print(f"[Info] data_variance: {data_variance}")
# --------------- 数据部分 --------------- #


class VectorQuantizer(nn.Module):
    def __init__(self, num_embeddings, embedding_dim, commitment_cost):
        super(VectorQuantizer, self).__init__()

        self._embedding_dim = embedding_dim
        self._num_embeddings = num_embeddings

        self._embedding = nn.Embedding(self._num_embeddings, self._embedding_dim)
        # 均匀分布
        self._embedding.weight.data.uniform_(-1 / self._num_embeddings, 1 / self._num_embeddings)
        self._commitment_cost = commitment_cost

    def forward(self, inputs):
        # convert inputs from BCHW -> BHWC
        # 通道维度转换为最后1维
        inputs = inputs.permute(0, 2, 3, 1).contiguous()
        input_shape = inputs.shape

        # Flatten input, 转换成二维张量
        flat_input = inputs.view(-1, self._embedding_dim)

        # Calculate distances, 欧式距离，或者是，余弦距离
        distances = (torch.sum(flat_input ** 2, dim=1, keepdim=True)
                     + torch.sum(self._embedding.weight ** 2, dim=1)
                     - 2 * torch.matmul(flat_input, self._embedding.weight.t()))

        # Encoding
        encoding_indices = torch.argmin(distances, dim=1).unsqueeze(1)  # 最近邻索引
        encodings = torch.zeros(encoding_indices.shape[0], self._num_embeddings, device=inputs.device)
        encodings.scatter_(1, encoding_indices, 1)  # 转换成 one-hot 形式

        # Quantize and unflatten, 矩阵相乘，获得 embedding vector
        quantized = torch.matmul(encodings, self._embedding.weight).view(input_shape)

        # Loss
        e_latent_loss = F.mse_loss(quantized.detach(), inputs)  # commitment loss
        q_latent_loss = F.mse_loss(quantized, inputs.detach())  # detach = stop gradient
        loss = q_latent_loss + self._commitment_cost * e_latent_loss

        # 梯度复制的技巧
        quantized = inputs + (quantized - inputs).detach()  # trick 通过常数, 让编码器和解码器连续, 可导

        # 困惑度, 即信息熵, 检测指标, 困惑度越大, 信息熵越高, 表明训练越充分
        avg_probs = torch.mean(encodings, dim=0)
        perplexity = torch.exp(-torch.sum(avg_probs * torch.log(avg_probs + 1e-10)))

        # convert quantized from BHWC -> BCHW
        return loss, quantized.permute(0, 3, 1, 2).contiguous(), perplexity, encodings


class Residual(nn.Module):
    def __init__(self, in_channels, num_hiddens, num_residual_hiddens):
        super(Residual, self).__init__()
        self._block = nn.Sequential(
            nn.ReLU(True),
            nn.Conv2d(in_channels=in_channels,
                      out_channels=num_residual_hiddens,
                      kernel_size=3, stride=1, padding=1, bias=False),
            nn.ReLU(True),
            nn.Conv2d(in_channels=num_residual_hiddens,
                      out_channels=num_hiddens,
                      kernel_size=1, stride=1, bias=False)
        )

    def forward(self, x):
        return x + self._block(x)


class ResidualStack(nn.Module):
    def __init__(self, in_channels, num_hiddens, num_residual_layers, num_residual_hiddens):
        super(ResidualStack, self).__init__()
        self._num_residual_layers = num_residual_layers
        self._layers = nn.ModuleList([Residual(in_channels, num_hiddens, num_residual_hiddens)
                                      for _ in range(self._num_residual_layers)])

    def forward(self, x):
        for i in range(self._num_residual_layers):
            x = self._layers[i](x)
        return F.relu(x)


class Encoder(nn.Module):
    def __init__(self, in_channels, num_hiddens, num_residual_layers, num_residual_hiddens):
        super(Encoder, self).__init__()

        self._conv_1 = nn.Conv2d(in_channels=in_channels,
                                 out_channels=num_hiddens // 2,
                                 kernel_size=4,
                                 stride=2, padding=1)
        self._conv_2 = nn.Conv2d(in_channels=num_hiddens // 2,
                                 out_channels=num_hiddens,
                                 kernel_size=4,
                                 stride=2, padding=1)
        self._conv_3 = nn.Conv2d(in_channels=num_hiddens,
                                 out_channels=num_hiddens,
                                 kernel_size=3,
                                 stride=1, padding=1)
        self._residual_stack = ResidualStack(in_channels=num_hiddens,
                                             num_hiddens=num_hiddens,
                                             num_residual_layers=num_residual_layers,
                                             num_residual_hiddens=num_residual_hiddens)

    def forward(self, inputs):
        x = self._conv_1(inputs)
        x = F.relu(x)

        x = self._conv_2(x)
        x = F.relu(x)

        x = self._conv_3(x)
        return self._residual_stack(x)


class Decoder(nn.Module):
    def __init__(self, in_channels, num_hiddens, num_residual_layers, num_residual_hiddens):
        super(Decoder, self).__init__()
        # 预处理层
        self._conv_1 = nn.Conv2d(in_channels=in_channels,
                                 out_channels=num_hiddens,
                                 kernel_size=3,
                                 stride=1, padding=1)
        # 信息提取
        self._residual_stack = ResidualStack(in_channels=num_hiddens,
                                             num_hiddens=num_hiddens,
                                             num_residual_layers=num_residual_layers,
                                             num_residual_hiddens=num_residual_hiddens)
        # 反卷积
        self._conv_trans_1 = nn.ConvTranspose2d(in_channels=num_hiddens,
                                                out_channels=num_hiddens // 2,
                                                kernel_size=4,
                                                stride=2, padding=1)
        # 反卷积
        self._conv_trans_2 = nn.ConvTranspose2d(in_channels=num_hiddens // 2,
                                                out_channels=3,
                                                kernel_size=4,
                                                stride=2, padding=1)

    def forward(self, inputs):
        x = self._conv_1(inputs)

        x = self._residual_stack(x)

        x = self._conv_trans_1(x)
        x = F.relu(x)

        return self._conv_trans_2(x)


class VectorQuantizerEMA(nn.Module):
    def __init__(self, num_embeddings, embedding_dim, commitment_cost, decay, epsilon=1e-5):
        super(VectorQuantizerEMA, self).__init__()

        self._embedding_dim = embedding_dim
        self._num_embeddings = num_embeddings

        self._embedding = nn.Embedding(self._num_embeddings, self._embedding_dim)
        self._embedding.weight.data.normal_()
        self._commitment_cost = commitment_cost

        self.register_buffer('_ema_cluster_size', torch.zeros(num_embeddings))
        self._ema_w = nn.Parameter(torch.Tensor(num_embeddings, self._embedding_dim))
        self._ema_w.data.normal_()

        self._decay = decay
        self._epsilon = epsilon

    def forward(self, inputs):
        # convert inputs from BCHW -> BHWC
        inputs = inputs.permute(0, 2, 3, 1).contiguous()
        input_shape = inputs.shape

        # Flatten input
        flat_input = inputs.view(-1, self._embedding_dim)

        # Calculate distances
        distances = (torch.sum(flat_input ** 2, dim=1, keepdim=True)
                     + torch.sum(self._embedding.weight ** 2, dim=1)
                     - 2 * torch.matmul(flat_input, self._embedding.weight.t()))

        # Encoding
        encoding_indices = torch.argmin(distances, dim=1).unsqueeze(1)
        encodings = torch.zeros(encoding_indices.shape[0], self._num_embeddings, device=inputs.device)
        encodings.scatter_(1, encoding_indices, 1)

        # Quantize and unflatten
        quantized = torch.matmul(encodings, self._embedding.weight).view(input_shape)

        # Use EMA to update the embedding vectors
        if self.training:
            self._ema_cluster_size = self._ema_cluster_size * self._decay + \
                                     (1 - self._decay) * torch.sum(encodings, 0)

            # Laplace smoothing of the cluster size
            n = torch.sum(self._ema_cluster_size.data)
            self._ema_cluster_size = (
                (self._ema_cluster_size + self._epsilon)
                / (n + self._num_embeddings * self._epsilon) * n)

            dw = torch.matmul(encodings.t(), flat_input)
            self._ema_w = nn.Parameter(self._ema_w * self._decay + (1 - self._decay) * dw)

            self._embedding.weight = nn.Parameter(self._ema_w / self._ema_cluster_size.unsqueeze(1))

        # Loss
        e_latent_loss = F.mse_loss(quantized.detach(), inputs)
        loss = self._commitment_cost * e_latent_loss

        # Straight Through Estimator
        quantized = inputs + (quantized - inputs).detach()
        avg_probs = torch.mean(encodings, dim=0)
        perplexity = torch.exp(-torch.sum(avg_probs * torch.log(avg_probs + 1e-10)))

        # convert quantized from BHWC -> BCHW
        return loss, quantized.permute(0, 3, 1, 2).contiguous(), perplexity, encodings


# --------------- 参数部分 --------------- #
batch_size = 256
num_training_updates = 15000
num_hiddens = 128
num_residual_hiddens = 32
num_residual_layers = 2
embedding_dim = 64
num_embeddings = 512
commitment_cost = 0.25
decay = 0.99
learning_rate = 1e-3
# --------------- 参数部分 --------------- #

training_loader = DataLoader(training_data,
                             batch_size=batch_size,
                             shuffle=True,
                             pin_memory=True)
validation_loader = DataLoader(validation_data,
                               batch_size=32,
                               shuffle=True,
                               pin_memory=True)


# --------------- 模型部分 --------------- #
class Model(nn.Module):
    def __init__(self, num_hiddens, num_residual_layers, num_residual_hiddens,
                 num_embeddings, embedding_dim, commitment_cost, decay=0.0):
        super(Model, self).__init__()

        self._encoder = Encoder(3, num_hiddens,
                                num_residual_layers,
                                num_residual_hiddens)
        self._pre_vq_conv = nn.Conv2d(in_channels=num_hiddens,
                                      out_channels=embedding_dim,
                                      kernel_size=1,
                                      stride=1)
        if decay > 0.0:
            self._vq_vae = VectorQuantizerEMA(num_embeddings, embedding_dim,
                                              commitment_cost, decay)
        else:
            self._vq_vae = VectorQuantizer(num_embeddings, embedding_dim,
                                           commitment_cost)
        self._decoder = Decoder(embedding_dim,
                                num_hiddens,
                                num_residual_layers,
                                num_residual_hiddens)

    def forward(self, x):
        # print(f"[Info] x: {x.shape}")
        z = self._encoder(x)
        # print(f"[Info] z: {z.shape}")
        z = self._pre_vq_conv(z)  # 需改维度
        # print(f"[Info] z: {z.shape}")
        loss, quantized, perplexity, _ = self._vq_vae(z)
        # print(f"[Info] quantized: {quantized.shape}")
        x_recon = self._decoder(quantized)
        # print(f"[Info] x_recon: {x_recon.shape}")

        return loss, x_recon, perplexity


model = Model(num_hiddens, num_residual_layers, num_residual_hiddens,
              num_embeddings, embedding_dim,
              commitment_cost, decay).to(device)
# --------------- 模型部分 --------------- #


# --------------- 模型训练 --------------- #
model_path = "model.ckpt"

if not os.path.exists(model_path):
    model.train()
    train_res_recon_error = []
    train_res_perplexity = []
    optimizer = optim.Adam(model.parameters(), lr=learning_rate, amsgrad=False)

    for i in xrange(num_training_updates):
        (data, _) = next(iter(training_loader))
        data = data.to(device)
        optimizer.zero_grad()

        vq_loss, data_recon, perplexity = model(data)
        recon_error = F.mse_loss(data_recon, data) / data_variance  # 重构 Loss 需要除以方差
        loss = recon_error + vq_loss
        loss.backward()

        optimizer.step()

        train_res_recon_error.append(recon_error.item())
        train_res_perplexity.append(perplexity.item())

        if (i + 1) % 100 == 0:
            print('%d iterations' % (i + 1))
            print('recon_error: %.3f' % np.mean(train_res_recon_error[-100:]))
            print('perplexity: %.3f' % np.mean(train_res_perplexity[-100:]))
            print()

    torch.save(model.state_dict(), model_path)

    train_res_recon_error_smooth = savgol_filter(train_res_recon_error, 201, 7)
    train_res_perplexity_smooth = savgol_filter(train_res_perplexity, 201, 7)

    f = plt.figure(figsize=(16, 8))
    ax = f.add_subplot(1, 2, 1)
    ax.plot(train_res_recon_error_smooth)
    ax.set_yscale('log')
    ax.set_title('Smoothed NMSE.')
    ax.set_xlabel('iteration')

    ax = f.add_subplot(1, 2, 2)
    ax.plot(train_res_perplexity_smooth)
    ax.set_title('Smoothed Average codebook usage (perplexity).')
    ax.set_xlabel('iteration')

else:
    model.load_state_dict(torch.load(model_path))
# --------------- 模型训练 --------------- #


# --------------- 重构效果 --------------- #
model.eval()

(valid_originals, _) = next(iter(validation_loader))
valid_originals = valid_originals.to(device)

vq_output_eval = model._pre_vq_conv(model._encoder(valid_originals))
_, valid_quantize, _, _ = model._vq_vae(vq_output_eval)
valid_reconstructions = model._decoder(valid_quantize)

(train_originals, _) = next(iter(training_loader))
train_originals = train_originals.to(device)

_, train_reconstructions, _, _ = model._vq_vae(train_originals)


def show(img):
    npimg = img.numpy()
    fig = plt.imshow(np.transpose(npimg, (1,2,0)), interpolation='nearest')
    fig.axes.get_xaxis().set_visible(False)
    fig.axes.get_yaxis().set_visible(False)


show(make_grid(valid_reconstructions.cpu().data)+0.5, )
show(make_grid(valid_originals.cpu()+0.5))
# --------------- 重构效果 --------------- #


# --------------- Codebook 效果 --------------- #
proj = umap.UMAP(n_neighbors=3,
                 min_dist=0.1,
                 metric='cosine').fit_transform(model._vq_vae._embedding.weight.data.cpu())
plt.scatter(proj[:,0], proj[:,1], alpha=0.3)
# --------------- Codebook 效果 --------------- #

参考：

  • 源码：vq-vae
  • CSDN - 详解VQVAE：Neural Discrete Representation Learning
  • CSDN - scipy.signal.savgol_filter
  • PyTorch - saving_loading_models
  • StackOverflow - module ‘umap’ has no attribute ‘UMAP’

本文来自互联网用户投稿，该文观点仅代表作者本人，不代表本站立场。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如若转载，请注明出处：/a/360892.html

如若内容造成侵权/违法违规/事实不符，请联系我们进行投诉反馈qq邮箱809451989@qq.com，一经查实，立即删除！

相关文章

ArcGIS学习（二）属性表的基本操作

ArcGIS学习（二）属性表的基本操作

ArcGIS学习（二）属性表的基本操作 1.查看属性表 ArcGIS是处理空间数据的平台。对于空间数据，大家可以理解成它是由两个部分构成：1.一个是空间形体，也就是点、线、面三种。线又可以分为直线、曲线，面又分为圆形、正方形、不规则形体等；2.另外一个部分是空间形体所附带的…
阅读更多...
Unix/Linux上的五种IO模型

Unix/Linux上的五种IO模型

a.阻塞 blocking 调用者调用了某个函数，等待这个函数返回，期间什么也不做，不停的去检查这个函数有没有返回，必须等这个函数返回才能进行下一步动作。 注意：阻塞并不是函数的行为，而是跟文件描述符有关。通…
阅读更多...
离谱题 3236：练39.1 书香阁座位

离谱题 3236：练39.1 书香阁座位

3236正常写法 #include<bits/stdc.h> using namespace std; int main() {int sum,a,b;a1;b10;sumb;cout<<a<<" "<<b;cout<<" "<<sum<<endl;do{a;b2;sumx;cout<<a<<" "<<b<<&…
阅读更多...
uniapp本地存储日志

uniapp本地存储日志

uniapp本地存储日志 背景实现代码实现使用查看生成log读取 注意事项尾巴 背景 我们的APP开发完成之后&#xff0c;在我们测试环境或者自测的时候都好好的&#xff0c;但是发布到生产环境客户使用总会出现一些奇奇怪怪的问题。这时候因为没在开发环境&#xff0c;我们无法查看到…
阅读更多...
力扣hot100 买卖股票的最佳时机 贪心 经典题

力扣hot100 买卖股票的最佳时机 贪心 经典题

Problem: 121. 买卖股票的最佳时机 文章目录 思路复杂度Code 思路 假设今天卖出&#xff0c;那怎么样收益最大呢&#xff1f;之前买入价是最低的 复杂度 ⏰ 时间复杂度: &#xff1a; O ( n ) O(n) O(n) &#x1f30e; 空间复杂度: O ( 1 ) O(1) O(1) Code class Solut…
阅读更多...
c++之IO流

c++之IO流

1.C语言的输入与输出 C语言中我们用到的最频繁的输入输出方式就是scanf ()与printf()。 scanf(): 从标准输入设备(键 盘)读取数据&#xff0c;并将值存放在变量中。printf(): 将指定的文字/字符串输出到标准输出设备(屏幕)。 注意宽度输出和精度输出控制。C语言借助了相应的缓…
阅读更多...
tsmc12: m0po max length问题（H384.M0_PO.L.1）

tsmc12: m0po max length问题（H384.M0_PO.L.1）

更多学习内容请关注「拾陆楼」知识星球 拾陆楼知识星球入口 在pt eco之后会有一些m0po max length问题出现，大部分问题都可以通过替换decap来解决，少部分由于局部density过高，需要手动调整。
阅读更多...
2023强网杯复现

2023强网杯复现

强网先锋 SpeedUp 要求2的27次方的阶乘的逐位之和 在A244060 - OEIS 然后我们将4495662081进行sha256加密 就得到了flag flag{bbdee5c548fddfc76617c562952a3a3b03d423985c095521a8661d248fad3797} MISC easyfuzz 通过尝试输入字符串判断该程序对输入字符的验证规则为9…
阅读更多...
【C++】类和对象之构造函数、析构函数、拷贝构造函数(二)

【C++】类和对象之构造函数、析构函数、拷贝构造函数(二)

前言&#xff1a;在上一篇我们对于C中类和对象有了一个初步的了解&#xff0c;今天我们将进一步的学习&#xff0c;今天我们目标是对构造函数、析构函数、拷贝构造函数进行一个初步学习在后面也会进一步的学习&#xff0c;一起加油呐&#xff01; &#x1f496; 博主CSDN主页:卫…
阅读更多...
代码随想录 Leetcode669. 修剪二叉搜索树

代码随想录 Leetcode669. 修剪二叉搜索树

题目&#xff1a; 代码(首刷看解析 2024年1月31日&#xff09;&#xff1a; class Solution { public:TreeNode* trimBST(TreeNode* root, int low, int high) {if (!root) return root;if (root->val < low) {TreeNode* node trimBST(root->right,low,high);return…
阅读更多...
Flutter canvas 画一条波浪线 进度条

Flutter canvas 画一条波浪线 进度条

之前用 Flutter Canvas 画过一个三角三角形&#xff0c;html 的 Canvas 也画过一次类似的&#xff0c; 今天用 Flutter Canvas 试了下 感觉差不多&#xff1a; html 版本 大致效果如下&#xff1a; 思路和 html 实现的类似&#xff1a; 也就是找出点的位置&#xff0c;使用二阶…
阅读更多...
山东第四次文物普查启动，全面开展不可移动文物预防性保护

山东第四次文物普查启动，全面开展不可移动文物预防性保护

一、山东进行全面普查不可移动文物资源 近日&#xff0c;山东省政府下发了《关于做好第四次全国文物普查工作通知》&#xff0c;根据调查充分摸清山东不可移动文物资源状况。这是我国时隔16年再次启动文物普查&#xff0c;也是“十四五”期内最大的文物保护行动&#xff0c;以…
阅读更多...
Memcached缓存服务器

Memcached缓存服务器

目录 简介 NoSQL的优点和缺点 下面扩展一下关系型数据库和非关系型数据库的区别 Memcached 特点 原理 配置与安装 Memcached我们直接使用yum安装就可以了 安装后启动 修改配置文件 测试 开发端安装telnet 进行远程连接memcached&#xff0c;端口探测 以下显示为连接…
阅读更多...
香蕉派BPI-M7 瑞芯微RK3588 人工智能开源硬件开发板公开发售

香蕉派BPI-M7 瑞芯微RK3588 人工智能开源硬件开发板公开发售

香蕉派(Banana Pi) BPI-M7瑞芯微K3588开源硬件单板计算机公开销售&#xff0c;支持WiFi 6和BT5.2&#xff0c;硬件有3个版本:8G Ram64G eMMC, 16G Ram128 eMMC和32G Ram128 eMMC 香蕉派BPI-M7采用睿芯最新旗舰RK3588八核64位处理器&#xff0c;最高频率为2.4GHz, 6 TOPS NPU&…
阅读更多...
106.乐理基础-五线谱-八度记号

106.乐理基础-五线谱-八度记号

内容参考于&#xff1a;三分钟音乐社 上一个内容&#xff1a;105.乐理基础-五线谱-谱号扩展-CSDN博客 上一个内容里的练习答案&#xff1a; 然后下图红圈位置的音&#xff0c;用高音谱号、低音谱号、中音谱号、次中音谱号&#xff0c;在加三根线的情况下无法表示&#xff0c;…
阅读更多...
uniapp底部栏设置未读红点或角标

uniapp底部栏设置未读红点或角标

pages.json {... // 省略"tabBar": {"color": "#333333","selectedColor": "#3296fa","backgroundColor": "#ffffff","borderStyle": "white","list": [{"pagePat…
阅读更多...
微信开放平台第三方授权(第四篇)-wechat发送客服消息

微信开放平台第三方授权(第四篇)-wechat发送客服消息

1.发送客服消息 上一张介绍了发送消息需要用到的authorizer_access_token,和发送消息的接口结合使用&#xff0c;上面直接上代码。 重写WechatMpService 获取token&#xff0c;这个发消息会用到 package com.test.wechat.service;import com.test.wechat.config.WechatMpConf…
阅读更多...
Roxlabs全球IP代理服务：解锁高效数据采集与网络应用新境界

Roxlabs全球IP代理服务：解锁高效数据采集与网络应用新境界

引言 在这个数字化迅速发展的时代&#xff0c;数据采集和网络应用的重要性显得愈发突出。江苏阿克索网络科技有限公司旗下的Roxlabs&#xff0c;以其卓越的全球IP代理服务&#xff0c;正引领着这一领域的创新和发展。Roxlabs不仅提供遍及200多个国家和地区的高质量动态住宅IP资…
阅读更多...
10个最好的免费数据恢复软件工具分享【合集】

10个最好的免费数据恢复软件工具分享【合集】

数据丢失经常发生。它可能是由于恶意软件、有缺陷的更新或疏忽造成的。无论哪种情况&#xff0c;这都是一个麻烦的事件。 许多人认为不可能恢复已删除的文件。这是一个错误的印象。 从回收站删除的文件很有可能仍然可以恢复。免费的开源数据恢复软件可以在这里为您提供帮助&a…
阅读更多...
Linux下使用信号量实现PV操作

Linux下使用信号量实现PV操作

一.信号量与PV操作概述 在多道程序系统中&#xff0c;由于资源共享与进程合作&#xff0c;使各进程之间可能产生两种形式的制约关系&#xff0c;一种是间接相互制约&#xff0c;例如&#xff0c;在仅有一台打印机的系统&#xff0c;同一时刻只能有一个进程分配到到打印机&…
阅读更多...
最新文章

Copyright @ 2022~2023