ShapeNet/ShapeNetCore
Updated β’ 14k β’ 276
DGCNN encoders pretrained with CluRender on ShapeNetCore, from Unsupervised Point Cloud Representation Learning by Clustering and Neural Rendering (IJCV 2024). Code: github.com/gfmei/clurender.
| Folder | Clustering | Rendering target | Decoder | Epochs | ModelNet40 SVM |
|---|---|---|---|---|---|
dgcnn-rgb-ep100 |
yes | RGB views | point-transformer U-Net | 100 | 91.1 |
dgcnn-dino-ep100 |
yes | DINOv2 feature maps | per-point MLP | 100 | 91.7 |
Each folder holds backbone.pth, the encoder state dict, and config.json, the
main_pretrain.py settings (checkpoint_epoch is the epoch of the released weights).
ModelNet40 SVM: a linear SVM (C = 0.002) on frozen global features of 1024 points, each
feature standardized with the mean and standard deviation of the training split, fitted on
the official training split and scored on the test split
(main_svm.py --standardize --c 0.002); overall accuracy in percent.
import torch
from huggingface_hub import hf_hub_download
from models.dgcnn import DGCNN # from the CluRender repository
path = hf_hub_download("RyanMei/clurender", "dgcnn-dino-ep100/backbone.pth")
encoder = DGCNN(emb_dims=1024, k=20, num_cls=-1)
encoder.load_state_dict(torch.load(path, map_location="cpu"))
global_features, point_features = encoder(points) # points: B x 3 x N
The downstream scripts of the repository take the downloaded file as --pretrained.
prepare_shapenet.py. These renderings differ from the ones used in the paper, so the
scores differ from the paper's.resumed_at_epoch_57_with in config.json).extract_dinov2.py).@article{mei2024clurender,
title = {Unsupervised Point Cloud Representation Learning by Clustering and Neural Rendering},
author = {Mei, Guofeng and Saltori, Cristiano and Ricci, Elisa and Sebe, Nicu and
Wu, Qiang and Zhang, Jian and Poiesi, Fabio},
journal = {International Journal of Computer Vision},
volume = {132},
number = {8},
pages = {3251--3269},
year = {2024},
doi = {10.1007/s11263-024-02027-5}
}