Search

Automated Verification of Neural Network-Based Image Classifier for Stability Assurance in Graphics Rendering

ํƒœ๊ทธ
Projects
Python
PyTorch
๐Ÿ‘ฅ Authors
Surya Chand Rayala, Changyong Song
โš™๏ธ Simulation Basis
Material Point Method (MPM)
๐Ÿ” Verification Tool
nnenum, CROWN-IBP
๐Ÿงช Robustness Tested With
FGSM, PGD, Certified Training
6 more properties
โ€ข
Abstract:
โ—ฆ
We propose a lightweight neural network classifier that detects unstable frames in physics-based animation (MPM) simulations. To ensure the reliability of predictions under pixel-level perturbations, we apply formal verification using the nnenum tool. Our model is trained on a custom dataset of successful and failed simulations generated by a differentiable MPM-based morphing framework. We also apply adversarial training methods (FGSM, PGD) and evaluate certified robustness using CROWN-IBP.
โ—ฆ
Dataset: 6000+ frames (Stable/Unstable) extracted from custom morphing simulations
โ—ฆ
Goal: Real-time detection and formal robustness certification of unstable frames in graphics rendering

Results

โ—ฆ
Classification Accuracy:
โ–ช
PGD-trained model achieved 99.88% test accuracy
โ–ช
Regular & FGSM-trained models: 99.25%
โ—ฆ
Robustness Verification (nnenum):
โ–ช
No models passed global verification at even small perturbation (ฯต = 0.02)
โ–ช
PGD-trained model showed localized certifiable robustness on high-confidence samples (up to ฯต = 0.07)
โ—ฆ
Model Size:
โ–ช
CNN2 achieved state-of-the-art performance with <1M parameters, making it verifiable and efficient
โ—ฆ
Dataset:
โ–ช
3694 stable frames / 2308 unstable frames
โ–ช
Generated from custom differentiable MPM morphing simulations