hyperparameter clustering GAN
hyperparameter based PyTorch implementation for weights batch.
- Input
- 6975-dim embedding
- Encoder
- 20 x GAN with 64 heads
- Output
- perplexity projection
Training config
optimizer=SGD, lr=0.548, scheduler=exponential, warmup=1259