Semi-supervised GRU

Semi-supervised GRU applies the Gated Recurrent Unit architecture to settings where only a small fraction of sequential data is labeled. By first pre-training or jointly training on abundant unlabeled sequences — through language modeling, auto-encoding, or consistency regularization — and then fine-tuning on labeled examples, the model exploits the full corpus to learn richer sequence representations than supervised-only training would allow.