About Keras Getting started Developer guides Keras 3 API documentation Models API Layers API Callbacks API Ops API Optimizers Metrics Losses Data loading Built-in small datasets Keras Applications Mixed precision Multi-device distribution RNG API Utilities KerasTuner KerasCV KerasNLP Pretrained Models Models API Tokenizers Preprocessing Layers Modeling Layers Samplers Metrics KerasHub Keras 2 API documentation Code examples KerasTuner: Hyperparameter Tuning KerasHub: Pretrained Models KerasCV: Computer Vision Workflows KerasNLP: Natural Language Workflows
► Keras 3 API documentation / KerasNLP / Pretrained Models / RoBERTa

RoBERTa

Models, tokenizers, and preprocessing layers for RoBERTa, as described in "RoBERTa: A Robustly Optimized BERT Pretraining Approach".

For a full list of available presets, see the models page.

RobertaTokenizer

  • RobertaTokenizer class
  • from_preset method

RobertaBackbone model

  • RobertaBackbone class
  • from_preset method
  • token_embedding property

RobertaTextClassifier model

  • RobertaTextClassifier class
  • from_preset method
  • backbone property
  • preprocessor property

RobertaTextClassifierPreprocessor layer

  • RobertaTextClassifierPreprocessor class
  • from_preset method
  • tokenizer property

RobertaMaskedLM model

  • RobertaMaskedLM class
  • from_preset method
  • backbone property
  • preprocessor property

RobertaMaskedLMPreprocessor layer

  • RobertaMaskedLMPreprocessor class
  • from_preset method
  • tokenizer property
RoBERTa
RobertaTokenizer
RobertaBackbone model
RobertaTextClassifier model
RobertaTextClassifierPreprocessor layer
RobertaMaskedLM model
RobertaMaskedLMPreprocessor layer
Terms | Privacy