Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In this step, we create our first model. You can either use promptranker to help you find the best labels and hypotheses or skip this step with your preferred setting.

...

Info

As a brief reminder, when defining the text classification task, we need to associate a label text (the label description) with the label name (the actual label) that we are intending to categorise. This label text, also referred sometimes as hypothesis or prompt, provides a semantic context to the model. 

...

Expand
titleIf you want to continue using Promptranker:
Panel
panelIconId1f4bb
panelIcon:computer:
panelIconText💻
bgColor#FFF0B3

API Docs: https://api.symanto.net/active-learning/docs#/v2/rank_label_texts_v2_datasets_rank_label_text_post

Info

This will run an unsupervised statistical Bayesian process that will end up outputting a reliability score of the best combination from the provided ones. It is recommended to use that combination for your model, both at zero and few-shot level.

  1. Enable ‘Rank label texts’

  2. Provide label names, e.g.

    Status
    titlepositive
    ,
    Status
    titlenegative

    1. For each label name, provide a list of alternative descriptions. For example, for positive, you can provide

      Status
      titlegreat
      Status
      titlewonderful
      Status
      titlepositive
      and for negative,
      Status
      titlebad
      Status
      titleterrible
      Status
      titlenegative

  3. Provide hypothesis variations, e.g. use an empty one and add several different variations such as

    Status
    titleThis TExt is {}
    ,
    Status
    titleThe author expresses a {} sentiment
    , …

The result is a table where each variation is ranked according to a calculated score. The higher the score, the more likely the given labels and hypothesis yield good results in a real scenario.

4. Click Create and the model will be automatically created with the prompts (labels and hypothesis) that scored the top.

...