| beastMode | The output object of the Ask for Beast Mode Payload service. It contains the following parameters: - isCustomerModel - modelId - prompt | | | | | | | | | | | | | | | | | | | | | |
| chatContext | A list of historical messages between the AI and the user to be considered in the current request. | | | | | | | | | | | | | | | | | | | | | |
| choices | A list of the outputs that the service creates. | | | | | | | | | | | | | | | | | | | | | |
| chunkingConfiguration | With large documents, not all text can be included in every request because the document may be too long to fit in the context window. The chunking configuration helps guide how we split our document into smaller parts or chunks. | | | | --- | --- | | chunkOverlap | Text can be overlapped to help give context to how the chunks in a document are grouped. An integer value defines the size of the overlap between successive chunks. | | disallowIntermediateChunks | Sometimes when trying to summarize very long texts, chunks are summarized and put together only to find that the text is still too long. In these cases, you would get summaries of the summaries unless disallowIntermediateChunks is set to false. | | maxChunkSize | An integer value that specifies the maximum size for a chunk | | separators | A list of String values that is used to separate chunks in order of most to least desired. For example: [“\n\n”, “\n”, ”.”, ""] separates double new lines first (within the max chunk size) followed by a single new line, then a period, followed by any character. | | separatorType | Out of the box separator types. The default is Text and includes HTML, JavaScript, Python. | |
| dataSet | The ID for the DataSet used in the request. | | | | | | | | | | | | | | | | | | | | | |
| generatedText | | | | | | | | | | | | | | | | | | | | | | |
| isCustomerModel | | | | | | | | | | | | | | | | | | | | | | |
| model | The AI you want to send your request to. Examples: GPT-4, Claude-2.1 | | | | | | | | | | | | | | | | | | | | | |
| modelConfiguration | A map with custom configuration parameters for a selected language model. | | | | | | | | | | | | | | | | | | | | | |
| modelId | | | | | | | | | | | | | | | | | | | | | | |
| outputWordLength — Size Boundary | The desired length of the output text represented as a boundary between min and max length. | | | | | | | | | | | | | | | | | | | | | |
| parameters | | | | | | | | | | | | | | | | | | | | | | |
| prompt | The field for the user to input any instructions that should be included in the prompt needed to run the function. | | | | | | | | | | | | | | | | | | | | | |
| promptTemplate | A text template that supports placeholder variables allowing users to easily organize input to the Large Language Model. Example: Summarize the following text to be no longer than ${max_word_count} words: ${input} | | | | | | | | | | | | | | | | | | | | | |
| SQL | This is the output of the request in SQL. | | | | | | | | | | | | | | | | | | | | | |
| summarizationOutputStyle | Bulleted, numbered, or paragraph | | | | | | | | | | | | | | | | | | | | | |
| summarizationStrategy | The strategy to follow while summarizing the given input. Currently available strategies include STUFFING or MAP_REDUCE. | | | | | | | | | | | | | | | | | | | | | |
| summary | The output of the function. | | | | | | | | | | | | | | | | | | | | | |
| system | | | | | | | | | | | | | | | | | | | | | | |