GenAI Prompts
NiCE CXone GenAI Prompts lets you customize and manage generative AI
Artificial intelligence (AI) technology that generates new content based on user prompts. Follows patterns and structures learned from training data. prompts for NiCE CXone products that utilize them. Once you have customized a prompt, you can add transcripts, summaries, or articles to test the prompt against. GenAI Prompts gives you better control over the content and format of the AI-generated responses and improves the large language model (LLM
Large Language Model. A type of AI that processes, understands, and generates human language based on context.) response.
GenAI Prompts currently lets you customize the following prompts:
-
The autosummary generated by Automated Summary (AutoSummary)
-
The KB query extraction prompts, for voice and digital interactions, used by Copilot for Agents
Key Facts About GenAI Prompts
-
GenAI Prompts is available for all systems but you can only create prompt profiles for the products and features you have enabled.
-
A new, unpublished profile is only accessible to the user who created it. Once it's been published, it shows a version number and is available both for other users to see and for selection in the related NiCE CXone product.
-
When you make changes to a new or existing prompt profile without publishing the changes, those changes are saved for up to 30 days from the last time you edited it. Only you can see those changes. After 30 days:
-
Changes to a new profile revert to the default settings.
-
Changes to an existing profile revert to the most recently published settings.
-
-
The icon next to a prompt profile indicates its current status.
-
: The profile is a new draft that hasn't been published yet. -
: The profile is published with no pending changes from you. -
: The profile is reverted to an earlier version that isn't the currently published one. -
: The profile has been published but has pending, unpublished changes.
-
-
The Prompt Template pane at the top of the prompt profile shows where the profile settings, like tone and length, fit into the prompt. You can click the links in the prompt template to be taken directly to the setting that populates it.
-
All users can now open the LLM list. Which models you can select depends on your organization's licensing. The list itself is grouped by standard and premium models, with models verified by NiCE CXone shown first and the rest listed alphabetically.
-
If you do not have the Prompt Editor Advanced license, premium models appear in the list but you cannot select them.
-
To see which models are premium, open the LLM Manager.
-
Premium models are billed based on usage. Your organization is charged for the number of tokens the model reads and writes when a prompt runs. To use premium models, your organization needs the LLM consumption item on its contract. Contact your NiCE CXone Account Representative for pricing.
-
NiCE Default is available as an LLM option. It is the model that NiCE CXone sets for that specific prompt type. If a prompt template only supports one model, NiCE Default is the only option shown and the LLM list is disabled. If a template supports multiple models, NiCE Default appears alongside them as a selectable choice.
-
If the LLM currently selected for a profile is scheduled for retirement, NiCE CXone displays a warning next to the LLM list stating that the model will retire in a set number of days and prompting you to update to a supported model.
-
When a model you use is closer to its retirement date, NiCE CXone also displays an LLM Update dialog when you open the affected profile. The dialog states the date the model switches to retention mode, after which the model is no longer accessible, and reminds you to update the LLM and test and publish all affected profiles before that date. Select Don't show this message again to suppress the dialog for that profile, or click OK to close it.
-
If a model reaches its retirement date and you have not selected a different model, NiCE CXone automatically switches the profile to NiCE Default. Test and publish the profile after this switch to confirm the output still meets your requirements.
Each prompt profile in GenAI Prompts uses a large language model (LLM) to generate its output. You select the LLM in the LLM list at the top of the profile.
The list groups models into Standard and Premium. NiCE-verified models appear first in each group, followed by the remaining models in alphabetical order. All users can view the list. Which models you can select depends on your organization's licensing.
-
These tables list only the LLMs that NiCE CXone has verified. Verified models differ by prompt type, so check the Verified LLMs by Prompt Type table before you change the model in a profile. The LLM list in the application may show additional models that have not yet been verified by NiCE CXone. In the list, the
icon next to a model indicates it has been verified by NiCE CXone for that prompt type. You can select any listed model, but if you choose one that is not listed for your prompt type, testing that model for your specific use case is your responsibility. -
NiCE Default is the model that NiCE CXone sets for each prompt type. NiCE CXone chooses it by testing, and the model can change over time, for example when a prompt is updated or a model is retired. Because the model differs by prompt type and can change, NiCE Default is not listed as a separate row in the LLM Ratings table.
-
Profiles previously defaulting to a specific model remain on the configured model, with no functional change.
This table shows the LLMs you can choose from, along with a rating from 1-10 for the speed, accuracy, complexity handling, and hallucination resistance. 1 is always the lowest and 10 is always the highest score. A high score is desirable for speed, accuracy, and complexity handling, but not for cost and hallucination resistance.
| LLM Model | Speed | Accuracy | Complexity Handling | Hallucination resistance | notes |
|---|---|---|---|---|---|
| Nova Micro | 10 | 6 | 5 | 6 | Lightweight, low latency; limited reasoning. |
|
Nova Lite |
9 |
7 | 6 | 7 | Higher intelligence than Micro; still lightweight and fast. |
| Nova Pro | 8 | 8 | 8 | 8 | Good balance of intelligence, reasoning, and speed. |
| Claude 4.5 Haiku | 8 | 8 | 7 | 8 | Strong accuracy and reasoning; suitable for efficiency-focused use cases. |
| Claude 5.5 Haiku | 6 | 8 | 7 | Not yet rated | Summary quality matches Claude 4.5 Haiku. It reasons before answering, so it responds more slowly. |
| Claude 4.5 Sonnet | 7 | 9 | 9 | 9 | Flagship-level intelligence and reasoning. |
| Gemma 3 12B | 9 | 8 | 8 | Not yet rated | Fast and low-cost. Scored close to Claude 4.5 Sonnet on interaction summaries in NiCE CXone testing. Less consistent on self-service and real-time summaries. Not available in all regions. |
| Gemma 3 27B | 8 | 7 | 5 | Not yet rated | Slower and less consistent than Gemma 3 12B, especially on journey summaries. Not more accurate than Gemma 3 12B. |
| GLM 4.7 Flash | 8 | 7 | 6 | Not yet rated |
Usually very fast, but some responses take 3-4 seconds. Mid-range accuracy on interaction summaries. |
| Llama 4 Maverick 17B | 9 | 8 | 6 | Not yet rated | Fast. Less consistent than Llama 4 Scout 17B on long interaction summaries. |
| Llama 4 Scout 17B | 9 | 8 | 8 | Not yet rated | Fast and consistent on interaction summaries, journey summaries, and knowledge answers. |
| Ministral 3 8B | 10 | 7 | 5 | Not yet rated | Very fast. Strong on short extraction tasks. Weaker on journey and real-time summaries. |
| Ministral 3 14B | 9 | 7 | 4 | Not yet rated | Fast and fine for interaction summaries and knowledge answers. Unreliable on journey summaries. Not more accurate than Ministral 3 8B. |
| Mistral Large 3 | 8 | 8 | 6 | Not yet rated | Strong on long interaction summaries. Inconsistent on journey summaries. |
| Nova 2 Lite | 9 | 8 | 7 | Not yet rated | Similar speed to Nova Lite and about as accurate as Nova Pro overall in NiCE CXone testing. Can exceed word limits or answer in the wrong language on some prompts. Not available in all regions. |
| NVIDIA Nemotron 3 Super 120B | 9 | 7 | 7 | Not yet rated | Fast. Limited testing so far. Test with your own inputs before you use it. |
| NVIDIA Nemotron Nano 3 30B | 10 | 6 | 5 | Not yet rated | Fastest model tested, but it failed more summary tests than any other model. Use only for short, simple tasks, and check the output. |
| Qwen3 32B | 9 | 8 | 8 | Not yet rated | Fast and consistent on interaction and journey summaries. Not available in all regions. |
| Qwen3 235B A22B 2507 | 8 | 8 | 8 | Not yet rated | Consistent quality across summary prompts. Slower than Qwen3 32B on long interactions. Not available in all regions. |
| Qwen3 Next 80B A3B | 8 | 8 | 7 | Not yet rated | Good summary quality. Slower than Qwen3 32B. Not available in all regions. |
Ratings are relative and based on NiCE CXone testing of summary and knowledge-answer prompts and measured response times. Availability varies by region, and some models are not available in specific regions. Test with your own inputs before you publish a profile.
These ratings describe each model in general. Check the Verified LLMs by Prompt Type table to see which models are verified for your prompt type.
| Prompt Type | Standard Verified Models | Premium Verified Models |
|---|---|---|
| Automated Summary (AutoSummary) | NiCE Default | None |
|
Copilot for Agents Autosummary |
NiCE Default Gemma 3 12B Gemma 3 27B GLM 4.7 Flash Llama 4 Maverick 17B Llama 4 Scout 17B Ministral 3 14B Mistral Large 3 Nova 2 Lite Nova Lite Nova Pro NVIDIA Nemotron 3 Super 120B NVIDIA Nemotron Nano 3 30B Qwen3 235B A22B 2507 Qwen3 32B Qwen3 Next 80B A3B |
Claude 4.5 Haiku Claude 4.5 Sonnet |
| Journey Summary |
NiCE Default Gemma 3 12B Gemma 3 27B Llama 4 Maverick 17B Nova 2 Lite Nova Lite Nova Micro Nova Pro NVIDIA Nemotron Nano 3 30B Qwen3 235B A22B 2507 Qwen3 32B Qwen3 Next 80B A3B |
Claude 4.5 Haiku |
| KB Answers |
NiCE Default Claude 5.5 Haiku Nova 2 Lite Nova Lite Nova Pro |
Claude 4.5 Haiku |
| KB Query Extraction - Voice |
NiCE Default Ministral 3 8B Nova Lite Nova Micro |
None |
| Real-Time Sentiment |
NiCE Default Gemma 3 12B Nova Lite Nova Micro |
None |
| Real-Time Summary |
NiCE Default Nova Lite Nova Micro |
None |
| Email AutoSummary |
NiCE Default Nova Lite |
Claude 4.5 Sonnet |
| Email Generation |
NiCE Default Nova Micro |
Claude 4.5 Haiku Claude 4.5 Sonnet |
| Email Real-Time Summary |
NiCE Default Nova Micro |
Claude 4.5 Haiku Claude 4.5 Sonnet |
| Email Rephrase |
NiCE Default |
Claude 4.5 Haiku Claude 4.5 Sonnet |
| Email Sentiment |
NiCE Default Nova Micro |
Claude 4.5 Haiku Claude 4.5 Sonnet |
| Email Simplify |
NiCE Default |
Claude 4.5 Haiku Claude 4.5 Sonnet |
| Email Topic Extraction |
NiCE Default Nova Lite |
Claude 4.5 Haiku Claude 4.5 Sonnet |
Consider Another Verified Model:
Consider another verified model when testing shows that NiCE Default does not meet a specific requirement, for example:
-
Languages other than English: Automated Summary (AutoSummary) writes summaries in the language set on the Copilot profile. If summaries come out in the wrong language, first check the profile language and any language instructions in your prompt. Then compare other verified models on your own non-English interactions.
-
Long or complex interactions: Choose a model with a high Complexity Handling score, and compare the output on your longest interactions.
-
Real-time prompt types: Real-Time Summary and Real-Time Sentiment run while the interaction is in progress, so response time matters. Choose a model with a high Speed score, and also check output quality on your own interactions. Speed alone does not guarantee good results.
-
Structured output: Email Topic Extraction and Email Generation must return JSON. Use a model verified for that prompt type. Models that are not verified may add extra text or formatting, or may not return JSON at all.
-
Custom redaction instructions: Instructions to exclude or redact information are best-effort with any model. They are not a guaranteed filter. In NiCE CXone testing, clearly structured instructions reduced leaked information more than switching models did. Structured instructions use separate lists of what to remove and what to keep, with examples. Review the output for sensitive information after any change to the prompt or the model.
Before You Publish a Profile That Uses a Different Model:
-
Test the prompt with a representative set of transcripts or email threads, including your longest and most complex ones.
-
Compare the output with NiCE Default output for the same interactions. Check the language, the required format, the content that must be included or excluded, the length, and the response time.
-
Switch only when the other model gives clearly better results for your use case.
-
Test again when you change the prompt, or when NiCE CXone announces that the model you selected will be retired.
If you select a model that is not verified for your prompt type, testing it for your use case is your responsibility.