Here is what we shipped at Markprompt in January:
1. New sources: Salesforce Case and Zendesk Tickets
You can now generate new answers and drafts based on past resolutions. The LLM prioritizes recent tickets over earlier ones. PII is removed at import time.
2. New RAG pipeline
We have drastically improved the retrieval algorithm, ensuring that the most comprehensive and precise context is brought in to generate answers. For instance, instead of pulling in individual sections from a knowledge base, related sections are also pulled in. The algorithm adjusts its behavior depending on the model being used, so that it can fully leverage the available context window, such as the 128k tokens of GPT-4 Turbo.
3. Chat completion filters
Want to only pull in certain parts of your indexed knowledge base for certain interactions? For instance, for a user on the Enterprise plan, you may want to include all articles with the “Enterprise” tag, but these should not be included for users on the free plan. With filters, you can specify rules on article metadata for what content should be used in a given situation.
4. Support for gpt-4-turbo-preview
Instead of specifying a pinned version of GPT-4 Turbo, such as gpt-4-0125-preview, you can now use gpt-4-turbo-preview and always be on the latest version. Incidentally, the latest version of GPT-4 Turbo improves handling of “laziness”, where the model doesn’t always complete a task, such as a step-by-step action.
5. Improved detection of “No response” situations
When the LLM cannot answer a question, it tells so in the most adapted way, using formulations that fit into the flow of the conversation. It doesn’t just leave an empty answer or say “No response”, which sometimes makes it tricky to detect. Our new LLM-based approach captures these situations robustly.
6. Advanced website importer
Some websites are notoriously difficult to import, because of server settings, long loading times, dynamically rendered content, and more. Our new website importer is built for situations where a standard approach falls short.
7. Mobile widget
The Markprompt chat widget is now fully responsive, and works well on devices of all sizes.
8. Sticky chat
The widget also supports a new "sticky" flag, so that it remains on-screen when the user is browsing a page, or navigating to other pages.
9. Updated /threads API
The threads API now offers an "expand" flag that allows you to pull in all message data in a single call.
