Testing Znuny LLM Bug?

Moderator: crythias

Post Reply
finalbeta2
Znuny newbie
Posts: 28
Joined: 26 Apr 2023, 11:31
Znuny Version: 6.4.5
Real Name: Jochen

Testing Znuny LLM Bug?

Post by finalbeta2 »

Hi,

I'm testing the new (cool) Znuny LLM add on.
I'm on 7.3.2 for Znuny and 7.3.1 for the Add-on.

I have a couple of issues/questions. And wanted to discus them here, as they may be issues on my side.

Basic Ollama config is working.
1.
When selecting "'FAQ matching & knowledge drafts". This seems to apply in the LLM wizard.
When going back through the wizard. "FAQ matching & knowledge drafts" is deselected again. (Can't see anything in the system logs).

2.
After enabling/disabling Ticket summaries, the ticket summaries keep running on all tickets. When going through the wizard, I can see it's disabled though. But on the tickets, it's still updating the summaries.
At the moment, I would like to be able to update ticket titles, but not create summaries (as this would take up to much of the system).
Johannes
Moderator
Posts: 442
Joined: 30 Jan 2008, 02:26
Znuny Version: All of them ^^
Real Name: Hannes
Company: Znuny|OTTERHUB

Re: Testing Znuny LLM Bug?

Post by Johannes »

Hi,

I will look into this. a 7.3.2 is on the horizion, so this can be fixed there.

Regards

Johannes
finalbeta2
Znuny newbie
Posts: 28
Joined: 26 Apr 2023, 11:31
Znuny Version: 6.4.5
Real Name: Jochen

Re: Testing Znuny LLM Bug?

Post by finalbeta2 »

@Jonannes, update after testing 7.2.3.

1. = Fixed.
2. = No changes, we needed to manually disable Ticket::Frontend::AgentTicketZoom###Widgets###0000-LLMSummary to stop summeries.
3. = We never got classifications to work. Might be dependend on the full summiers (not stated anywhere). So we reenabled them.
Some tickets show an empty classification block. No logs seem to exist on how to debug. No controls seems to be given on "do we want the AI to classify the ticket, do we really want the AI moving tickets in the system. " etc.
4. = Vectorisation is failin on a number of FAQ's. Somethimes because the plugin should probably set chunking on the request.
5. = Feature request = Filtering where the AI does it's job (mail adressen or queue's) is probably a good option for higher volume systems. This will but a lot of tokens on high volume systems.

If our input is welcome, I'm willing to take this to github? (can we make github issues for the plugins?)
Post Reply