[BUG]: Wrong RAM usage and garbage AI response.

[ODeux2]

Note:

• I didn't know it was open source since it wasn't mentioned in the play store page, a mention and link to repo should be added.
• I am using a Samsung Galaxy A10 running Android 11(2GB RAM).
• Benchmarking works fine, just takes time(my bad, maybe add more info, like a time estimation(~5mins for me) and elapsed time, or live update if possible).
• Assigning a large model can result in "crash" that is only recoverable due to removing the char before the model loads(android kill apps when low on RAM, when recording the video below, the rec app closed more that once).

Bug:

• The video the RAM usage is low(0,59GB used of 1,70GB) and clearly doesn't reflect the actual RAM remaining(according to the developer service page: system=~800Mo, apps=~300Mo, free=~700Mo, when I have nothing opened).
• As for the garbage output, it seems to only happen when the system prompt is empty, despite the broken looking default template.
  • The default template has a bunch of Unicode noncharacter in it, looking at other template for comparison, it seems that the delimiter %- and %} are broken.

rec_160624_18402026.mp4

[shubham0204]

I didn't know it was open source since it wasn't mentioned in the play store page, a mention and link to repo should be added.

Agreed, a mention of the app being open-source will be helpful for users.

Benchmarking works fine, just takes time(my bad, maybe add more info, like a time estimation(~5mins for me) and elapsed time, or live update if possible).

Let me check how we can estimate the time for the benchmark.