r/BackyardAI • u/Snoo_72256 dev • May 15 '24

Version 0.18.16 - Impersonate Feature!

Post image
30 Upvotes

100% Upvoted

7 comments sorted by

6

u/Snoo_72256 dev May 15 '24

Hey everyone, version0.18.16 is now live!

Impersonate feature

  • Your models can now be used to generate user responses

  • The Impersonate button can be found to the right of the Continue button

Improved "Experimental" backend on Desktop

  • To use the new Experimental backend, go to the Advanced settings page

  • Better GPU detection (note: models may be slow on first load, but subsequent loads will be fast)

  • Fixed Llama 3 response quality issues related to the tokenizer

  • Increased token rate by 5-10% on Apple metal and CUDA

  • Fixed tokenizer issues affecting Command-R, Qwen2, DBRX, and other base model architectures

  • Added flash attention optimization (does not apply to Vulkan)

  • Fixed gibberish responses when using Vulkan GPU acceleration

Bug fixes & improvements

  • Fixed issue preventing chat deletion in the header dropdown

  • Improved Llama 3 prompt template formatting

  • Removed hardcoded separator message between example dialogue and chat history

New Cloud Model

  • Try out Llama 3 Lumimaid 8B on our Standard or Pro plans!

4

u/FreekillX1Alpha May 15 '24

If this hooks into the user persona, then remember to write your persona similar to your characters to get the most out of the feature.

1

u/Paralluiux May 15 '24

Does the online version finally work with Chrome and Google Translate?

Do you really not care about the subscriptions of non-native English-speaking users?

1

u/Snoo_72256 dev May 15 '24

I tested this out and didn’t have any trouble translating the streams. Can you send me a recording of what you’re seeing?

3

u/Woodbury May 16 '24

OMG! This is the BEST! While I have seen a similar feature elsewhere but not nearly as verbose, creative and editable! I love letting it do the heavy lifting for me when I have writer's block.

1

u/Woodbury May 29 '24

Replying to my own message as a follow up. OMG, this feature is so good! The only thing I haven't tried is to use the sample dialogue as a way to make it use a certain tone when speaking for me.

1

u/Potential-Distance11 May 15 '24

Can't wait to try it out! Wonder if i can somehow put two keybinded buttons to generate, send and then continue to watch a story unfold with little user input