I just want to mess with this one too. I had a hard time finding an abliterated one before that didn’t fail the Tiananmen Square question regularly.

Can’t wait to try a distillation. The full model is huge.

I’ve heard of this happening when you generate datasets with ChatGPT to help train your model. OpenAI doesn’t want you doing this, making it against their terms of use, but there’s nothing they can do to stop people. You can generate some really good synthetic datasets from ChatGPT, and it’s perfectly legal to do.

Were you running it locally?