WYGIWYG

  • 0 Posts
  • 31 Comments
Joined 4 months ago
cake
Cake day: September 24th, 2024

help-circle
  • You should try the comparison between the larger models and the distilled models yourself before you make judgment. I suspect you’re going to be surprised by the output.

    All of the models are basically generating possible outcomes based on noise. So if you ask it the same model the same question five different times and five different sessions you’re going to get five different variations on an answer.

    You will find that an x out of five score between models is not that significantly different.

    For certain cases larger models are advantageous. If you need a model to return a substantial amount of content to you. If you’re asking it to write you a chapter story. Larger models will definitely give you better output and better variation.

    But if you’re asking you to help you with a piece of code or explain some historical event to you, The average 14B model that will fit on any computer with a video card will give you a perfectly serviceable answer.


  • That’s not quite it either.

    The model itself is just a giant ball of math. They made a thing that can transform an English through the collected knowledge of much of humanity a few dozen times and have it crap out a reasonable English answer.

    The open source part is kind of a misnomer. They explained how they cooked the meal but not the ingredient list.

    To complete the analogy, their astounding claim is that they managed to cook the meal with less fire than anyone else has by a factor of like 1000.

    But the model itself is inherently safe. It’s not like it’s a binary that can carry a virus or do crazy crap. Even convincing it to do give planned nefarious answers is frankly beyond our capabilities so far.

    The dangerous part that proton is looking at and honestly is a given for any hosted AI, is in the hosting server side of things. You make your requests to their servers and then their servers put the requests into the model and return you the output.

    If you ask their web servers for information about tiananmen square they will block you.

    You can, however, download the model yourself and run it yourself and there’s not any security issues there.

    It will tell you anything that you need to know about tiananmen square.


  • Yeah the article is mostly legit points that if your contacting the chatpot in China it is harvesting your data. Just like if you contact open AI or copilot or Claude or Gemini they’re all collecting all of your data.

    I do find it somewhat strange that they only talk about deep-seek hosting models.

    It’s absolutely trivial just to download the models run locally yourself and you’re not giving any data back to them. I would think that proton would be all over that for a privacy scenario.









  • Every other executive and most of the management in the country deals with this. Hell even the lowest level of workers deal with this in the opposite direction. Probably 3/4 of the white collar workforce deals with this.

    We’re all working under the same constraints here.

    In my immediate private and professional spheres, I have a pretty good idea of who will or will not keep a secret. In that mental list, 10% of it is easily wrong that is highly situation-dependent. Each one of them that would pass the information on has their own private and professional sphere whom they think won’t pass information.

    It is simply not possible to pass information to your entire company without expecting it to get out.

    It might piss him off but it’s absolutely to be expected. If you want to tell your company that Trump has you by the balls without getting in trouble, you say: We have recently made some very controversial changes to our policies. We as a company do not support these controversial changes and and we are not able to disclose details about the situation, We are being coerced to make these changes, and we really have no choice other than to comply or severely modify the operation of our company.

    That right there tells you what’s going on, But in such a vague method that it can’t be reported back to the orange goblin.