Beehaw
  • Communities
  • Create Post
  • search
    Search
  • Login
  • Sign Up
Otter ( otter@lemmy.ca )  to Privacy Guides@lemmy.oneEnglish · 2 years ago

DuckDuckGo AI Chat adds support for Llama 3 70B and Mixtral 8x7B

lemmy.ca

message-square
20
link
fedilink
134

DuckDuckGo AI Chat adds support for Llama 3 70B and Mixtral 8x7B

lemmy.ca

Otter ( otter@lemmy.ca )  to Privacy Guides@lemmy.oneEnglish · 2 years ago
message-square
20
link
fedilink
DuckDuckGo at DuckDuckGo
lemmy.ca
external-link
DuckDuckGo. Privacy, Simplified.

Might be helpful for those that

  • don’t have access to hardware that can run things locally
  • understand the benefits and limitations of generative AI

Link: https://duckduckgo.com/?q=DuckDuckGo&ia=chat

As a nice coincidence, one of the first results when I searched for a news update was this discussion:

https://discuss.privacyguides.net/t/adding-a-new-category-about-ai-chatbots/17860/2

  • sabreW4K3 ( sabreW4K3@lazysoci.al ) 
    link
    fedilink
    English
    arrow-up
    18
    ·
    2 years ago

    Is there a YouTube video under 10 minutes that compares the different AI models available from DuckDuckGo?

    • simple ( simple@lemm.ee ) 
      link
      fedilink
      English
      arrow-up
      14
      ·
      2 years ago

      Dunno, but Llama 3 is the best open source model and Claude 3 is the best overall model they offer.

      • Instantnudel ( instantnudeln@discuss.tchncs.de ) 
        link
        fedilink
        English
        arrow-up
        26
        ·
        2 years ago

        You provided no reasoning but I choose to just believe you. Thank you wise person in the Internet.

        • Even_Adder ( Even_Adder@lemmy.dbzer0.com ) 
          link
          fedilink
          English
          arrow-up
          7
          ·
          2 years ago

          I can reaffirm what they said with slightly more proof.

          https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard

      • sabreW4K3 ( sabreW4K3@lazysoci.al ) 
        link
        fedilink
        English
        arrow-up
        6
        ·
        2 years ago

        Thanks for the info

    • Howdy ( mynamesnotrick@lemmy.zip ) 
      link
      fedilink
      English
      arrow-up
      12
      ·
      2 years ago

      I use mixtral8x7b locally and it’s been great. I am genuinely excited to see ddg offering it and the service in general. Now I can use this service when not on my network.

      • rutrum ( rutrum@lm.paradisus.day ) 
        link
        fedilink
        English
        arrow-up
        3
        ·
        2 years ago

        What GPU are you using to run it? And what UI are you using to interface with it? (I know of gpt4all and the generic sounding ui-text-generation program or something)

        • Howdy ( mynamesnotrick@lemmy.zip ) 
          link
          fedilink
          English
          arrow-up
          6
          ·
          edit-2
          2 years ago

          I am using this: https://github.com/oobabooga/text-generation-webui … It is running great with my AMD 7900XT. It also ran great with my 5700xt. It sets up itself within a conda virtual environment so it takes all mess out of getting the packages to work correctly. It can use NVIDIA cards too.

          Once you get it installed you can then get your models from huggingface.co

          I’m on arch, btw. ;)

          Edit: I just went and reinstalled it and saw it supports these gpus

          • rutrum ( rutrum@lm.paradisus.day ) 
            link
            fedilink
            English
            arrow-up
            3
            ·
            2 years ago

            That’s right, “text-generation-webui”. At least its unambiguous lol. Thanks for sharing.

    • Otter ( otter@lemmy.ca ) OP
      link
      fedilink
      English
      arrow-up
      8
      ·
      2 years ago

      A lot of it might come down to individual tasks or personal preference.

      Personally I liked Claude better than GTP3.5 for general queries, and I have yet to explore the other two

      • sabreW4K3 ( sabreW4K3@lazysoci.al ) 
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 years ago

        Thank you.

Privacy Guides@lemmy.one

privacyguides@lemmy.one

Subscribe from Remote Instance

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !privacyguides@lemmy.one
lock
Community locked: only moderators can create posts. You can still comment on posts.

In the digital age, protecting your personal information might seem like an impossible task. We’re here to help.

This is a community for sharing news about privacy, posting information about cool privacy tools and services, and getting advice about your privacy journey.


You can subscribe to this community from any Kbin or Lemmy instance:

  • Subscribe on Kbin.social
  • Subscribe on Lemmy.one
  • Subscribe on Lemmy.ml
  • Subscribe on Beehaw.org

Learn more…


Check out our website at privacyguides.org before asking your questions here. We’ve tried answering the common questions and recommendations there!

Want to get involved? The website is open-source on GitHub, and your help would be appreciated!


This community is the “official” Privacy Guides community on Lemmy, which can be verified here. Other “Privacy Guides” communities on other Lemmy servers are not moderated by this team or associated with the website.


Moderation Rules:

  1. We prefer posting about open-source software whenever possible.
  2. This is not the place for self-promotion if you are not listed on privacyguides.org. If you want to be listed, make a suggestion on our forum first.
  3. No soliciting engagement: Don’t ask for upvotes, follows, etc.
  4. Surveys, Fundraising, and Petitions must be pre-approved by the mod team.
  5. Be civil, no violence, hate speech. Assume people here are posting in good faith.
  6. Don’t repost topics which have already been covered here.
  7. News posts must be related to privacy and security, and your post title must match the article headline exactly. Do not editorialize titles, you can post your opinions in the post body or a comment.
  8. Memes/images/video posts that could be summarized as text explanations should not be posted. Infographics and conference talks from reputable sources are acceptable.
  9. No help vampires: This is not a tech support subreddit, don’t abuse our community’s willingness to help. Questions related to privacy, security or privacy/security related software and their configurations are acceptable.
  10. No misinformation: Extraordinary claims must be matched with evidence.
  11. Do not post about VPNs or cryptocurrencies which are not listed on privacyguides.org. See Rule 2 for info on adding new recommendations to the website.
  12. General guides or software lists are not permitted. Original sources and research about specific topics are allowed as long as they are high quality and factual. We are not providing a platform for poorly-vetted, out-of-date or conflicting recommendations.

Additional Resources:

  • EFF: Surveillance Self-Defense
  • Consumer Reports Security Planner
  • Jonah Aragon (YouTube)
  • r/Privacy
  • Big Ass Data Broker Opt-Out List
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 1 user / month
  • 3 users / 6 months
  • 716 local subscribers
  • 21.7K subscribers
  • 539 Posts
  • 5.44K Comments
  • Modlog
  • mods:
  • jonah ( jonah@lemmy.one ) 
  • dngray ( dngray@lemmy.one ) 
  • Freddy ( freddy@lemmy.one ) 
  • ninchuka ( ninchuka@lemmy.one ) 
  • jonah ( jonah@lemmy.jonaharagon.net ) 
  • BE: 0.19.21
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code