Beehaw
  • Communities
  • Create Post
  • search
    Search
  • Login
  • Sign Up
Dissk ( Dissk@alien.top ) B to Self-Hosted Main@selfhosted.forum · 3 years ago

Ollama - super easy to host local LLM

github.com

external-link
message-square
5
link
fedilink
  • cross-posted to:
  • technews@radiation.party
7
external-link

Ollama - super easy to host local LLM

github.com

Dissk ( Dissk@alien.top ) B to Self-Hosted Main@selfhosted.forum · 3 years ago
message-square
5
link
fedilink
  • cross-posted to:
  • technews@radiation.party
GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally
github.com
external-link
Get up and running with Llama 2 and other large language models locally - GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally
alert-triangle
You must log in or # to comment.
  • Gamma ( GammaGames@beehaw.org ) 
    link
    fedilink
    English
    arrow-up
    3
    ·
    3 years ago

    There’s also an unofficial web frontend https://github.com/ollama-webui/ollama-webui

    Though I can’t get compose to use my gpu

  • Pi_ofthe_Beholder ( Pi_ofthe_Beholder@alien.top ) B
    link
    fedilink
    arrow-up
    1
    ·
    3 years ago

    Thanks Ollama

  • SungrayHo ( SungrayHo@alien.top ) B
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 years ago

    Ollama works great with Big-AGI too, look it up on github.

  • getgoingfast ( getgoingfast@alien.top ) B
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 years ago

    Thanks for sharing this. Not an expert, so here goes my dumb questions. Can we potentially train these model with local data kinds of like Stable Diffusion checkpoints?

  • SnooPets20 ( SnooPets20@alien.top ) B
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 years ago

    I’m thoroughly disappointed by the lack of Obama memes in this repo.

Self-Hosted Main@selfhosted.forum

main@selfhosted.forum

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !main@selfhosted.forum

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.

For Example

  • Service: Dropbox - Alternative: Nextcloud
  • Service: Google Reader - Alternative: Tiny Tiny RSS
  • Service: Blogger - Alternative: WordPress

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

  • Awesome-Selfhosted List of Software
  • Awesome-Sysadmin List of Software
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 1 user / month
  • 7 users / 6 months
  • 24 local subscribers
  • 675 subscribers
  • 729 Posts
  • 3.17K Comments
  • Modlog
  • mods:
  • communick ( communick@selfhosted.forum ) 
  • Raphael ( rglullis@communick.news ) 
  • BE: 0.19.15
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code