Dissk ( Dissk@alien.top ) B to Self-Hosted Main@selfhosted.forum · 3 years ago

Ollama - super easy to host local LLM

5

cross-posted to:
technews@radiation.party

7

Ollama - super easy to host local LLM

Dissk ( Dissk@alien.top ) B to Self-Hosted Main@selfhosted.forum · 3 years ago

5

cross-posted to:
technews@radiation.party

GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally

Get up and running with Llama 2 and other large language models locally - GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally

Chat

Gamma ( GammaGames@beehaw.org )
link
fedilink
English
arrow-up
3·
3 years ago
There’s also an unofficial web frontend https://github.com/ollama-webui/ollama-webui

Though I can’t get compose to use my gpu

Self-Hosted Main@selfhosted.forum

main@selfhosted.forum

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !main@selfhosted.forum

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.

For Example

Service: Dropbox - Alternative: Nextcloud
Service: Google Reader - Alternative: Tiny Tiny RSS
Service: Blogger - Alternative: WordPress

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

Awesome-Selfhosted List of Software
Awesome-Sysadmin List of Software

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
7 users / 6 months
24 local subscribers
675 subscribers
729 Posts
3.17K Comments
Modlog