A Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

github.com

cross-posted to:
technews@radiation.party

A Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

github.com

ijeff@lemdro.idM to

AI Stuff@lemdro.idEnglish · 2 years ago

cross-posted to:
technews@radiation.party

GitHub - Maknee/minigpt4.cpp: Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

github.com

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML) - GitHub - Maknee/minigpt4.cpp: Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

The main goal of minigpt4.cpp is to run minigpt4 using 4-bit quantization with using the ggml library.

https://github.com/Maknee/minigpt4.cpp

You must log in or register to comment.

Chat

AI Stuff@lemdro.id

aistuff@lemdro.id

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !aistuff@lemdro.id

A place for all things artificial intelligence

Stay up-to-date with the latest news, reviews, and insightful discussions about artificial intelligence. Whether you’re interested in machine learning, neural networks, natural language processing, or AI applications, this is the place to be!

Subscribe: !aistuff@lemdro.id

Quick Links

Subscribe Links

Rules

1. Stay on topic

All posts should be directly related to artificial intelligence. This includes discussions, news, research, tutorials, applications, and anything else specifically about AI.

2. No reposts/rehosted content

Submit original sources, unless the content is not available in English. Reposts about the same AI-related content are not allowed.

3. No self-promotional spam

Only active members of the community can post their AI-related apps, projects, or resources, and they must actively participate in discussions. Please avoid posting self-promotional content that does not contribute to the AI community.

4. No editorializing titles

When sharing AI-related articles or content, refrain from changing the original titles. You may add the author’s name if relevant.

5. No offensive/low-effort content

Avoid posting offensive, irrelevant, or low-effort content that does not contribute positively to the AI community.

6. No unauthorized polls/bots/giveaways

Do not create unauthorized polls, use bots to generate content, or organize giveaways related to AI without proper authorization.

7. No affiliate links

Posting AI-related affiliate links is not allowed.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
2 users / 6 months
0 local subscribers
0 subscribers
10 Posts
0 Comments
Modlog

mods:
ijeff@lemdro.id