bazsalanszky

joined 1 year ago
MODERATOR OF
[–] [email protected] 4 points 3 months ago

From what I've seen, it's definitely worth quantizing. I've used llama 3 8B (fp16) and llama 3 70B (q2_XS). The 70B version was way better, even with this quantization and it fits perfectly in 24 GB of VRAM. There's also this comparison showing the quantization option and their benchmark scores:

1000029570

Source

To run this particular model though, you would need about 45GB of RAM just for the q2_K quant according to Ollama. I think I could run this with my GPU and offload the rest of the layers to the CPU, but the performance wouldn't be that great(e.g. less than 1 t/s).

[–] [email protected] 2 points 3 months ago

Yes, you can find it here.

[–] [email protected] 1 points 3 months ago (2 children)

Are you using mistral 7B?

I also really like that model and their fine-tunes. If licensing is a concern, it's definitely a great choice.

Mistral also has a new model, Mistral Nemo. I haven't tried it myself, but I heard it's quite good. It's also licensed under Apache 2.0 as far as I know.

[–] [email protected] 1 points 3 months ago* (last edited 3 months ago) (1 children)

I haven't tested it extensively, but open webui also has RAG functionality (chat with documents).

The UI it self is also kinda cool and it has other useful features like commands (for common prompts) and searching for stuff online (e.g. with searx). It works quite well with Ollama.

[–] [email protected] 1 points 3 months ago

I have resolved this and other issues in the latest nightly build. I have also uploaded the fix to Google Play (it's currently under review). If we do not encounter any further problems, I could release it soon.

[–] [email protected] 1 points 4 months ago

I want to add kbin/mbin support in the future, but for now, Lemmy is my primary focus.

[–] [email protected] 1 points 4 months ago

Thank you! I missed that. I will try to fix that too

[–] [email protected] 2 points 4 months ago* (last edited 4 months ago) (3 children)

Just wanted to add here that you can test the release early with the nightly builds or with the Google Play Beta program (it's still under review, but hopefully it will be out there soon).

If you find any issues with it, please let me know so I can fix it before this release.

UPDATE: It should be available on the Google Play Beta now. Unfortunately, I've found some issues with posting comments/posts so I will need to fix that before the release.

[–] [email protected] 1 points 4 months ago

Not yet, but I think I know what the problem is. I can probably fix it before this release.

[–] [email protected] 19 points 4 months ago (3 children)

Currently, there is no page to show you the list of communities (other than your subscriptions/blocks). However, I plan to implement something similar to this one soon.

I also want to add an instance view page that will show the list of communities for that specific instance as well.

[–] [email protected] 5 points 4 months ago (1 children)

Currently, I only have a free account there. I tried Hydroxide first, and I had no problem logging in. I was also able to fetch some emails. I will try hydroxide-push as well later.

 

Hello everyone!

First and foremost, a heartfelt thank you to everyone who poured their time, talent, and effort into creating icons for Eternity. The creativity and dedication displayed by our community are truly overwhelming. I'm sincerely grateful to each and every one of you.

I'd also like to apologize for the delay in putting up this voting thread. Life has been especially busy lately, and I appreciate everyone's understanding and patience during these times.

Voting Rules:

  1. Only upvotes count as a vote. To keep things fair and positive, please refrain from downvoting.

  2. The thread will be open for voting for a week unless we see a clear winner before then.

To cast your vote, simply upvote the comment containing your favorite icon design. And once again, I kindly ask that you avoid downvoting any submissions.

In light of the upcoming changes in Lemmy 0.19, I am planning a minor release that could feature the winning icon.

Thank you all for your continuous support and contributions to Eternity. Let's vote and select the icon that will represent our app!

 

Hello everyone!

I've finally released Eternity on the google play store. Note that this is not compatible with the existing releases as this build has a different signature.

Thanks for your support and looking forward to your feedback!

150
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

Hello everyone!

I've just released Eternity v0.1.1. This is meant as a small patch to fix issues and improve stability. For the complete changelog, please visit the release notes.

Thank you for your continued support and feedback! If you have any questions or suggestions, please don't hesitate to leave a comment below.

Cheers! 🚀

66
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

Hello everyone!

You may have noticed that Eternity's icon could use a bit of a facelift (I just hacked it together to have something). Well, it's time for a change and I'd like to get all you talented folks involved!

So, I want to host a competition where you can submit your designs for a new app icon. Once we have all the submissions, we can vote as a community to pick our new icon!

Some details to keep in mind:

Deadline: I'll be accepting submissions until the 8th of September, 2023, 18:00 CET. I might extend this deadline if we have too few submissions.

Format: Submissions should be in SVG or PNG format, with a 1:1 aspect ratio.

Resolution: Please ensure your design is at least 512x512 pixels if you're going with PNG.

Monochrome Version (Optional): It'd be great to see a monochrome version of your design too (for Material You icons).

Design: Your design should be colorful, fun, and engaging. The original UFO spaceship could be a source of inspiration, or elements of the fediverse or Lemmy. Of course, if you've got another creative idea, go wild!

Once the submissions close, we'll have a public vote to pick the winner (similar to what we did with the app name).

Thanks in advance for participating.

Happy designing!

 

Hello everyone!

I've just released the first version of Eternity (after changing the name from Infinity for Lemmy). It's been long overdue, but I wanted to finish a few features before this update. This release includes various fixes and new features, such as:

  • Blocking users/communities

  • List blocked users/communities

  • Separate up/down votes (can be disabled in the settings)

  • Private messages

  • Content reporting

  • New themes (including a new default one!)

  • Fixed various crashes.

And a huge thank you to everyone who provided feedback, translated the app, or contributed in any form during the testing phases of this release. Your insights and suggestions were invaluable in making Eternity better for all users. I'll continue to gather feedback and make improvements in the coming updates, so please don't hesitate to reach out with any further thoughts or issues you might encounter. Your support and engagement mean the world to me! Happy browsing!

 

Hello everyone!

I'm excited to bring some news to our wonderful community today. After an engaging voting process on the voting thread, we as a community have decided to change the name from Infinity for Lemmy to Eternity. 🎉 I am grateful to everyone who participated and voiced their opinions. It was great to see so much involvement!

While [email protected] will be our new gathering space, I'd like to let you know that the original [email protected] won't be closing its doors immediately. This way, everyone has enough time to transition comfortably and get accustomed to our new home.

Lastly, remember, while names may change, our spirit and camaraderie remain eternal. I cherish our roots with "Infinity for Reddit" and am excited about the journey ahead in "Eternity". Let's collaborate, share, and continue building on this vibrant community.

Have fun and see you all in Eternity! 🚀🌌

1
URL Test (lemmy.toldi.eu)
1
test (lemmy.toldi.eu)
1
Test & post (lemmy.toldi.eu)
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

Test

1
Test & test (lemmy.toldi.eu)
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

Test & test

1
Test post (lemmy.toldi.eu)
1
Test (lemmy.toldi.eu)
 

Test

view more: ‹ prev next ›