What is Lemmy?

Lemmy is a self-hosted social link aggregation and discussion platform. It is completely free and open, and not controlled by any company. This means that there is no advertising, tracking, or secret algorithms. Content is organized into communities, so it is easy to subscribe to topics that you are interested in, and ignore others. Voting is used to bring the most interesting items to the top.

Major Changes

This version brings major optimizations to the database queries, which significantly reduces CPU usage. There is also a change to the way federation activities are stored, which reduces database size by around 80%. Special thanks to @phiresky for their work on DB optimizations.

The federation code now includes a check for dead instances which is used when sending activities. This helps to reduce the amount of outgoing POST requests, and also reduce server load.

In terms of security, Lemmy now performs HTML sanitization on all messages which are submitted through the API or received via federation. Together with the tightened content-security-policy from 0.18.2, cross-site scripting attacks are now much more difficult.

Other than that, there are numerous bug fixes and minor enhancements.

Support development

@dessalines and @nutomic are working full-time on Lemmy to integrate community contributions, fix bugs, optimize performance and much more. This work is funded exclusively through donations.

If you like using Lemmy, and want to make sure that we will always be available to work full time building it, consider donating to support its development. No one likes recurring donations, but they’ve proven to be the only way that open-source software like Lemmy can stay independent and alive.

Upgrade instructions

Follow the upgrade instructions for ansible or docker. There are no config or API changes with this release.

This upgrade takes ~5 minutes for the database migrations to complete.

You may need to run sudo chown 1000:1000 lemmy.hjson if you have any permissions errors.

If you need help with the upgrade, you can ask in our support forum or on the Matrix Chat.

124 points

80% reduction is crazy! Good job!

permalink
report
reply
80 points

80% is wizard like, great work, thanks phiresky@lemmy.world!

permalink
report
reply
100 points

That particular improvement is actually mine. Lemmy was storing a lot of federation data which was completely unused so I removed it. However the 80% improvement is actually overstated, because not all data was migrated to the new table. So the db will grow a bit bigger over time, but still much smaller than before.

Phiresky made a lot of other sql optimizations which make Lemmy snappier and reduce CPU usage on the server. We don’t have any benchmarks in that regard, but server load on lemmy.ml has gone down a lot since upgrading.

permalink
report
parent
reply
28 points

Thanks for the clarification! Your stewardship along with everyone collaborating in work and donations makes for a wonderful project. Really demonstrates the power of people working together to provide spaces outside of the control of corporate interests that are destroying other platforms.

permalink
report
parent
reply
6 points

Do we need to run a full vacuum after upgrade? And for that matter, is the data not used truncated during upgrade?

permalink
report
parent
reply
67 points

80%?? Legend

permalink
report
reply
59 points

It was actually easy because a lot of data was stored which was never used at all.

permalink
report
parent
reply
46 points

Shhh let me compliment youuuu

permalink
report
parent
reply
11 points

I was saving that data, you never know when it might come in handy.

permalink
report
parent
reply
1 point

Do we have a datahoarder forum here yet? Need to bring back forum names as hashtags

permalink
report
parent
reply
66 points
*

Update on lemmy finances (not including cryptocurrencies)

patreon: $1,591/month

liberapay: $374.22 per week (about 1609 per month)

open collective: $2082 (29/6/2023 -> 29/7/2023)

Assuming 63K active users , the per user monetization of 0.08 dollar per user (Reddit’s revenue per monthly user is roughly $1.19).

Estimated developer salary for the two main developers is about 2600$, estimated median salary for developer in the US is about 10K a month.

For comparison firefish made about 1424$ ((29/6/2023 -> 29/7/2023) with an active users count of 11868 (or 8146 if you don’t count calckey, which i think is important because they added a pop up asking for donation, but i don’t know if that is after the name change) so that gives a per user monetization of 0.11 dollar per user ( or 0.17 not counting calckey).

Corrections are welcomed.

permalink
report
reply
10 points

Thanks for the insight!

permalink
report
parent
reply
41 points

I want to clarify that most/ a lot of the DB work of this release actually came from others e.g. nutomic, RocketDerp, Sh4d ;)

permalink
report
reply
16 points

Thank you all for your work!

permalink
report
parent
reply

Announcements

!announcements@lemmy.ml

Create post

Official announcements from the Lemmy project. Subscribe to this community or add it to your RSS reader in order to be notified about new releases and important updates.

You can also find major news on join-lemmy.org

Community stats

  • 196

    Monthly active users

  • 69

    Posts

  • 2.3K

    Comments