Status update July 4th

Just wanted to let you know where we are with Lemmy.world.

Issues

As you might have noticed, things still won’t work as desired… we see several issues:

Performance

  • Loading is mostly OK, but sometimes things take forever
  • We (and you) see many 502 errors, resulting in empty pages etc.
  • System load: The server is roughly at 60% cpu usage and around 25GB RAM usage. (That is, if we restart Lemmy every 30 minutes. Else memory will go to 100%)

Bugs

  • Replying to a DM doesn’t seem to work. When hitting reply, you get a box with the original message which you can edit and save (which does nothing)
  • 2FA seems to be a problem for many people. It doesn’t always work as expected.

Troubleshooting

We have many people helping us, with (site) moderation, sysadmin, troubleshooting, advise etc. There currently are 25 people in our Discord, including admins of other servers. In the Sysadmin channel we are with 8 people. We do troubleshooting sessions with these, and sometimes others. One of the Lemmy devs, @[email protected] is also helping with current issues.

So, all is not yet running smoothly as we hoped, but with all this help we’ll surely get there! Also thank you all for the donations, this helps giving the possibility to use the hardware and tools needed to keep Lemmy.world running!

  • imaqtpie@sh.itjust.works
    0·
    1 year ago

    Thanks for the update, you’re leading the way for Lemmy.

    I was prepared for servers crashing and lagging, but you’re keeping things moving thus far, despite receiving 85k new users in a month. Heroic stuff.

  • NebLem@lemmy.world
    0·
    1 year ago

    I hope hosting all these massive communities is enough a portfolio to land Ruud a crazy job offer one day that pays him stupid levels of money while allowing him plenty of time off to maintain these massive hobby projects.

  • Glunkbor@lemmy.world
    0·
    1 year ago

    Of course these performance issues are a bit annoying, but I gotta say that I love these updates and explanations here. Great communication, keep it up, please!

  • Sentau@lemmy.one
    0·
    1 year ago

    People of lemmy.world should encourage the new users joining up on lemmy.world to other create accounts on other instances instead

  • YellowtoOrange@lemmy.worldEnglish
    0·
    1 year ago

    As much as I hope that Lemmy grows, I wouldn’t want lemmy.world to suddenly get 1 million signups and multiply your headaches.

    Perhaps we need more well run servers by other people to take the load.

  • ubergeek77@lemmy.ubergeek77.chat
    0·
    1 year ago

    That DM sending bug was already fixed in a later rc version. Although in rc.9 (and possibly rc.10) there is a weird bug where you can’t sign out. Fun stuff.

  • The dogspaw @midwest.social
    0·
    1 year ago

    Its amazing this site hasn’t completely melted down yes it sucks trying to use it and having nothing load but the fact that the site has mostly worked when I want to use it and the fact you guys have less than 1% of 1% of reddits resources is mind blowing

  • Achsonaja@sh.itjust.works
    0·
    1 year ago

    Curious about the server info. Is there more info available somewhere else?

    Is lemmy.world running on a single server? What’s the CPU and memory capacity? You mentioned a percentage of CPU usage and an amount for ram, so that made me curious about what’s available for each.

    Does restarting take down all services or is the application clustered or not monolithic somehow?

    • Ruud@lemmy.worldOPM
      0·
      1 year ago

      It’s a single server with 32core/64 thread AMD EPYC and 128GB RAM. At the moment we run multiple containers for lemmy so restarting doesn’t mean outage.

  • Shartacus@lemmy.world
    0·
    1 year ago

    I want this to succeed so badly. I truly feel like it’s going to be sink or swim and will reflect how all enshitification efforts will play out.

    Band together now and people see there’s a chance. Fail and we are doomed to corporate greed in every facet of our lives.

  • el_cordoba@lemmy.world
    0·
    1 year ago

    I am sure the stress is unreal, but It is appreciated. You all stepped up when everyone was stepping down (or trying to sellout). I am hopeful this will turn into something great.

  • Kokesh@lemmy.world
    0·
    1 year ago

    Thank you for everything! Can we donate to cover the costs? If more people throw in $5, we all will benefit. Can Lemmy server scale up without needing RAM exponentially growing with the user number? I hope the system will get better optimized for bigger user base as the time goes on…

  • Flying Squid@lemmy.world
    0·
    1 year ago

    I am very forgiving of the bugs I encounter on Lemmy instances because Lemmy is still growing and it’s essentially still in beta. I am totally unforgiving of Reddit crashing virtually every day after almost two decades.

    • Ruud@lemmy.worldOPM
      0·
      1 year ago

      Yes phiresky is working with us improving performance, has helped a lot so far! (We’re now running a custom build with some of his improvements)