this post was submitted on 28 Jun 2023

259 points (97.8% liked)

Lemmy.World Announcements

29199 readers

3 users here now

This Community is intended for posts about the Lemmy.world server by the admins.

Follow us for server news 🐘

Outages 🔥

https://status.lemmy.world/

For support with issues at Lemmy.world, go to the Lemmy.world Support community.

Support e-mail

Any support requests are best sent to info@lemmy.world e-mail.

Report contact

DM https://lemmy.world/u/lwreport
Email report@lemmy.world (PGP Supported)

Donations 💗

If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.

If you can, please use / switch to Ko-Fi, it has the lowest fees for us

Join the team

founded 2 years ago

MODERATORS

ruud@lemmy.world

lwadmin@lemmy.world

lwCET@lemmy.world

jelloeater85@lemmy.world

Serinus@lemmy.world

lw_mod_notification@lemmy.world

259

[Update: Failed again] Update to 0.18.1-rc.1 tried and rolled back (lemmy.world)

submitted 2 years ago* (last edited 2 years ago) by ruud@lemmy.world to c/lemmyworld@lemmy.world

206 comments fedilink hide all child comments

We've upgraded lemmy.world to 0.18.1-rc.1 and rolled back that upgrade because of issues.

(If you had posted anything in those 10 minutes between upgrade and rollback, that post is gone. Sorry!)

The main issue we saw is that users can't login anymore. Existing sessions still worked, but new logins failed (from macos, ios and android. From linux and windows it worked)

Also new account creation didn't work.

I'll create an issue for the devs and retry once it's fixed.

Edit Contacted the devs, they tell me to try again with lemmy-ui at version 0.18.0. Will try again, brace for some downtime!

Edit 2 So we upgraded again, and it seemed to work nicely! But then it slowed down so much it was unuseable. There were many locks in the database. People reported many JSON errors. Sorry, we won't be on 0.18.1 any time soon I'm afraid..

top 50 comments

sorted by: hot top controversial new old

[–] MrPear@lemmy.world 50 points 2 years ago (1 children)

Thank you for the transparancy!

[–] GatoB@lemmy.world 7 points 2 years ago

I love post like this, another reason of why this instance is so good

[–] morelikepinniped@lemmy.world 21 points 2 years ago

Thanks for all your hard work @ruud@lemmy.world. It's not easy!

[–] Jerti@lemmy.world 13 points 2 years ago

UI: 0.18.0 BE: 0.18.1-rc.1 👍

seems to be working for me, I was already logged on

[–] Machefi@lemmy.world 9 points 2 years ago (8 children)

Just curious, why are we updating now instead of waiting for the proper 0.18.1 release?

[–] ruud@lemmy.world 13 points 2 years ago

Because of a few things, really anoying bugs and the Jerboa app not working properly with older versions

[–] antik@lemmy.world 6 points 2 years ago

For example the frontpage is no longer being constantly filled with random posts when you set the filter to "active" or "top day".

[–] dragontamer@lemmy.world 5 points 2 years ago* (last edited 2 years ago) (2 children)

Federation is completely borked with .18 servers. Its very difficult for us to interact with https://lemmy.ca in any way: subscribing, upvoting, comments, posting... its all bugged.

Its maybe not that big a deal because Lemmy.world "has the most users", so in some regards its https://lemmy.ca's loss but... we need to restore reliable federation... especially before the July 1st rush IMO.

The .17 to .18 upgrade is basically a soft-defederation event, because of whatever this bug is between the two versions.

load more comments (2 replies)

[–] twistedtxb@lemmy.world 4 points 2 years ago

I suspect there will be a large influx of new users in two days, and that having Jerboa not working on .world might cause a few issues

[–] axzxc1236@lemmy.world 4 points 2 years ago* (last edited 2 years ago) (23 children)

Reasons I can think of:

The official Android client for lemmy, Jerboa, only supports 0.18 and later, unless users download older version from github and sideload manually.
Sorting is broken pre 0.18, new posts keeps flowing in.
Performance improvement by removing web socket from lemmy. (which fixes 2, which is why 1. happens)

load more comments (23 replies)

[–] Octavius@lemmy.world 3 points 2 years ago

I thought because right now on 0.17 mobile access with jebora is pretty broken and since 0.18 .0 is not an option they are trying to go to 0.18.1 as soon as possible. Even when it means installing rc versions

[–] woelkchen@lemmy.world 2 points 2 years ago

Just curious, why are we updating now instead of waiting for the proper 0.18.1 release?

A Release Candidate is supposed to be past beta testing already and in a state of no major bugs.

[–] rrobin@lemmy.world 9 points 2 years ago (1 children)

As any engineer who does ops can tell you - you did the right thing - the solution is always to roll back, never force a roll forward, ever.

We should totally do pre and post update parties though. Even if the update fails we can have an excuse for drinks and a fun thread.

load more comments (1 replies)

[–] OsrsNeedsF2P@lemmy.ml 8 points 2 years ago (3 children)

Both Dessalines and Nutomic have been working their butts off to get 0.18.x ready for the Reddit API changes. Huge hopes they can pull through!

Dessalines:

Nutomic:

load more comments (3 replies)

[–] Buffalox@lemmy.world 7 points 2 years ago

Linux/Firefox After upgrade many things didn't work, but they continued not to work after rollback.

Turns out I needed to clear the cache, then everything worked fine again.

[–] necropola@lemmy.world 6 points 2 years ago* (last edited 2 years ago) (6 children)

Eveyrthing (UI) is extremely slow now. Not an improvement at all.

load more comments (6 replies)

[–] snargledorf@lemmy.world 6 points 2 years ago (1 children)

@ruud@lemmy.world just wondering if you have considered setting up a second, beta, instance of lemmy.world open to the public?

With all the performance issues with 0.18.1, it's highlighted that there needs to be a way to stress test these updates before applying them to the main instance.

[–] ruud@lemmy.world 4 points 2 years ago (4 children)

Yes, considering that. But we'll need people to use that when we will do testing...

[–] snargledorf@lemmy.world 3 points 2 years ago (1 children)

Well, you have at least one person who would be willing to use it ;D

load more comments (1 replies)

load more comments (3 replies)

[–] ulu_mulu@lemmy.world 5 points 2 years ago (1 children)

is that users can’t login anymore

Ouch, that's bad :(

Thank you for your work, as always :)

[–] LazaroFilm@lemmy.world 2 points 2 years ago

I mean that’s a Tuesday on Reddit lmao.

[–] naneek@lemmy.world 4 points 2 years ago* (last edited 2 years ago) (2 children)

Thanks for the transparency. Maybe it’s a good idea to have a test instance and some test cases/validation done there before updating the main instance. This is a regular process in any software/tech company/stack.

Testing should never be done directly on the prod instance.

load more comments (2 replies)

[–] Spitz@lemmy.world 4 points 2 years ago (2 children)

Jerboa is almost unusable for me at the moment. A lot of crashes, pages not loading, messages not sending etc. But I know that's inevitable at times. Restarting my phone seemed to make it worse. But I know you guys are on it! 👍

[–] kratoz29@lemmy.world 3 points 2 years ago (7 children)

I recommend you this web app

https://wefwef.app

It is almost as functional as Jerboa and very impressive for a web app.

load more comments (7 replies)

load more comments (1 replies)

[–] ndr@lemmy.world 4 points 2 years ago

Seems to be working fine!

[–] Anarch157a@lemmy.world 4 points 2 years ago

Seems 0.18 is up... and...

OH NO ! The interface changed ! Bring it back ! Bring it back... /s

Just kidding... It's looking good, so it's time to explore a little and find all the new stuff.

Nice work @Rudd, thanks for all the hard work.

[–] itadakimasu@lemmy.world 4 points 2 years ago

Thanks for the hard work /u/ruud, we'll get there

[–] Nintendo@lemmy.world 4 points 2 years ago

appreciate the transparency. how are things looking in the back in lemmy.world (server wise)? will we get to a point where it wont require complete rollbacks on the state when a botched update gets rolled out?

[–] NABDad@lemmy.world 4 points 2 years ago

Thanks for the info. You're doing a great job!

[–] Spitz@lemmy.world 4 points 2 years ago (4 children)

Jerboa crashes constantly for me now, doesn't even let me view anything. JSYK!

load more comments (4 replies)

[–] rr7@lemmy.world 4 points 2 years ago

My current session works now with 0.18.0 + 0.18.1.rc1

[–] Sterben@lemmy.world 4 points 2 years ago* (last edited 2 years ago) (1 children)

I am glad I didn't write my last post during the upgrade process.

Maybe next time, give a warning, or maintenance notice.

Thanks for trying though.

load more comments (1 replies)

[–] ekZepp@lemmy.world 3 points 2 years ago (1 children)

load more comments (1 replies)

[–] necrxfagivs@lemmy.world 3 points 2 years ago* (last edited 2 years ago)

Great! I'm getting a bug, when I upvote a comment or post, the "loading animation" takes forever to complete. If I refresh the upvote is there. It reminds me to the bug we had with comments and new posts.

Edit: Is the same for comments.

[–] xtract@lemmy.world 3 points 2 years ago

Working fine from Lift-off!

[–] Machefi@lemmy.world 3 points 2 years ago

PSA: If you've been using lemmy.world during the upgrades and rollbacks your browser might've cashed some stuff that quickly got out of date. If you have problems (especially JSON errors), try doing a hard refresh (usually Ctrl + F5) on the site. It might log you out.

[–] Classy@lemmy.world 2 points 2 years ago

In the meantime I've migrated over to Connect for Lemmy on Android, and it is working significantly better than Jerboa did.

load more comments