Forum Back Online - Request to community members for reports of lingering issues

Using The Forums
1

Howdy y’all! :frog:

As posted in part at https://trust.sangoma.com, we experienced an issue during a forum upgrade that started late in the evening (Eastern US) on March 19, 2025.

Fortunately, we took backups that day and the day before (and more!) Unfortunately, during site restoration, it was discovered that some backup data was corrupted* :beetle:

On March 21, 2025, we were able to bring up the forums in slightly degraded mode, with a few user IDs not yet synchronized, and some posts from March 18 and March 19 not yet restored.

Please let us know in this thread if you are experiencing any issues beyond these that a “Password Reset” and a “Logout” then “Login” are unable to resolve.

Sorry for the down time folks.

:cowboy_hat_face:

* Specifically, it appears that some Crowdsource user logins were causing conflicts with previous usernames stemming from a change to the forum login process made in November 2023. We are working to restore these appx. < 5% of logins as quickly as possible (including our beloved moderator and Asterisk Project Lead @jcolp who is being banished to vacation for the weekend :palm_tree: or at least to the Asterisk Forums.)

3

I hate in-place upgrades. They always tempt Mr. Murphy and to often he responds. Did you get the rest of the corrupted data restored?

4

I always hated working on this server.
I used to say a prayer before launching the update.
A thought to Kapil.

2 Likes
5

Working on it!

1 Like
6

Small update… the Crowd plugin by Discourse that connected Atlassian login functionality and was scheduled for removal from the Forums a year ago (but not completed!) is “no longer supported” - the GitHub repo was archived on March 21, 2024. This will make restoring users who utilized the plugin a bit more complicated.

7

Regarding missing data not yet in the forum: we are able to recover from another backup the posts from appx. 2025-03-18 07:20 to 2025-03-20 06:01 (UTC) which is appx. 150 posts, but minus spam, will be less… some examples…

Please reply with appx. date & time & topic of any you want restored – trying to get to them all, especially those that users already raised issues on, but, will take time. Good news is, it looks increasingly like we will not lose any post data because of the backup taken immediately before the upgrade was started.

8

I’m noticing that links from automatic emails [FreePBX Community Forums] Summary have links like https://community-staging.freepbx.org/t/freepbx-support-incoming-call-failures-title-edit-by-mod/104839

9

…I’m back! :waving_hand:

4 Likes
10

Me too!

3 Likes
11

Thanks, the summary emails from staging should’ve stopped now, but please do let us know if it happens again.

As for the fraction of accounts which were missing for a bit, those should be restored now – had to rebuild the table index with:

REINDEX TABLE users;

…but there might be a few more things left TODO. Continuing to test on staging server :test_tube:

1 Like
13

We are running some more maintenance this evening - minor reindex of tables - please wait a few minutes and refresh the page if you encounter any issues. Thank you!

14

I can’t login with my @ozarktech account. I hit the forgot password button but don’t get an email. I checked the spam folders. I had the account for awhile, it might not have been on the atlassian system or whatever you call it. So I setup this account for now to post this.

15

Hmm, it did not show a pending reset email, so just clicked that button - please check spam folder.

16

I’m not sure what email I setup the account with, but i’m not seeing any email in my primary account or spam folder. When I logged in I had to click the option on the right hand side above the Login with Passkey option, and that option isn’t there after the update.

17

Yes, we removed the Crowd login plugin, which was EOL upstream and no longer compatible with modern versions of Discourse.

Please DM me another email address you’d like to use on the original account, then we can get you a new password reset link sent there (but not the same email as this new account because that probably won’t work ie. duplicate email error.)

18

Ha… the f..king plugins and their dependences!! :smiley:

19

If anyone is still missing an important post, then please let us know the appx. date/time/subject, so that it can be dug out like several others were (as previously mentioned in this topic.)

20

I’m not seeing an option to DM. Is this account too new?