Structure In Unusable State

[mattcdavis1]

Description

At some point our structure has devolved into an unusable state. Reassigning an entry to a different parent doesn't work. Items show up under two parents at the same time. Expanding contracting doesn't work. Chunks of hierarchy are missing. See screenshot.

Also, here is a screenshot of an error i received when trying to remove a parent (to set element back to
the root of the structure)

Steps to reproduce

Still trying to figure this out. Structures in other areas of the CMS are working ok. Possibly related to depth?

Additional info

• Craft version: Craft Pro 3.0.17
• PHP version: 7.2.7
• Database driver & version: MySQL 5.7.22

[mattcdavis1]

Comparing with another area of the CMS where the structures are working, it looks like folding up items should not trigger an ajax call for get-more-elements but in the broken structure folding and unfolding both generate ajax calls form get-more-elements

[brandonkelly]

Can you send a database backup to [email protected] ? We can look into it from there.

[jcherniak]

So I recently ran into this same issue trying to programatically create about 15000 entries. We created queue jobs for them, but when we ran the queue over 8 threads (on 2 hosts), the whole structure gets smashed.

In the fix you pushed, you just acquire the lock immediately and throw an exception if it fails. This is problematic because it will cause entry saving to fail in some instances.

Would it be possible to:

1. Add a few second timeout to the mutex?
2. Throw a custom exception class that could be caught in our job? This way I can detect I should just try to save again, versus just crap out.

I can just add a mutex around saving elements completely, but that's far less efficient than if we can do it here.

[brandonkelly]

@jcherniak I just added a mutexTimeout property to the Structures service class. Your queue jobs can either set this on the Craft::$app->structures singleton, or instantiate their own instances, with a custom mutexTimeout property.

It’s set to 0 by default, so there’s no change in behavior by default here. There’s no sense in giving it a timeout by default, because the structure UI isn’t collaborative. So if there’s a scenario where the structure is already locked, then one/both of the users are likely viewing inaccurate structure views.

[jcherniak]

@brandonkelly Thanks for the amazingly quick resolution here!

[jcherniak]

So looking into this further, it seems that Craft uses a yii\mutex\FileMutex. This doesn't work across load-balanced or worker-queue hosts. Any thoughts about using a DbMutex instead?

[brandonkelly]

@jcherniak probably not a bad idea. Can you request in a separate issue?