Managed Plugin Updates: Visual Regression Testing

Managed Plugin Updates utilizes AI to perform visual regression testing after running updates on your sites. By visually comparing a series of pages before and after the updates ran, most discrepancies can be identified and your website can be quickly rolled back to its pre-update state!

Verification

VRT (Visual Regression Testing) will check your homepage and 19 other pages at random (20 total) as long as a sitemap is present.  The VRT system also checks for server response error codes, broken code, and visual changes – immediately after plugins have been updated.

For example, missing images and forms, misplaced icons, and PHP errors resulting from plugin updates will initiate a rollback and restore the site to the previous working state.

VRT is based on artificial intelligence and is progressively improving. The system is designed to catch changes ranging from very small to large significant changes, however, there is a possibility that some changes may not be detected. If you or your team detect a change that was missed by VRT reach out to support and our dedicated managed plugin support team will investigate the error and work to restore your site.

Rollback procedure

If a rollback is initiated, a notification will be sent to one of our Technical Account Specialists to review the site and troubleshoot any issues encountered, as well as manually update your plugins.

If any action is required on your end to address errors with plugin developers or update the site, we’ll reach out directly with more information.

WooCommerce

Sites running WooCommerce will have their cart, checkout, and my-account pages verified, along with 3 random category pages and 13 random product pages. The following URLs will be verified:

/cart
/checkout
/my-account
/product-category/your-category-name
/product/your-product-name

If your site doesn’t utilize the above product or category URL structure, WooCommerce will be queried first for current URLs using the IDs (e.g. myflysite.com/?product=111.)

Multisite

Multisites with under 49 subsites will have the following pages verified:

• Homepage of the main site (the main site is defined as the site ID 1 and uses the wp_options table)
• Homepages of all subsites

Multisites with 49 or more subsites will have the following pages verified:

• Homepage of the main site
• Homepages of the first 49 subsites (site numbers 51 and greater will not be verified)

Need help?

If you have questions on this or any of the above please contact our Support team!