Manual tests migration

Last modified by Ilie Andriuta on 2026/07/31 12:30

See https://forum.xwiki.org/t/manual-tests-vs-automated-tests-analysis/7535 for defining the strategy.

List of the manual tests reviewed:

TESTS REVIEWED THAT ARE (OR WERE IN THE MEANTIME) AUTOMATED:

P1.Product

Nr.TEST NAMECOMMENTSDATE UPDATEDSTATUS (if the case)
Administration Tests   
1.Add Delete User In Groupautomated test exists, updated links pointing to automated tests14.10.2020 
2.Add Subgroup To Groupautomated tests exist, updated links pointing to automated tests14.10.2020 
3.Administer Page - Presentation - Change Color Themenot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1797422.10.2020Was automated
4.Create And Delete Userautomated test exists, updated links pointing to automated tests12.11.2020 
5.Create And Delete Groupautomated test exists, updated links pointing to automated tests19.11.2020 
6.Change Page Layoutautomated test exists, updated links pointing to automated tests26.11.2020 
7.Connect to Office Serverautomated test exists, updated links pointing to automated tests04.12.2020 
8.Configure Mail Sendingautomated test exists, updated links pointing to automated tests14.12.2020 
9.Configure Mail Sending with Sender email addressautomated test exists, updated links pointing to automated tests14.12.2020 
10.Create Page From Templateautomated test exists, updated links pointing to automated tests18.12.2020 
11.Edit Groupsautomated test exists, updated links pointing to automated tests15.04.2021 
12.Compare 2 versions from History Tabautomated test exists, updated links pointing to automated tests29.04.2021 
13.Display Right Panel Columnautomated test exists, updated links pointing to automated tests24.03.2022 
14.Extension Manager Advanced Searchautomated test exists, updated links pointing to automated tests05.08.2022
15.Obfuscate Email Addressesautomated test exists, updated links pointing to automated tests30.03.2023
16.Page Panel Wizard Drag And Drop Panel From Panel List To Sideautomated test exists, updated links pointing to automated tests28.07.2023
17.Panel Wizard Drag And Drop Panel From Side To Panel Listautomated test exists, updated links pointing to automated tests14.09.2023
18.Space Panel Wizard Drag And Drop Panel From Side To Panel Listautomated test exists, updated links pointing to automated tests05.10.2023
19.Downgrade Extensionautomated test exists, updated links pointing to automated tests19.10.2023
20.Navigation Panel configuration Exclusionsautomated test exists, updated links pointing to automated tests11.01.2024
21.Panel Wizard Drag And Drop Panel From Panel List To Sideautomated test exists, updated links pointing to automated tests15.02.2024
22.Name strategies preformatted names [Since XWiki 12.0RC1]automated test exists, updated links pointing to automated tests29.02.2024
23.Presentation Change Color Themeautomated test exists, updated links pointing to automated tests13.03.2024
24.Change the languageautomated test exists, updated links pointing to automated tests17.04.2024
25.Switch the languageautomated test exists, updated links pointing to automated tests17.04.2024
26.Set Language Settingsautomated test exists, but missing a test updated in https://jira.xwiki.org/browse/XWIKI-2210417.04.2024Was automated
27.Extension Manager extensions installed as dependenciesautomated test exists, updated links pointing to automated tests27.05.2024
28.Setting password security policy [Since XWiki 11.9]automated test exists, updated links pointing to automated tests06.06.2024
29.Disable Search Suggestnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2230306.06.2024Was automated
30.Upload And Delete XARautomated test exists, updated links pointing to automated tests07.11.2024
31.Mail Discard Success Statusesautomated test exists, updated links pointing to automated tests02.12.2024
32.Show Page Information Tab (No)not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2240908.08.2024Was automated
33.Show Page Attachments Tab (No)not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2240621.07.2025Was automated
34.Show Page Annotations Tab (Yes)not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2240521.07.2025Was automated
35.Show Page Comments Tab (No)not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2240721.07.2025Was automated
36.Show Page History Tab (No)not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2240821.07.2025Was automated
37.Disable Minor Editsnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1879525.06.2021Was automated
38.Document version history optionsnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1933119.01.2022Was automated
39.Create and Add an Object to the Class Templatenot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1833709.10.2025Was automated
40.Create Page from Officeautomated test exists, updated links pointing to automated tests13.11.2025
41.Disable Like featurenot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1836217.02.2026Was automated
42.Change Timezonenot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1882423.02.2026Was automated
43.Change Date Formatnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1946723.02.2026Was automated
44.Create a New Template Provider using Restrictionsautomated tests exists, but they don't cover all tested features from manual test, created https://jira.xwiki.org/browse/XWIKI-1826020.04.2026Was automated
45.Space Rights Show Users and Groupsnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2306631.05.2026Was automated
46.Show User and Group Rightspartially automated, added JIRA task for full automation: https://jira.xwiki.org/browse/XWIKI-2228631.05.2026Was automated
47.Change Default Editornot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1867231.05.2026Was automated
48.Name strategies test selected strategy [Since XWiki 12.0RC1]not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2185331.05.2026Was automated
49.See The Logging Pagenot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2208131.05.2026Was automated
50.Name strategies character replacement validation [Since XWiki 12.0RC1]not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2041131.05.2026Was automated
51.Extend User Profilenot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1862931.05.2026Was automated
52.Disable Version Summariesnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1877231.05.2026Was automated
53.Solr Add to Indexnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2244612.06.2026Was automated
54.Solr Delete from Indexnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2447412.06.2026Was automated
55.Solr Reindexnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2447412.06.2026Was automated
56.Create a template with descendent documentsnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1830318.06.2026Was automated
57.AppWithinMinutes parentnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1802129.06.2026Was automated
58.Make Document Title Field Mandatorynot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1874030.06.2026Was automated
59.Change the Icon Theme from Administer Pagenot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1951130.06.2026Was automated
60.Create Template Provider from the Class UI [Since XWiki 11.8RC1]not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1839030.06.2026Was automated
61.Make Version Summaries Mandatorynot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1871530.06.2026Was automated
62.Display Left Panel Columnnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1956201.07.2026Was automated
63.Footer Space Copyrightnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2034901.07.2026Was automated
64.Name strategies automatic character replacement [Since XWiki 12.0RC1]not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2041001.07.2026Was automated
65.Delete user with Script or Programming Rightsnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1850421.07.2026Was automated
66.Recommended Templates when creating pagespartially automated, added JIRA task for full automation: https://jira.xwiki.org/browse/XWIKI-2202321.07.2026Was automated
Nested Spaces Tests  
67.Rename a page with historyautomated test exists, updated links pointing to automated tests27.06.2024
68.Rename a page with history and attachmentsautomated test exists, updated links pointing to automated tests27.06.2024
69.Add a Nested Page using the Create buttonautomated test exists, updated links pointing to automated tests11.09.2025
70.Convert a Nested Page to a Terminal Pageautomated test exists, updated links pointing to automated tests08.04.2026
71.Convert a Terminal Document to a Nested Documentnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2417620.04.2026Was automated
72.Copy a page by preserving childrennot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2396020.04.2026Was automated
73.Create a child document from a hierarchyadded JIRA task: https://jira.xwiki.org/browse/XWIKI-2458122.07.2026Already automated
74.Copy a WebHome page from one space to another on a hierarchyadded JIRA task: https://jira.xwiki.org/browse/XWIKI-2458323.07.2026Was automated
75.Warning conflict when editing a page [Since XWiki 11.5RC1]added JIRA task: https://jira.xwiki.org/browse/XWIKI-2458524.07.2026Already automated
76.Rename a page with existing translationsadded JIRA task: https://jira.xwiki.org/browse/XWIKI-2458624.07.2026Was automated
Security Tests  
77.Grant Like right from Extension Rightsnot automated, added JIRA task: https://jira.xwiki.org/browse/XWIKI-1882609.10.2025Was automated
78.Deny the rights for a user at wiki level and give rights to a group at page levelnot automated, added JIRA task: https://jira.xwiki.org/browse/XWIKI-2458727.07.2026Was automated
CKEditor Tests  
79.Insert Code macro with a different source [Since XWiki 14.10.2]automated test exists, updated links pointing to automated tests27.06.2024
80.Insert Include Macro with target document author [Since XWiki 14.10.2]automated test exists, updated links pointing to automated tests27.06.2024
Web Tests  
81.Upload Attachment Summary [since XWiki 16.3.0 RC1]automated test exists, updated links pointing to automated tests09.05.2024
82.Set a New Target when delete a page [Since XWiki 14.4.2 and 14.5]automated test exists, updated links pointing to automated tests27.06.2024
83.Attach a restricted Mimetype file disguised as an allowed Mimetype filenot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2334420.04.2026Was automated
84.Copy a pageautomated test exists, updated links pointing to automated tests25.06.2026
85.Create Pageautomated test exists, updated links pointing to automated tests07.07.2026
Export Tests  
86.Export a revision of a page [Since XWiki 14.2.1]not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2090108.06.2023Was automated

P2.Product

Nr.TEST NAMECOMMENTSDATE UPDATEDSTATUS (if the case)
Panels Tests   
1.Resize and toggle panel columns [Since XWiki 17.3.0 and 17.4.0]not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2325822.01.2026Was automated
Color Themes Tests   
2.Buttons Default Backgroundadded JIRA task: https://jira.xwiki.org/browse/XWIKI-2459022.07.2026Was automated
3.Base Colors Text Coloradded JIRA task: https://jira.xwiki.org/browse/XWIKI-2458931.07.2026Was automated
4.Change Theme Logoadded JIRA task: https://jira.xwiki.org/browse/XWIKI-2459231.07.2026Was automated

TESTS REVIEWED THAT ARE NOT (YET) AUTOMATED or CANNOT BE AUTOMATED:

P1.Product

Nr.TEST NAMECOMMENTSDATE UPDATEDSTATUS (if the case)
Administration Tests   
1.Add a favicon for the wikinot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1791107.10.2020 
2.CAPTCHA Image [Since XWiki 10.8 RC1]not automatable05.11.2020-
3.CAPTCHA Soundnot automatable05.11.2020-
4.CAPTCHA Textnot automatable05.11.2020-
5.Create Wiki From A Template With Extensions Installednot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1844811.03.2021task created on 17.03.2021
6.Export and Import Partial Wiki [since XWiki 11.10]not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1864102.04.2021task created on 12.05.2021
7.Change the MailSenderPlugin Loggerautomated tests exists, but this test was marked as Deprecated, see discussion28.07.2022
8.Enable and Disable Message Streamnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1917304.11.2021task created on 25.11.2021
9.Backup and restore a Wikinot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1986823.06.2022 
10.Extension Difference Viewnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2120203.08.2023 
11.Import a XAR into an empty subwikinot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1979908.06.2022Was marked as deprecated
12.Install Extension Historynot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-1994107.07.2022 
13.Localization Filter Boxwas marked as deprecated12.12.2023
14.Correct links rendering on a domain based wikinot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2052106.01.2023 
15.Insert Icon Macro [Since XWiki 14.10.6]not automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2086621.04.2023
16.Panel Wizard Change Order Of The Panelsnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2125024.08.2023
17.Panel Wizard Accordion Headersnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2181418.01.2024
18.Panel Wizard Width Settingsnot automated, listed it on: https://jira.xwiki.org/browse/XWIKI-2181418.01.2024
19.Space Panel Wizard Columnsnot automated, listed it on: https://jira.xwiki.org/browse/XWIKI-2181418.01.2024
20.Space Panel Wizard Panels Homepagenot automated, listed it on: https://jira.xwiki.org/browse/XWIKI-2181418.01.2024
21.Space Panel Wizard Panels Ordernot automated, listed it on: https://jira.xwiki.org/browse/XWIKI-2181418.01.2024
22.Partial XAR exportnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2197807.03.2024Was marked as deprecated
23.Reset panels configurationpartially automated, added JIRA task for full automation: https://jira.xwiki.org/browse/XWIKI-2205402.04.2024
24.Show document version historywas marked as deprecated, merged with Document version history options01.08.2024
25.Switch between Icon Themesnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2258217.10.2024
26.Uninstall Extension Historynot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2260624.10.2024
27.Disconnect from Office Servernot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2280922.01.2025
28.User and Group pickernot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2304727.03.2025
29.Modify User Information from Administrationasked about it on chat05.03.2026
30.View Core Extensionsasked about it on chat07.05.2026
31.Upgrade Extension using Updaternot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2411612.03.2026
Nested Spaces Tests  
32.Access documents from Index Treeasked about it on chat08.04.2026
33.Automatic Redirect on Page Renameasked about it on chat19.02.2026
Security Tests  
34.Subwiki: Deny the rights for a user at page level and give the rights to a groupadded JIRA task: https://jira.xwiki.org/browse/XWIKI-2458822.07.2026

P2.Product

Nr.TEST NAMECOMMENTSDATE UPDATEDSTATUS (if the case)
Color Themes Tests   
1.Typography Font Family Sans Serifadded JIRA task: https://jira.xwiki.org/browse/XWIKI-2459322.07.2026

P3.ProductColor Themes Tests.Base Colors Text Color

Nr.TEST NAMECOMMENTSDATE UPDATEDSTATUS (if the case)
Other Tests   
1.Icon picker default selectionnot automated, added JIRA task for automation: https://jira.xwiki.org/browse/XWIKI-2280822.01.2025

Get Connected