chore: add changelog for 10484

changes/ce/fix-10484.en.md

@@ -0,0 +1,3 @@
+Fix the issue that the priority of the configuration cannot be set during rolling upgrade.
+For example, when authorization is modified in v5.0.21 and then upgraded v5.0.23 through rolling upgrade,
+the authorization will be restored to the default.