Subplots with single linked colorbar for manual editing

I understand that there's no straightforward way to create a single colorbar for all subplots -- in the sense that I have to use the same caxis limits for all -> create a colorbar for one of the subplots and position it so it looks as if it represents all of them.

However, the problem comes when I have to manually tweak the colorbar a bit (using interactive colormap shift). This ends up modifying only the subplot with which the colorbar is linked. Is there a way to link the colorbar to all subplots? similar to linkaxes perhaps?

Thanks!