Mixture of Experts in Multi-modal Models