When the medium surrounding the prism has same refractive index as the refractive index of the material of the prism, the whole system will behave as a single homogeneous medium in which light will travel straight without any deviation.