In this work, a robust, consistent, and coherent approach, termed as Modified Ghost Method (MGM), is developed to deal with the multi-medium interaction with elastic-plastic solid. This approach is simple to implement and keeps the solvers intact, and can handle multi-medium problems which involve various media including gas, liquid and solid. The MGM is first validated by two-dimensional (2D) cases and then is applied to study the interaction between elastic-plastic solid structure and the underwater explosion. The development of the wave system is described and analyzed. Furthermore, two kinds of complex solid structure subjected to underwater explosion are simulated. Finally, a complex solid structure immersed in water subjected to underwater explosion is simulated and analyzed. The numerical experiments show the viability, effectiveness and versatility of the proposed method which is able to accurately predict the wave pattern at various interfaces.