First you gotta try to find out where they're getting in, and seal up those holes. Put steel wool in the hole to fill up the entire surface of the hole, and then fill it with whatever material the rest of the wall is made of. Mice can't chew steel wool. Also, throw some moth balls into the hole before you seal it up. Rodents hate the smell of moth balls.