Had the same problem when importing eps files created with other software (Matlab, Tecplot). Drove me nuts!

lionfish is right, ungrouping everything solves the problem. You need to ungroup objects on invisible layers, too.
After that you can start grouping things again.