If you weren't there for the Olympics, it's not too late. Lillehammer has a very good range of opportunities.
My suggestion
Try to stay somewhere close to the former Olympic village, particularly if you're travelling in a group. The place is very welcoming and practical in itself, particularly when you consider how expensive Norway can be.