You definitely don't want to mess around, if it continues to hurt. My brother got a hairline fracture in a wrist bone that was undiagnosed and therefore not immobilized, and the bone's blood supply got pinched off. The bone died and decayed and he had to have it replaced.

Just to scare you into actually going. ;-)