Vos commented Tuesday after Assembly Republicans voted to oust Kramer as majority leader amid allegations that he sexually harassed at least two women last week, one of them a GOP staff member.
Vos says he has heard from people who say they would be concerned about their safety if Kramer returns. His office says Kramer checked into a treatment facility on Saturday and he has not been available for comment.
Kramer's chief of staff did not immediately return messages seeking comment Tuesday.
Vos says he hopes Kramer does not seek re-election.