Speaker forced to act according to govt. wishes, says Opposition