Only if the phone is connected to a charger, at least on mine. If it could always do "ok Google" on a phone regardless of whether or not it is connected, it would be infinitely more useful. Since I opted in to use Google Now in the first place, I actually want that.