Councils have been urged to do more to crack down on the buy to let property sector by the shadow housing minister on a visit…