Should be fine to pull the box for servicing with boat in the water. Check shift linkages and oil levels first. May also have a place where you can check the oil pressure.