Sounds like the idle mixture is way too lean, and the motor is running on the main circuit only -- hence no idle. Those carbs are VERY sensitive to even slight changes in the idle circuit.
It is usual and normal to swap props when changing boats/loads. Likewise, if there is a big altitude change, it is typical to either swap jets or change to a carb that is jetted correctly for the specific altitude. You can't have it both ways, but you can try to hit a middle ground -- setting up in a manner that is not best for either, but tolerable for both.
What specific model is the 6? If it's a B model, you may get a little more tolerance for different altitudes by running the carb from the A model.
There are 2 jet kits available, about $42.00 each. The kit for 3,000-6000 ft includes 3R6032540M PILOT JET #35 and 3R1032511M MAIN JET #68 HIGH ALT; The kit for over 6,000 ft, includes 3R2032510M MAIN JET #62 and 3R6032540M PILOT JET #35. The difference between the kits is the main jet.
Don't know what performance you need from the portabote, but there is a slow-speed, large-blade, high thrust prop available (used on sailboat applications), 399B645121 PROP 4/5/6HP, 8.375" DIA X 6" PITCH (ELEPHANT EAR), about $72.00, which may slow your trolling idle enough, yet have enough top speed for the portabote.
However, if you are jetted for high altitudes, running at sea level will still be the wrong mixture, and vice versa if running at high altitudes with sea-level jetting.