If you can afford the Polaris, I would buy it. You can late get enough money with it to buy a Carrack, much much sooner than having the Carrack get enough money for a Polaris.
As said, you can always "visit" your friend Carracks and enjoy those aspects of the game.
I would not be worried by...