When pot is legal, will I have the right to smoke a joint in my backyard – even if it bothers the neighbours?

My neighbours think my occasional pot smoking is rude; but with marijuana legalization coming, what are my rights as a home owner?