You need to finish rinsing with clean water.
Soda baking is no less popular in home dentistry. However, if a rinse of it disinfects and softens the oral cavity, then bleaching with sodium bicarbonate must be carried out carefully and in combination with dental paste. «Naked» soda is quite capable of damaging enamel and injure the delicate fabric of the gums.