"Let them worship how, where, or what they may"

"We claim the privilege of worshiping Almighty God according to the dictates of our own conscience, and allow all men the same privilege, let them worship how, where, or what they may"

According to the 11th Article of Faith, it seems to me that Latter-day Saints are typically quite generous (or at least ought to be) in our allowance (or tolerance) of the religious beliefs of those not of our faith. But must letting "them worship" differently only refer to people in other faiths? Or can "them" also refer to fellow Mormons in terms of how they worship? My question isn't original (see "Should we apply the 11th article of faith internally?"), but it's nonetheless a question I've had on my mind lately.

There may have been a time when I read this particular article of faith only in the direction of "us" and "them"--Mormon and non-Mormon. Now I read it and apply it in all directions, including within Mormonism. How tolerant are we with "allowing" variances within our own faith as opposed to simply being tolerant with "others"? How generous are we with each other in recognizing that we must each individually follow "the dictates of our own conscience"? What should be said (if at all) about the limits to divergence of our personal choices of worship (or lack thereof) inside the Church of Jesus Christ of Latter-day Saints?