Each alliance has one of each mundus stone as well as Cyrodiil. If you need to see where they are on a map then click here to visit the wiki.

​

I would instead suggest you join a craft guild as these usually have 1 of each mundus stone and it will make your life much easier.