When someone ask me as to where they can buy gold, the first place that will appear in my mind is at the goldsmith shop or the jewelry shop. Do you know that there is actually places that sell gold that is not mean for you to wear on your body? They are 100% for investment or to pay random. kekekekeke.
Here is one of those places; United States Gold Bureau. There you can purchase silver too besides gold or other precious metals and coins. It will be sent to you personally or you can request them to send your "precious" to safe storage at an independent bank or depository.