Weatherby regency stock swap?:

I own a weatherby regency. All the steel in fine. Perfect really. The wood is so plain its almost invisible. I want to buy another regency with better wood and swap it to my gun. Then sell off the other remaining set.

My question. How much trouble will I run into with fit? Can I just assume swapping the wood will fit flush and look clean ? Or could I be running into big fit problems?