regex to remove ? in a string

I have been trying to use $core_v2_utility.Replace to remove the ? from a string (specifically, an URL). I have been able to remove the entire query string a la "\??(\w*=\w*&?)" but every combination of backslashes for the initial ? leaves it. Eg, $core_v2_utility.Replace($someString, "\\?", "") always leaves the last ?.