On average, Americans would need a net worth of $2.5 million or higher to be considered wealthy, according to a new Charles Schwab survey.