Band with "!" in their name?

What is the name of band from upstate New York(?) that had an exclamation in their name? A lady was the lead singer and they had a cd released in mid 1990"s.