Skeptics

But Jesse Walker, of the Reason Foundation and author of an upcoming book, "The United States of Paranoia: A Conspiracy Theory," said counting groups isn't a good way to measure the threat. "It's dubious to assume growth in numbers is related to violence."

Also, the center's definition of hate groups has changed in the past year, kicking up a controversy. Critics accused the group of unfairly bundling together organizations with vastly different points of view -- and painting them all as potentially violent.

For example a North Carolina-based group calling itself "Granny Warriors" appears on the SPLC list of active "patriots."

But founder Linda Hunnicutt says her organization is harmless.

"I am deadly!" she joked. "I'm 74 years old. I have COPD. I have congestive heart failure. I'm sewing a quilt."

Hunnicutt acknowledges she's no friend of the federal government, but, she wishes no harm on anyone.

"All these people that want to bomb places and kill children, come on," she said. "Who would be in sympathy with them?"

Hunnicutt said she and her group just want Uncle Sam to leave them alone. When Granny Warriors showed up on the SPLC list, Hunnicutt said she wasn't surprised. But it made her wonder, "Is this all they have to do?"

Nonetheless, Hunnicutt's thankful to be on the list because she said it increases her group's notoriety.