I just recently noticed this caterpillar and I’m raising one to see what the moth looks like. According to Dave, it only eats the blue baptisia.
You can control it with hand picking or BT if you have a lot. Some people have reported losing their plant. Here’s a link from GardenWeb with other people’s experience.