I've tried adding a criteria and while a delete button appears, it only lets you delete the criteria but you still cannot delete the group. Sometimes, incosistently, if I delete it, the group deletes as well, but other times only the criteria gets deleted
While it may just be visual cluttter, it's still an odd UI design choice to not be able to delete a group.