Pure, rejoice
This name comes from the English tradition.
Kay is a Christian girl name. It is commonly given to girls.