In 1501 local laird Jokūbas Nemiravičius built the first church in Karkažiškė. This church didn't survive long. In 1670 it was rebuilt by Aleksandras Sapiega, but it burned after the lightning strike.
In 1913 new church of St. Peter and St. Paul was built. It was closed down from 1963 till 1990.