The Bishop says five to ten minutes into the sermon, he saw the door in the back of the room kicked open and three to four men walked in with guns. He believes he was targeted, the station says. The service was being livestreamed.

"I said, 'Alright, alright, alright,' pretty much stating that I'm not going to do anything because I know you're coming for me. You're coming straight to me. I don't want my parishioners hurt. I've got women and children there," said Whitehead, of Leaders of Tomorrow International Ministries.

"As I got down, one went to my wife and took all her jewelry and had the gun in front of my 8-month-old baby's face. Took off my bishop's ring, my wedding band and took off my bishop's chain, and then I had chains underneath my robe and he started tapping my neck to see if anything else. So that means they knew. They watched and they knew that I have other jewelry," he explained.

The church's livestream shows the gun being held on the pastor.

"They had guns on my deacons that was at the door," said Whitehead.

The robbers are yet to be apprehended.