You have no security worries whatsoever, 80% Muslim, 20% Christian but nobody cares what religion you are. I lived in Atyrau for 3 years and never experienced any difficulties as long as you show normal respect for people and don't go looking for trouble.
Kind Regards
JimWalshIreland