I'll never walk with you, Ambiga tells Isma chief