Those guards look strong.
Try not to fight them. What spell could you use so that they don't see you enter the gates?
Try blinding them with a Dazzle spell.
Now open the door and follow the Djinni.
There is no way you can beat Ad Avis' main man with your spells and dagger.
Try to calm him then get down from the balcony.