Mishkat al-Masabih 1120
Abu ‘Atiya al-'Uqaili said:
Malik b. al-Huwairith used to come to our place of prayer and tell us traditions, and one day when the time for prayer came we told him to go forward and lead the prayer, but he said to us: Put one of your own men forward to lead you in prayer, and I shall tell you why I am unwilling to do so. I heard God’s Messenger say, "If anyone visits people he must not act as their imam , but one of their men must do so.” 

Abu Dawud, Tirmidhi and Nasa’i transmitted it, but Nasa’i gave only the Prophet's words.
وَعَنْ أَبِي عَطِيَّةَ الْعُقَيْلِيِّ قَالَ: كَانَ مَالِكُ بن الْحُوَيْرِث يَأْتِينَا إِلَى مُصَلَّانَا يَتَحَدَّثُ فَحَضَرَتِ الصَّلَاةُ يَوْمًا قَالَ أَبُو عَطِيَّةَ: فَقُلْنَا لَهُ: تَقَدَّمَ فَصْلُهُ. قَالَ لَنَا قَدِّمُوا رَجُلًا مِنْكُمْ يُصَلِّي بِكُمْ وَسَأُحَدِّثُكُمْ لِمَ لَا أُصَلِّي بِكُمْ؟ سَمِعْتُ رَسُولَ اللَّهِ صَلَّى اللَّهُ عَلَيْهِ وَسَلَّمَ يَقُولُ: «مَنْ زار قوما فَلَا يؤمهم وليؤمهم رجل مِنْهُم» . رَوَاهُ أَبُو دَاوُدَ وَالتِّرْمِذِيُّ وَالنَّسَائِيُّ إِلَّا أَنَّهُ اقْتَصَرَ عَلَى لَفْظِ النَّبِيِّ صَلَّى اللَّهُ عَلَيْهِ وَسلم