Is it possible that implementations based on same paper show different performance? I'm a junior research engineer of AI.
Looking for the code in the particular paper, I found two git-hub repositories.
However, I think it's weird that how they show different performance, even though they are based on exact same paper and have a similar structure at the code level.
(Of course, I didn't compare the code line by line)
Is it possible, and common things?
It's certainly possible. You just demonstrated that. (I assume you have compared implementations in the same language, compiled the same way.)
I don't think it's surprising. Implementing any reasonably complex algorithm calls for many choices that can affect performance to different degrees - choice of data structures and libraries, efficient use of space or memory.
Whether you should or want to compare the implementations &quot;line by line&quot; to ferret out the differences depends on how the difference in performance matters to you.