Gamification in education describes the application of game elements in the design of learning processes. The MathCityMap project, which consists of a web portal and a gamified application for smartphones, combines the idea of math trails with the possibilities of mobile devices. To evaluate the impact of points and leaderboard on intrinsic motivation a pilot study has been conducted. The results suggest that there is no significant difference between these two game elements. However, gender seems to play an important role on the impact of gamification on intrinsic motivation.