Research indicates that educators value certain benchmarks of educational quality when choosing educational apps from app stores (i.e., curriculum, feedback, scaffolding, learning theory, and development team). However, it is unclear how other users' ratings of the app, or the app's ranking on the app store's list of “top” educational apps, might impact educators' evaluations. The present study examines how educational benchmarks, ratings, and rankings influence educators' selection of educational apps. One-hundred and fifty elementary educators viewed 18 researcher-created educational app pages and indicated their willingness to download, pay for, and rate each app. Results from a repeated-measures MANOVA and non-parametric tests revealed that educators preferred benchmark apps to buzzword apps, with a medium sized effect. However, they also had a strong preference for apps with positive user ratings, with a large effect, and preferred apps with a bottom ranking, with a medium effect. To improve app selection, educators should rely on their own knowledge to choose apps rather than relying on user ratings or company rankings. Companies running app stores should improve their user ratings and rankings systems to facilitate selection of apps that include evidence-backed benchmarks of app quality.