The Truth You Choose to Use Matters