The pressures currently on teachers of mathematics at every level seem greater than ever, whether that is university mathematics lecturers, school teachers or those who work with very young learners. So, I began my Presidential Address with the hope that no one would leave the Joint Conference of Mathematics Subject Associations 2023 feeling as though they were not good enough and must do more. I did not want anyone to go home with a lengthy to-do guilt list of additional things they must try to incorporate into their practice. Instead, I advocated giving attention to the ancient proverb “less is more”, versions of which are found within many cultures; e.g., “brevity is the soul of wit” (Hamlet), “Sometimes diminishing a thing adds to it; Sometimes adding to a thing diminishes it” (Tao Te Ching). I offered five aspects of mathematics teaching and learning that might benefit from ‘less of’ something, in each case trying to see how this might create space for more of something else. In this article, I present these five suggestions for improving by removing.