In disfavour (or favour) with someone: you could say he is in my bad books
More example sentences
- They say: ‘Let's try and be in their good books.’
- He's back in their good books, so his odds remain long.
- Ministers and officials in the state see to it that they stay in their good books.