So I think there may be a distinction between sex incongruity and gender incongruity. While most trans people I've talked to experience both these things, some only feel one or the other.