Once you pick the color of your number, that's it. When it goes to the section where you pick a house, all the other numbers in it either weren't on the page or a different color. The number you picked is in the house, but it's the only one in the house that was the color you chose ealier.
For example:
You chose 18. (which is blue)
Now in the house section- House E: 18(blue), 16(green), 6(pink), 15(red), 7(black), 29(not there).
So..there you have it.
I fail at life. XD