The yellow thing is your gear selector for the transmission. It has copper traces with copper fingers to electrically tell the transmission computer what gear you have selected with the shifter. Not something you really want to move around.
Have you looked at your console overall to see if maybe someone sat on it and crushed it down? That's about the only thing I can think of at this time. Try pushing the console upward near where the shift selector is to give a little more clearance.