I had another look at my 2003.  It appears that the piece we are trying to
pull out extends well below the console.  I tried a thumb in the socket,
and hands to both sides... grunt... no give.  I have two blank plates, but
I can't see how to pop them out non-destructively.  There's almost no
access to the backside of any of this.  

I don't even want to take the radio out, really.  I just need access to the
14 pin plug on the back of the head unit to plug my adapter in.

Taking the glove box out is no help.  Too much reinforcing framework to get
from there to the radio.

I did pop the rearmost section of the console out though.  Several screws
come next.  If I spend 10 minutes a day doing this, I might have my
birthday present installed by Christmas.

  yes. on a 2001 civic you can get that panel out without removing
the console..  i just did one today. sometimes there is a blank plug
next to the socket, pull that out and put your finger in there and
pull. it may be real tight on those 6 clips so be carefull!! don't
peel the hide off your finger.
                       Chip

Do you mean I can pop that panel out without removing the console first?

I bought a PIE adapter to hook up my MP3 player, and I've really been
putting it off for a couple of weeks now.  According to the shop manual, I
have to take those two bolts out, but first take off the lower panel, but
first take off the front part of the console, but first take off the sides
of the console, but first take off the rear portion of the console, but
first remove the tiny storage tray at the left rear of the console.

You work backwards through the steps, which makes it a little difficult to
unravel the needed steps.

If the "accessory outlet" area pops out without taking the console out,
that would be downright handy.  I tried giving it a tug, but I wasn't
enthusiastic enough to get it loose.

I also had to find my radio code before I got started, and I've got that
now, so I'm almost ready to get started ;-)

  the panel below the stereo with the accessory outlet pops out, it's
got a few clips. then there are 2 8mm bolts that go straight up behind
that. then reach in and pop the entire center piece out.
        install dr. is behind the times big time!!!
                        Chip

Try this link:
http://www.installdr.com/InstallDocs/Honda/Civic.html

Does anyone have info on how to remove the standard honda stereo as fitted
to civic models from 2001 onwards. I just spent all day today trying to
remove my one but have given up now...sigh.