Drew,
Firebug for FireFox is your friend when it comes to identifying and testing CSS changes through DNN.
http://getfirebug.com/
You can use it to "see" which css classes are being applied to which elements on your page (right mouse click on the section and select "Inspect Element".
Then you can adjust you CSS and see the changes.
All of the AS CSS is in the module.css and the specific theme you're using. If you don't want to create a new theme you can simple copy the adjusted CSS classes into either your skin's CSS file or paste them into the portal.css through Admin | Site Settings | Stylesheet Editor.