Can I use c# to interface with excel without using vsto?

Sure you can and, if you have VS 2010 or later (.NET 4.0), it's much easier than it used to be thanks to the introduction of the 'dynamic' keyword.

Check out this link to get going on this:

http://msdn.microsoft.com/en-us/library/ee342218.aspx