Microsoft Excel – Graphing Mean and Standard Deviation

What you need is Error Bars

Changed to better fit OP's request:

Put the data into excel to look like the following. This is pretty much how you already have it formatted:

Highlight just the cells with values in them and insert a new Line-With-Markers chart. This is the type of chart that has the lines as well as the little symbols depicting the actual value that the lines are connecting. You'll get something like:

Now, right click on the chart and choose "Select Data.." In the Select Data dialog hit the big button in the middle to Switch the rows and columns.

You'll find that your data is now stacked the way, I believe, you are wanting it. You'll need to right click on each series (just somewhere on each line) and you'll be able to edit the marker and remove the line. You can make the markers all look the same if you are into that.