Reading Ironballs' post reminded of a PM I sent to someone about sawing technique, this was specifically aimed at English backsaw use but the principles are exactly the same for Japanese saws. It may be of use to others too so I'll post it here, apologies if any points are repeated from other people's posts:
Backsaws are unidirectional, they cut straight down with the weight of the back providing all of the downward pressure required for the cut. If you want to cut at an angle, always reposition the timber rather than canting the saw.
Your posture is important. Stand at 45 degrees to the bench with your feet a little over a shoulders width apart. now turn the foot that is closest to the bench outwards so that it aligns with the direction of the cut. Imagine a continuous planar surface, like a big imaginary sheet of card, continuing out from the edges of the saw blade. Your wrist, elbow, shoulder and dominant eye should all be in this plane, lined up with the blade of the saw. Rest your other hand on the top of the workpiece.
Think of the amount of the saw's weight that you are holding as the accelerator pedal. If you are holding all of the weight it is at tickover, if the wood is bearing all of the weight, it is at full throttle. When you start the cut you need to be taking almost all of the weight and just allowing the teeth to gently graze the surface. As the cut becomes established, you can relax your arm slowly, feeding on the power as you allow more and more weight to be borne by the timber. If you are accelerating too fast the saw will judder - equivalent to wheelspin. Never apply any additional downward pressure yourself.
As you start the cut you have about 10 or 12 strokes to determine its direction. After that the saw will be guided by the kerf (the groove you have already cut) any attempt to steer the saw after that will make it bind in the cut. To steer the saw during the first dozen strokes, look at the reflection of the timber in the side of the sawplate. If your wood is horizontal and your saw vertical, then it will appear to continue straight on through the blade. Because it's a mirror image any inaccuracies are doubled, so it's a very accurate way of assessing whether all is square or not. If the wood is canted over at 45 degrees you will see a right angle as long as the saw is plumb, canted at 22.5 you will see a 45 etc.
Having established the cut, try holding the handle of the saw between thumb and forefinger and just pushing it back and forth, it should cut a perfectly straight line. All you are providing is the forward and back motion, the back of the blade is providing the downward pressure and the kerf is doing the steering. Once you are up and going the saw takes care of itself in the vertical and horizontal planes, so the only movement you need to supply is back and forth.
If you still find that the cut is wandering, try cutting three or four kerfs next to each other. If all the cuts show an identical error the problem is with the saw, not your technique. If you are getting inconsistent errors it is a technique issue - this test is the sawing equivalent to getting a grouping of shots when zeroing a rifle.