User assistance, as implemented in most commercial computing applications deployed today, has a number of well documented limitations. Speech technology can be used to complement traditional user assistance techniques and mitigate some of these problems. This paper reports the results from a pilot study conducted on a speech-enabled user assistance system, and describes improvements to the system made as a result of that initial study.