From: rick@cs.arizona.edu (Rick Schlichting) Subject: INDUSTRY: Kahaner Report: Oki's activities in human-computer interface Date: 1 Jul 93 13:04:26 GMT Organization: University of Arizona CS Department, Tucson AZ Crossposted from comp.research.japan [Dr. David Kahaner is a numerical analyst on sabbatical to the Office of Naval Research-Asia (ONR Asia) in Tokyo from NIST. The following is the professional opinion of David Kahaner and in no way has the blessing of the US Government or any agency of it. All information is dated and of limited life time. This disclaimer should be noted on ANY attribution.] [Copies of previous reports written by Kahaner can be obtained using anonymous FTP from host cs.arizona.edu, directory japan/kahaner.reports.] From: Dr. David K. Kahaner US Office of Naval Research Asia (From outside US): 23-17, 7-chome, Roppongi, Minato-ku, Tokyo 106 Japan (From within US): Unit 45002, APO AP 96337-0007 Tel: +81 3 3401-8924, Fax: +81 3 3403-9670 Email: kahaner@cs.titech.ac.jp Re: Oki's activities in human-computer interface 1 July 1993 This file is named "oki-hci.93" ABSTRACT. Oki Electric's R&D in human computer interface. The OKI Technical Review 146 Vol. 59, January 1993 is a special issue on human computer interfaces. An overview article on trends and research developments is followed by about ten detailed articles on specific Oki activities. For detailed information contact the publishers, Oki Technical Review 17-1 Toranomon 1-chome, Minato-ku, Tokyo 105 Japan Tel: +81 3 3501-3351 Trends and Future Directions of Human Interface R&D Katsuhisa Saito*, Kozo Yamada*, Yuunosuke Haga** and Tetsuo Kinoshita** (*Human Interface Lab., R&D Group; **Systems Lab., R&D Group) Abstract This report describes a knowledge-based design support method that allows designers to efficiently create a user oriented human interface for application programs. This report first introduces a representation method for user-required information of a human interface, then explains the design process support method based on such representation requirements. The knowledge-base of interface functional parts that plays an important role in this process is also explained. 1. Introduction Due to the recent developments communications, computer downsizing, especially in high performance microprocessors, and information communication systems, to include automatic cash machines at banks, have begun to appear in our everyday life. Telephones, word processors (hereafter WP), VTRs, etc. are commonly being, used in homes offering, numerous functions and flexible use. However, the methods of use are becoming, complicated, and users have begun to be interested in understanding the equipment and in furthering ease of use. This report focuses on information communication systems. Section 2 explains the history of human-system concepts, beginning with man-machine interfaces, based on ergonomics studies, placing importance on efficient HIs and on supporting users. Section 3 explains R&D trends toward implementing, a superb HI using two pivotal concepts: HI in a wide and in a narrow sense. Human interface, in a wide sense, will gain greater importance in the future to include functions to process user requests. Section 4 considers OKI products and presents an overview of the progress of HIs at information terminals, the user point of contact with systems. OKI's future R&D directions are also discussed. Tools that people use in dally life have been in use for a long time, and often are quite refined in terms of HI. However, information communication systems have a short history, developed rapidly, and have both an abstract and complicated interface. In a sense, information communications are not very refined, although they possess many functions. Continuing energetic research is a necessity. Section 5 briefly introduces each report of this special issue. 2. Concepts of Human Interfaces 2.1 Development Processes of Human Interface The phrase "human interface" came into common usage with the deepening of communication between humans and machines (systems). However, concepts and definitions of this phrase vary with individuals. This section clarifies the concept of HI with an overview of development processes (Figure 1). [Shows historical development from 1960s to 1990s, (general) DKK] To dramatically improve work efficiency, various computer based tools, machines and systems have been introduced to the work environment where people perform both manufacturing and machine operation. From a worker's point of view, the work environment has not always been comfortable because workers had to learn system handling methods and the creation of special work formats for a given system. To examine systems and work environments from the human side, attention was given to the field of "ergonomics." At the same time, as information communication systems gradually became popular, and technologies were developed, terms like "man-machine interface" and "User interface" came into common speech. Improvements in the interaction between users and systems was aggressively performed at the system side. In the late 1980s the user system contact point begun being called "human interface", and examinations began on the method of interaction from a wide perspective, to include system nature and functions. In the future, along, with advances in quality and user diversification, the diversification and advancement of interfaces will accelerate, providing numerous HI choices. 2.2 Definition of Human Interface, Required Characteristics This section defines Hls of information communication systems from an engineering point of view. This definition envisions the HI as an "environment that provides functions and means to perform various user work that concerns various real world targets (user tasks) more easily and more efficiently in a 'system world', using the system functions provided by a given information communication system". This definition poses the question as to what kind of system offers an excellent HI. Donald A. Norman, an advocate of using cognitive engineering, to study human activities and thought processes from a psychological point of view, mentions four characteristics that a system must have: a conceptual model, mapping, visualization, and feedback. These characteristics are explained using Figure 2. [Described by the author below, DKK.] Imagine a real world situation where a person creates a document using such tools as a pencil and eraser. Here, the individual creates and checks content and format in direct contact with the document. This operation could easily be performed in the system world that consists of a WP, printer, etc., just as in using a pencil and paper. A system world that can provide such work sensations has the same or similar nature and structure as a real world work format. In this sense, the system maps the real world quite well. The function and structure of a WP (system image) is created based on the design concept of the designer (design model). A user can gradually master WP operation while using the program because the system image is transferred to that user. Mastery, is acquired by the user as user knowledge (user's model). Such a designer model, system image and user's model are collectively referred to as the "conceptual model". A WP that clan easily create a user's model is designed and implemented based on an excellent conceptual model. People in the real world can immediately understand the function and result of an action themselves, and such an experience is important in the system world as well. Specifically, this would mean that various WP functions and built-in information are often difficult to recognize and understand to the user, and if these functions and information could be clearly presented to a user when necessary (visualization), this would help a user to operate and understand the WP. Also, if a user properly understood the program executions and status of a WP (feedback), that user could easily understand system flow and use the system free of concern. To a degree, the above mentioned 4 characteristics are satisfied in excellent systems. As in the WP example, these characteristics are perceived by the user via the HI, and in no way contradict the definition of the HI stated above. This report considers these characteristics as required aspect, advocating them in the design and evaluation of a HI. 3. Trends of Research and Development 3.1 Structure and Technologies of Human Interfaces This section explains the structure and technologies of a HI for information communication systems based on Figure 3. [Described below, DKK.] Initially, the authors define a HI for an information communication system directly operated by the user in a narrow sense (narrow sense HI) using three modules: information input, information output and HI control modules. In the information input and information output modules, the user and system exchange information using various media. Information from the user is captured to the system by the information input modules, and after being processed using system functions, information is presented to the user as a response via the information output modules. In such information input/output modules, media process technologies to manipulate media source information is important. In this equation the HI control modules controls, manages and supports interactions between the user and system functions. In addition to conventional information processing technology, knowledge information processing technology to effectively utilize various knowledge effectively is required so that intelligent and flexible interactions can be implemented. The objects of user tasks handled by an information communication system include such various elements as information processed by system functions, functions and information of another system accessed via a communication network, and human beings in communication with each other. Because of this, we add another definition from a macroscopic point of view that includes these objects, referring to it as a wide sense HI. In addition to the technological elements of a narrow sense HI, for HI in a wider sense, both communication technology and information processing technology that implement distributed and coordinated information processing by organically combining multiple systems and objects are important. The concept of a HI that embraces the entire information communication system, including individuals as users and a HI fundamental technology, is a guiding principle for each technological element. A wide sense HI would deal with ergonomics technology, cognitive engineering technology that targets HI models, human information processing mechanisms, design methodologies and media theories related to Hls. 3.2 Human Interface Research Problems Human interface R&D has been energetically performed in each technological field mentioned in the previous section. This section summarizes recent R&D primarily from a HI design and development point of view, with attention to HI fundamental technologies that give a sense direction for the total HI. The following aspects are introduced: design guide lines and techniques that concern the design and construction of a HI system, individuals as users, a model that concerns an architectural method for a HI, and an evaluation of Hls. Table 1 shows R&,D examples of these aspects. ----------------------------------Table 1---------------------------- RESEARCH PURPOSE R&D EXAMPLES TARGET Guideline, Provide basic principles Norman's guidelines design of HI design, guidelines HI architecture technique techniques, tools Interface builder, UIMS Human Study relations between Human info proc model being humans & HI from system Analysis & clarification users viewpoint of human errors and of communication activites Model 7-Stage model Double-contact surface model System characteristics model Evaluation Protocol analysis Evaluation of human errors HI evaluation standards ----------------Table 1-------------------------- Most critical in the design and development of a HI is to have effective design guidelines and techniques. The four characteristics of a systems explained in Section 2.2 can be regarded as an example of guidelines based on cognitive engineering principles. Recent design techniques and tools were based on both artificial intelligence and on the latest software technologies. The other three R&D areas, however, provide a different foundation to design guidelines and techniques. The study of human beings has provided indications that concern the required characteristics and structure of both the narrow and wide sense HI from the point of view of an information communication system user. Studies on models have resulted in a basic framework (model) of a HI in terms of requirements analysis and specification definitions of a design target system. Other studies dealing with evaluation have provided feedback on evaluation standards and designs that concern system facility and performance. 4. Development of Human Interfaces at OKI Electric 4.1 Progress of Interfaces in OKI Electric Products This section considers two aspects in the evolution and improvement of HIs: the accumulation of various media by human beings, and the implementation of intelligent systems that are familiar to human beings. If the history of OKI information communication system products are considered, one would see that OKI has anticipated the change of the times and has put energy into HI development. Figure 4 shows history of OKI's terminal equipment by media. [This gives a detailed time-line of various Oki products beginning in the 1950s grouped by area such as data terminal, speech terminal, printer, etc, DKK.] Terminal equipment represents the contact point between humans and systems, and is an example of the narrow sense HI defined in Section 3.1. Terminal equipment has been developed in a speech, data and image media sequence. Using data media as a basis for explanation, it can be said that general purpose terminals, personal computers and workstations (PC/WS) have recently become the primary hardware used for data. Dedicated terminals were developed for application fields using PC/WS at the core. In this area, innovations in HI have advanced remarkably, as seen in downsizing, personalization, and in the multi-media integration of speech and images. The history of the development of printers, data output equipment, is a history of improvements in printing speeds. This historical flow can be seen from the early matrix type printers, on to wire dot and the current non-impact type printers. The Microline series of printers, released in 1980, were epoch making PC printer superior in cost and performance. This became a huge force in promoting the personalization of terminal equipment. The OPP6100 photo printer, an optical printer, released in 1983, was the first LED page printer in the world. This unit was compact, running at high speeds while offering high quality reproduction. A future OKI product, an OCR terminal that mechanically reads characters, will allow anyone to quickly and efficiently input data. In terms of functions, user facilities have progressed, for example, the type of characters that can be read have increased, including not only typed or wordprocessed characters, but handwritten characters as well, thus minimizing input restrictions. The IR-620J had written Kanji OCR was released in 1991, and has the most advanced recognition performance in the industry, launching a whole new generation of OCRs. In the area of speech media terminals, speech quality improvements, multi-functions, integration with data media, developments in system telephones, etc. have progressively evolved since the No. 4 telephone of the 1950s. Cellular mobile telephones (AMPS), were commercialized in 1983 and led the start of mobile communication in the world. These first units were followed by further developments and the downsizing of portable telephones, triggering a revolution in HIs for communication systems. In the area of still image media, the facsimile is a typical example. The OKI FAX 600, released in 1975, was the first thermal fax in the world. This epoch making product saw most products throughout the world change to a thermal mechanism. It also caused equipment downsizing and operability to progress dramatically. Soon thereafter, G2 to G4 standard products were developed in succession, offering shorter transmission times, higher precision and quality, and plain paper recording (PPF). In the area of moving image media, analog TV telephones were developed in the 2970s, with INVITE and CCITT H.261 standards starting developments in this area. TV telephone and TV conferencing systems based on these standards were developed in the OMNIMATE series. This series saw the integration of moving images, still images, speech and data, thus implementing real time image communication. 4.2 Future Targets In the field of HIs, OKI is performing R&D with the general technologies mentioned in Section 3.1. Future R&D focuses on the following for commercialization purposes: media processing as an information output group, pursuing ergonomic fidelity principles to include the system function module, and creating intelligent tools by applying knowledge information processing. 1. Toward diversification and integration of media: In the future, if images, especially color moving images, are used in both the communication and computer fields along with conventional media, the volume of information will become enormous and a highly efficient coding technology will be required. OKI is now developing coding technology based on international standards that include LSIs. If communication per se and computers began to handle mixed or multi- media, then media integration will be performed at various levels. For example, it will be possible to recognize Japanese text transmitted by fax, translating it into English, or converting text information output by printer or displayed on screen into vocalized Japanese speech. To integrate media based on conversion between media, it is necessary to create recognition technology for characters, speech, documents and images that are closer to the level of human perception. OKI Electric is putting energy into high performance recognition technologies for such multi-media, and is also exerting great efforts in 3-D computer graphics that can easily express processing results and the operation status of computers. 2. Following ergonomic fidelity principles: As information output devices such as displays and printers reach higher levels of precision and speed, function and quality improvements that implement ergonomic fidelity principles for users, to include units that are easy to see and have good response, is required. OKI is aiming to downsize telephones and PCs which incorporate ergonomic designs and functions so that a user can freely use them anywhere. In conjunction with this, OKI is researching pen and speech input to eliminate keyboards, and is working on color flat panel displays to further downsize display devices. 3. Toward intelligent tools: In the field of information communications, the tools that people use are becoming increasingly intelligent. In the future, OKI will widen research targets by adding intelligence to tools, with an aim to support user individuality. Oki is thinking of providing true user oriented information communication systems that utilize the results of technological developments based on the above three aspects. Effective implementation would improve the conveniences of system. 5. Summary of this issue There are generally two types of reports in this special issue: reports related to technological developments that improve the HI, and reports related to the HI of products. One article describes the trends in window systems an interface that caused a most important revolution in PC/WS information presentation systems. Other topics include knowledge-based design supported and the development of data base retrial in relation to knowledge information processing technologies and object oriented technologies. The importance of both will further increase in the future, paralleling improvements in HIs. Five articles introduce speech processing related to media processing, speech synthesis LSIs, graphics and technologies related to still and moving image processing. In the future, environments that can easily handle speech, high precision graphics, and still images that can run on general purpose PCs or WSs will be available. To handle color moving images, the development of highly efficient coding technology is essential. Other articles introduce such topics as electronic mail as a foundation for remote conferencing, and computer supported cooperative work (CSCW). Two reports deal with design guidelines for display and terminal systems from the point of view of human engineering. This issue concludes with articles that introduce topics on the design of multi-media related systems, banking automation systems, printing systems, video conferencing, mobile terminals, and mobile information equipment from a HI point of view. 6. References 1. Norman, D.A., translated by Nojima, Psychology of Everyday Things, Shimnoyosha, 1989. 2. Human Interface Research Group, Human Interface, Japan Data Communication Association, 1990. 3. Nikkei Computer Supplement Issue, User Interface in Multi-media Era, Nikkei BP, 1989. 4. Furukawa, et al., Science of Interface, Kyoritsu Shuppan, 1987. 5. Saeki et al., When Body and Intention are Alienated, Active Mind, Tokyo University Press, pp. 55-86, 1990. 6. Winograd, T., et al., translated by Hiraga, Understanding Computers and Cognition, Sangyo Tosho, 1988. 7. Saeki, Interface and Cognitive Engineering, Jogakushi Vol. 30, No. 1, pp. 2-14, Information Processing Society, 1989. 8. Rasmussen, J., translated by Kaiho et al., Clgnitive Engineering in Interface, Keigaku Shuppan, 1990. 9. Ericsson, K.A., et al., Protocol Analysis, MIT Press, 1984.. 10. Railey, R.W., translated by Hiramatsu et al., Human Error Management, Keigaku Shuppan, 1986. ----------------------------------------------------------------------------- TITLES AND ABSTRACTS OF OTHER ARTICLES OKI TECHNICAL REVIEW, 146 Vol 59 1/93 (RELATED TO HUMAN INTERFACE) Knowledge-based Design Support for Human Interfaces Noriyuki Iwane, Mariko Osato, Toshihiko Shirokaze and Tetsuo Kinoshita (Systems Lab., R&D Group) Abstract This report describes a knowledge-based design support method that allows designers to efficiently create a user oriented human interface for application programs. This report first introduces a representation method for user-required information of a human interface, then explains the design process support method based on such representation requirements. The knowledge-base of interface functional parts that plays an important role in this process is also explained. -------------------------------------------- Visualized Data Manipulating System Mitsunori Wada and Nobuyoshi Miyazaki (Systems Lab., R&D Group) Abstract We are developing a visualized data manipulating system that can manipulate and process objects by displaying permanent objects in a windowing system, manipulating displayed objects by using such input devices as a keyboard and mouse. The user not only manipulates permanent objects, but can exchange messages between permanent objects, making visual programming possible. Also permanent objects that have new functions can be dynamically synthesized by combining multiple permanent data. This report clarifies the requirements for this system, describes the implementation method and features of this system, and explains future developments. ---------------------------------------------- Image Coding and Reproduction Osamu Asada (Human Interface Lab., R&D Group) Abstract This report describes the role of still images in human interfaces, and the image coding and reproduction technologies that have become critical in handling still images. Pseudo-tone process technology and color reproduction technology used for image reproduction are explained first, followed by a description of arithmetic coding as a coding technology. The report ends by advocating the integration of image reproduction and coding as a future direction. ---------------------------------------------------- Authoring and Playback System for Digital Video of if486VX Personal Computer Nobuhiko Ohama (Computer Systems Development Div., Computer and Networks Systems Group) Abstract We have developed an authoring and playback system for digital video for the if486VX PC that makes real time compression and decompression of full motion video, full color still images and speech data possible. In addition to video, still images and speech, this system can process such multimedia data as text and graphics in a PC windowing environment. Because this media now can be processed in a PC environment, an environment that can implement text and graphics is now provided. Application system development in new fields is expected. ------------------------------------------------ Brownie: Groupware Based on Electronic Mail Hidehiko Kita and Akihiro Okumura (Kansai Lab., R&D Group) Abstract Groupware is receiving attention as a new perspective of human interfaces. This paper explains Brownie, groupware that we are developing based on electronic mail, and explains basic groupware concepts in Bronwnie, and the configuration and group work flow in Brownie. ---------------------------------------------------- Human Interface for Auto Teller Terminal Systems Sakae Yamamoto (Dept. of Business Administration, Faculty of Economics, Dokkyo Univ.) et al. Abstract We regard automated teller machines widely used by the public as a total system that integrates a cash service corner and the hardware and software of automated equipment. Development of such machines are based on consistent design concepts, where critical factors include not only the human engineering considerations of hardware that do not physically tire the user, but software as well. This includes methods of matching operations that a user expects or assumes on an operation screen, and equipment guidance screens so that operations become easier. We researched the software ergonomic aspects of these factors and developed the AT-300 series of automated equipment. -------------------------------------------------- Human Interface for Video Phones and Video Conferencing Systems Kenji Koro (Transmission Systems Div., Telecommunications Group), et al. Abstract The use of video phones and video conferencing systems based on CCITT standards are advancing as audio visual communication devices that support the current advanced information oriented society. These systems allow users to take a step forward toward communication ideals, anytime, anywhere with anyone, and can be implemented by fully utilizing band width (CODEC) technologies for such information formats as image and speech. Users demand system configurations that allow them to easily and naturally use systems. This report describes an outline of the human interface technologies in Oki systems. --------------------------------------------------------- Human interface for Mobile Telephones Shigeya Kuriki (Mobile Communications Div., Mobile Communication Systems Group), et al. Abstract Mobile and portable telephones are the terminals of a mobile communications network. Usage when moving is a new aspect that has been added to human interfaces in phones. This report explains such aspects with specific examples for mobile and portable phones, describing these aspects in product design. ------------------------------------------------------- A Consideration of Visuality and Operability Concerning Automotive Information Equipment Yoshikazu Hirao (Automotive Electronics Systems Div., Public Systems Group), et al. Abstract From a safety point of view, we examined various problems that occur when a driver view and operates such information equipment as meters and navigation devices in a special environment while driving. Recently, we made some improvements to enhance visuality and operability with attention to these considerations. According to evaluation results when improved navigation devices were installed in an automobile, good results were seen in response, clarity and operability, and we were able to acquire basic data for human interfaces of automotive information equipment that will see further development in the future. ---------------------------------------------------------- Application of Speech LSIs for Human Interfaces Yoshikata Shiratori (Logic LSI Div., Electronic Devcices Group), et al. Abstract From a user friendly point of view, we have developed many multi- function speech synthesis LSIs that have high speed features and minimal peripheral components, utilizing aspects of the ADPCM method, one speech synthesis technology. This report briefly introduces speech LSIs and application examples in various systems, and explains future trends in speech synthesis LSIs from a human interface standpoint. ----------------------------------------------- TITLES/ABSTRACTS OF OTHER ARTICLES, INCLUDED FOR COMPLETENESS Pretreatment of Si Substrates for Si_{1-x}Ge_x Heteroexpitaxial Growth Kinya Ashikaga (Semiconductor Technology Lab., R&D Group), et al. Abstract We researched Si_{1-x}Ge_x hetero-expitaxial growth to implement hetero-structure devices such as hetero-bipolar transistors (HBT) using Si. After introducing Si substrates that were cleaned with diluted hydroflouric acid into a reaction furnace, we processed substrates using SiH4 gas, and continuously formed Si_{1-x}Ge_x thin film. We discovered that surface morphology and crystal growth improved considerably compared to directly forming Si_{1-x}Ge_x thin film on substrates. We also discovered that epitaxial Si layers are formed during SiH4 processing, and the crystal properties of Si_{1- x}Ge_x thin film on epitaxial Si layers are better than on substrate epitaxial Si layers. This reports explains the effect of this new substrate pre-treatment method, and the reasons for improvement. ----------------------------------------------------- Development of Advanced 0.8mu-m Sea Gates Tadao Takahashi (Logic LSI Div., Electronic Devices Group) Abstract We developed the MSM 30S family, high speed-high integration sea of gate LSIs, using a 0.8mu-m gate length 3-layer metal CMOS structure micro-process technology. This product has 65% higher integration and is about 20% faster than MSM 10S family of conventional 0.8mu-m 2- layer metal sea of gate LSIs. During development we shortened the development period by fully utilizing the design capabilities of the MSM 10S family. This report describes the design technology, an evaluation of the characteristics of the sea of gates LSI developed, and the processing technology used. --------------------------------------------------------- Single Chip Microcontroller MSM66507 for Automotive Systems Jiro Kobayashi (Logic LSI Div., Electronic Devices Group) Abstract We developed MSM66507, a single-chip microcontroller for automotive systems, that has higher speeds and higher performance than conventional products. In MSM66507, a 16-bit nX-8 /500 core CPU, and peripheral functions that include ROM, RAM, I/O ports and a flexible timer are integrated to a single chip that is mounted to an 84-pin PLCC package. The chip runs on a proprietary 32 MHz clock. This report describes the features of the 16-bit nXS8 /500 core CPU, the features of MSM66507, and the design policy, program development support system and application examples. ----------------------------------------------------------- 4 M-bit Low Power SRAM Noboru Egawa (Memory LSI Div., Electronic Devices Group), et al. Abstract We developed a 4 M-bit SRAM using 0.5mu-m CMOS technology. Polysilicon PMOS was used as the load device for memory cells, which allowed the current consumption during standby to be controlled to 10 muA. We also implemented low power consumption and high speed operation by improved circuit technology, making a 3V power voltage possible. By integrating about 25 million components to a 7.90 x 17.36 mm^2 chip, this device could be mounted to a TSOP-II package. ---------------------------------END OF REPORT-------------------------