Method and system for processing and presenting on-line, multimedia information in a tree structure

Abstract

Method and system are provided for processing and presenting on-line, multimedia information such as diagnostic information for a machine tool. The system uses multimedia information tools (i.e. graphics, documentation, drawings, photographs, full motion video with audio, PLC ladder, etc.) and techniques to assist maintenance personnel. Diagnostic development and multimedia information assignment are accomplished through graphical visual programming, which requires no conventional software programming efforts. The system uses diagnostic trees having multimedia graphic icons which define the diagnostic components. In developing a visual diagnostic tree, the multimedia information can be assigned or mapped to each node of the tree by selecting an appropriate icon to represent the multimedia from an icon library. Then, an appropriate media information file or record and comments for that icon are further added to define that node assignments. The system is user friendly, uses conventional hardware and can be used on the plant floor. The system is immediately executable and is generic. The method and system can also be used for training, process planning, marketing, sales, help desk applications, other machine diagnostics, and engineering design.

Claims

We claim: 1. A method for processing and presenting multimedia diagnostic information as a diagnostic tree structure including branches having a plurality of nodes and node-connecting links in a computer system, the method comprising the steps of: displaying multimedia diagnostic commands representative of various types of multimedia diagnostic information; conveying multimedia diagnostic information to a user of the system; storing a multiplicity of diagnostic information records mapped into the diagnostic tree structure, the diagnostic information records including: information records denoting the text strings to be displayed; information records denoting the multimedia commands to be displayed; and information records denoting the multimedia diagnostic information to be presented; receiving an initial command; displaying a graphical representation of a plurality of nodes including a question and answer node of the diagnostic tree structure including at least one text string in response to the initial command; displaying a plurality of multimedia diagnostic commands corresponding to the question and answer node; receiving a user command related to one of the displayed multimedia diagnostic commands; and presenting a selected amount of the multimedia diagnostic information to the user of the system in response to the user command. 2. The method as claimed in claim 1 wherein at least a portion of the multimedia information is stored in analog form. 3. The method as claimed in claim 1 wherein at least a portion of the multimedia information is stored in digital form. 4. The method as claimed in claim 1 wherein the at least one selected node is a question and answer node. 5. The method as claimed in claim 1 wherein the nodes of the tree structure include question and answer and branch jump nodes. 6. The method as claimed in claim 1 wherein the nodes of the tree structure include question and answer, branch jump and solution nodes. 7. The method as claimed in claim 1 wherein the multimedia information includes video images. 8. The method as claimed in claim 1 wherein the multimedia information includes sound messages. 9. The method as claimed in claim 1 wherein the multimedia information includes drawing images. 10. The method as claimed in claim 1 wherein the multimedia information includes graphical images. 11. The method as claimed in claim 1 wherein the multimedia information includes images of documents. 12. The method as claimed in claim 1 wherein a multiplicity of digitized video images is stored, each of the stored video images corresponding to one or more pieces of equipment from a predefined set of pieces of equipment. 13. The method as claimed in claim 1 wherein the multimedia commands are displayed in the form of graphic icons. 14. The method as claimed in claim 1 wherein the initial command is a user command. 15. The method as claimed in claim 1 wherein the selected nodes of the tree structure are displayed. 16. The method as claimed in claim 1 wherein the information records further include means for denoting graphical images to be displayed. 17. A system for processing and presenting multimedia diagnostic information as a diagnostic tree structure including branches having a plurality of nodes and node-connecting links in a computer system having tree display means for displaying a graphical representation of nodes of the tree structure, the system comprising: command display means for displaying multimedia diagnostic commands representative of various types of multimedia diagnostic information; multimedia output means for providing multimedia diagnostic information to a user of the system; a knowledge base for storing a multiplicity of diagnostic information records mapped into the diagnostic tree structure, the diagnostic information records including: information records denoting the text strings to be displayed on the tree display means; information records denoting the multimedia commands to be displayed on the command display means; and information records denoting the multimedia information to be presented by said multimedia output means; means for receiving an initial command, the tree display means displaying a plurality of nodes including a question and answer node of the tree structure including at least one text string in response to the initial command, and the command display means displaying a plurality of multimedia diagnostic commands corresponding to the question and answer node on the command display means; and means for receiving a user command related to one of the displayed multimedia diagnostic commands, the multimedia output means presenting a selected amount of the multimedia diagnostic information to the user of the system in response to the user command. 18. The system as claimed in claim 17 wherein the knowledge base references at least a portion of the multimedia information stored in analog form. 19. The system as claimed in claim 17 wherein the knowledge base stores at least a portion of the multimedia information in digital form. 20. The system as claimed in claim 17 wherein the computer system is an expert computer system. 21. The system as claimed in claim 17 wherein the at least one selected node is a question and answer node. 22. The system as claimed in claim 17 wherein the nodes of the tree structure include question and answer and branch jump nodes. 23. The system as claimed in claim 17 wherein the nodes of the tree structure include question and answer, branch jump and solution nodes. 24. The system as claimed in claim 17 wherein the multimedia output means includes video display means for displaying video images. 25. The system as claimed in claim 17 wherein the multimedia output means includes sound generating means for generating sound messages. 26. The system as claimed in claim 17 wherein the multimedia output means includes drawing display means for displaying drawing images. 27. The system as claimed in claim 17 wherein the multimedia output means includes graphics display means for displaying graphical images. 28. The system as claimed in claim 17 wherein the multimedia output means includes document display means for displaying images of documents. 29. The system as claimed in claim 17 wherein the knowledge base stores a multiplicity of digitized video images, each of the stored video images corresponding to one or more pieces of equipment from a predefined set of pieces of equipment. 30. The system as claimed in claim 17 wherein the multimedia commands are displayed on the command display means in the form of graphic icons. 31. The system as claimed in claim 17 wherein the initial command is a user command. 32. The system as claimed in claim 17 wherein the tree display means, the command display means and the multimedia output means define a video display of the computer system. 33. The system as claimed in claim 17 wherein the tree display means includes branch display means for displaying the selected nodes of the tree structure. 34. The system as claimed in claim 17 wherein the information records further include means for denoting graphical images that can be displayed on the tree display means. 35. A method for creating a diagnostic tree structure for processing and presenting multimedia diagnostic information, said tree structure including branches having a plurality of nodes and node-connecting links in a computer system, the method comprising the steps of: displaying multimedia diagnostic commands representative of various types of the multimedia diagnostic information; providing the multimedia diagnostic information to the system; inputing the multimedia diagnostic information to the computer system; storing the multimedia diagnostic information; storing a multiplicity of diagnostic information records mapped into the diagnostic tree structure having a plurality of nodes including a question and answer node, the diagnostic information records including: information records denoting text strings to be graphically displayed; information records denoting multimedia commands to be displayed; and information records denoting the multimedia diagnostic information to be presented; and assigning the stored multimedia diagnostic information to one or more of the diagnostic information records. 36. A system for creating a diagnostic tree structure for processing and presenting multimedia diagnostic information, said tree structure including branches having a plurality of nodes and node-connecting links in a computer system having tree display means for displaying a graphical representation of nodes of the tree structure, the system comprising: a computer system, the computer system including: command display means for displaying multimedia diagnostic commands representative of various types of the multimedia diagnostic information; multimedia output means for providing the multimedia diagnostic information to a user of the system; multimedia input means for providing the multimedia diagnostic information to the system; multimedia storage means for storing the multimedia diagnostic information in the form of a knowledge base, the knowledge base storing a multiplicity of diagnostic information records mapped into the diagnostic tree structure having a plurality of nodes including a question and answer node, the diagnostic information records including: information records denoting text strings to be graphically displayed on the tree display means; information records denoting multimedia commands to be displayed on the command display means; and information records denoting the multimedia information to be presented by said multimedia output means; and means for assigning said stored multimedia diagnostic information to at least one information record.
CROSS-REFERENCE TO RELATED APPLICATION This application relates to U.S. patent application U.S. Ser. No. 07/952,211 entitled "Method And System For Diagnosing Machines" filed on the same day as this application, having the same assignee, and which is hereby expressly incorporated in its entirety by reference. TECHNICAL FIELD This invention relates to methods and systems for processing and presenting multimedia information and, in particular, to methods and systems for processing and presenting on-line, multimedia information such as diagnostic information for a machine tool in a tree structure. BACKGROUND ART There exists a need for timely delivery of diagnostic information for machine tools such as stamping presses. As illustrated in FIG. 1, the need is the greatest when the press is first delivered. As time passes, the plant personnel become more experienced and less dependent on a diagnostic system. The key is continually to have the proper tools present to minimize press down time, regardless of the need. Based on these observations, the machine tool manufacturer must develop the diagnostic aid as the press is being designed if this goal is going to be achieved. Current expert systems and/or artificial intelligence technology tools can not meet the above direction, goals and design needs. The deficiency is in the ability to allow end users to build and maintain diagnostics, especially as the plant machinery goes through modification. Based on the current state of software/hardware technology (i.e. object oriented), there exists a need for a new method and system which uses this technology in a novel way for capturing, preserving and delivering machine tool diagnostic and support information. The U.S. patent to Isle et al. (U.S. Pat. No. 4,931,950) discloses a multimedia interface method for a knowledge-based diagnostic system. The knowledge-based system stores multimedia commands to control multimedia outputs for presenting information to users. The U.S. patent to Tsumura (U.S. Pat. No. 4,954,969) discloses a system for processing multimedia information in a easily usable form. The U.S. patent to Singh (U.S. Pat. No. 4,954,964) discloses an apparatus and method for expert analysis of metal failure with automated visual aid. The invention combines an expert system with a video or photographic display system. The U.S. patent to Rutherfoord et al. (U.S. Pat. No. 4,893,256) discloses an interactive multimedia presentation system and a method for developing the presentation. The U.S. patent to Bodick et al. (U.S. Pat. No. 4,945,476) discloses a knowledge-base system with stored pictorial images for use in medical diagnostic environments. The prior art discloses the use of icons in various systems. For example, the U.S. patent to Nose et al. (U.S. Pat. No. 5,025,395) discloses a data processing system which employs icons to represent various functions of the system. The U.S. patent to Wexelblat et al. (U.S. Pat. No. 5,021,976) discloses a method and system for generating dynamic, interactive visual representations of information structures. The patent teaches the use of iconic representations in an information system. The U.S. patents to Dunn (U.S. Pat. Nos. 4,656,603 and 4,813,013) disclose interactive rule based systems employing icons. The system generates and stores a specific set of rules pertaining to the use of each icon. The paper entitled "The Relationship Between Multimedia And Expert Systems" by John Coyne, discloses a philosophy to using an expert system and multimedia but fails to provide many details. The U.S. patent to Franke et al. (U.S. Pat. No. 4,710,763) discloses a method of constructing and developing a tree structure. An operator is capable of performing editing and evaluating functions on the tree. The U.S. patent to Watson et al. (U.S. Pat. No. 4,902,469) discloses apparatus for producing a discrete state display including status trees and status tree node operations. SUMMARY OF THE INVENTION An object of the present invention is to provide a method and system for processing and presenting on-line, multimedia information in a tree structure. Another object of the present invention is to provide a relatively simple and flexible method and system for processing and presenting on-line, multimedia information such as diagnostic information for a machine tool wherein initial diagnostic knowledge and documentation (such as drawings) are electronically captured as designers are designing the machine tool, which eliminates any possible loss or re-engineering of this information at a later time. In carrying out the above objects and other objects of the invention, a method for processing and presenting multimedia information in a tree structure including branches having a plurality of nodes and node-connecting links in a computer system having a tree display for displaying nodes of the tree structure is disclosed. The method includes the step of providing a command display for displaying multimedia commands representative of various types of multimedia information. The method also includes the step of providing a multimedia output which provides multimedia information to a user of the system. The method further includes the step of providing a knowledge base for storing a multiplicity of information records mapped into the tree structure. The information records include means for denoting the text strings that can be displayed on the tree display, means for denoting the multimedia commands that can be displayed on the command display, and means for denoting the multimedia information that can be presented by the multimedia output. In response to a received initial command, at least one selected node of the tree structure is displayed including at least one text string on the tree display. A plurality of multimedia commands corresponding to the at least one selected node is displayed on the command display. After a user command related to one of the displayed multimedia commands is received, a selected amount of the multimedia information is delivered to the multimedia output in response thereto for presentation to the user of the system. A system is also provided for carrying out each of the above method steps. Preferably, the multimedia commands are displayed on the command display in the form of graphic icons. The above objects and other objects, features, and advantages of the present invention are readily apparent from the following detailed description of the best mode for carrying out the invention when taken in connection with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a graph illustrating the interrelationship of the need for diagnostic information to press development time and press operational time; FIG. 2 is a schematic diagram illustrating the architecture of the system of the present invention including a diagnostic system coupled to a database of machine-specific knowledge and support information; FIG. 3 is a schematic diagram of a diagnostic tree and multimedia mapping of the present invention; FIG. 4 is a schematic view of the hardware of the system; FIG. 5 is a schematic view of the software of the system; FIG. 6 is a schematic block diagram of a diagnostic tree and presentation server structure of the present invention; FIG. 7 is a schematic view of an example question and answer (Q and A) screen in text format; FIG. 8 is a schematic view of an example question and answer screen in graphics-with-text format; FIG. 9 is a schematic view of a presentation server screen; FIG. 10 is a schematic view of a diagnostic branch (edit) screen; FIG. 11 is a graphical view of a presentation server edit screen or multimedia definition screen; FIG. 12 is a graphical view of a screen illustrating diagnostic tree development with multimedia icon edit; FIG. 13 is a graphical view of a media selection server; FIG. 14 is a graphical view of an initial application screen; FIG. 15 is a graphical view of a standard Q and A screen similar to FIG. 8; FIG. 16 is a graphical view of a multimedia view screen similar to FIG. 9 with video selected; FIG. 17 is a graphical view of a documentation view screen; FIG. 18 is a graphical view of a screen for a drawing; FIG. 19 is a graphical view of a screen for still video; FIG. 20 is a graphical view of a screen for full motion values; and FIG. 21 is a graphical view of a solution screen. BEST MODE FOR CARRYING OUT THE INVENTION Referring now to the drawing figures, there is schematically illustrated in FIG. 2 a system including a generic core of software and hardware, which is referred to below as a diagnostic system 20 for use with a machine tool such as a press. To give life to the diagnostic system 20 for a unique machine tool diagnostic solution requires specific machine tool diagnostic knowledge and support information (referred to below as a database 22). The architecture of the system illustrated in FIG. 2, shows three primary components of the system: the diagnostic system 20, a knowledge acquisition tool 24, and the database 22. The diagnostic system 20 is dependent on the data to enable it as an application. The data in the database 22 includes machine tool specific diagnostic knowledge and support information (i.e. drawings and video) which is stored in the form of information records. The machine tool support information provides alternative methods of communication and documentation necessary to properly inform the end user while doing his or her job. Another important aspect of this architecture is that the machine specific support information can be stored in its original format (for example, Wordperfect). There is no need to translate or re-engineer the information, thus reducing development time, expense and effort. The knowledge acquisition tool 24 of the present invention is relatively simple and intuitive to use; provides graphical representation of diagnostics knowledge; and provides mapping of machine tool related support information. The tool 24 represents the knowledge in graphical trees (or diagnostic trees). Within a tree there are several questions and answers, and solution nodes as illustrated in FIG. 3. Nodes can be grouped together into branches, making the diagnostic tree more modular and reusable. There is no software programming involved in building the trees or mapping the support knowledge--it is performed through graphical visual programming. Training to use of the diagnostic tool can be accomplished relatively quickly. The procedure is similar to using a computer drawing package, by graphically selecting and placing objects (denoted by boxes), asserting text (questions & answers), linking boxes and assigning support information to respective nodes as illustrated in FIG. 3. Training to build and maintain diagnostic trees, and assign or edit machine specific support information can also be accomplished relatively quickly. The method and system of the present invention preferably utilizes an IBM PC platform that operates under DOS 5.0 and Windows 3.0. This platform provides a rich design environment and option flexibility. The target system preferably includes, at a minimum, an IBM 386/486 or compatible computer with a 200 Mb hard drive, 8 Mb of RAM, VGA display, Video card, a computer controlled VCR, optional speakers, and a direct connection to a press PLC network as illustrated in FIG. 4. There is illustrated in FIG. 5, a software portion of the system. The software includes commercially available software and one custom piece of software called a presentation server 26. The Windows 3.0 environment allows multiple software package to run concurrently and communicate between themselves. Communication between the software packages leverages the software packages functionality into a integrated solution and minimizes software development. The diagnostic system 20, the knowledge acquisition tool 24 and the database 22 are preferably incorporated in a software package called "Advisor" provided by Emerald Intelligence of Ann Arbor, Mich. Advisor provides the environment to build and execute diagnostics. To assign (i.e. map) and present (i.e. display) multimedia information for each of the diagnostic tree nodes as illustrated in FIG. 6, Advisor communicates and interacts with the presentation server 26. The presentation server 26 then communicates with the media specific software packages (i.e. Microsoft Word for documentation media) to select and view. With this architecture, it is possible for each diagnostic node to have multimedia information assigned or mapped thereto thus improving the communication between the operator and the computer. The standard forms of multimedia utilized are: drawings, documentations, graphics, photographs, full motion video and audio, animation, sound, etc. For example, this approach can provide a better and easier means of on-line interactive repair and training procedures (i.e. by using full motion video) to the operator when a cause of the problem is determined. Also, because the architecture allows for the multimedia information to be used in its original format, there is no need to re-engineer the media information for it to be deliverable. Based on this software architecture, there are two system utilities: the runtime solution or utility referred to as RUNTIME and the diagnostic tree building solution or utility referred to as BUILDER, as also described hereinbelow. RUNTIME Within the RUNTIME software there are two forms of executing the diagnostics: PLC directed or operator step-by-step operation. The PLC directed approach involves the computer receiving a predefined PLC fault code relative to a press malfunction. Once the PLC fault is recognized, the software jumps to a specific assigned location in the diagnostic tree (the same diagnostic process can be completed using the operator step-by-step approach, discussed below). The benefit of this approach is to minimize operator-to-computer diagnostic dialogue and get to the cause of the problem as quickly as possible. The key limitation of this approach is that it only applies to sensory faults. Non-sensory faults will need to be diagnosed in the step-by-step approach. In either of the approaches (PLC directed or step-by-step), the operator is asked a series of questions until he reaches the cause of the press problem. In the step-by-step approach, the diagnostics always starts from the top of the tree. Answers for questions are presented in one of two formats: text or graphics with text. The text type answer is a traditional format illustrated in FIG. 7, and is the easiest to generate and least time-consuming. The graphics with text, as illustrated in FIG. 8, is a format that conveys the message faster and with less effort for the operator, but does take more development time because of the graphic development. Both of the answer formats can be intermixed in the diagnostics, but are defined and fixed in the diagnostic at the time of tree development. Another important feature in both the Question & Answer formats is the placeholders. The placeholder reminds the operator of the path that has been chosen and allows the operator to "Back Up" to a previous diagnostic screen. Also, at any time during the diagnostic session, if related machine specific support information has been assigned to a particular question & answer or solution screen, an "i" button is displayed in the upper left hand corner as illustrated in FIGS. 7 and 8. By selecting the "i" button, the presentation server 26 is activated as illustrated in FIG. 9, which allows the operator to view the different assigned media relative to that node function in the form of multimedia commands. More detail on the use of the runtime solution is described hereinbelow. BUILDER BUILDER allows one to define and/or maintain machine diagnostic trees (a graphical representation of a diagnostic decision step or flow) and assign multimedia machine information to the respective tree node. To briefly demonstrate the ease and simplicity of creating a diagnostic tree, reference may be made to FIG. 10. Diagnostic trees are made up of branches. Branches are made up of four primary components: Question & Answer (Q&A) nodes Solutions nodes Branch jump nodes links or lines. The Q&A node states a question with an unlimited number of answers. The solution node states the cause of the problem and needed repair for the cause of the problem. To assign a Q&A node (or solution node), a point mark is first located on the screen (click mouse) where one would like to place the node. Second, the type of node is selected from the above screen menu select: OBJECT-CREATE-SYMPTOM for Q&A node, or OBJECT-CREATE-SOLUTION for a solution node. This procedure places the object node on the screen as previously marked. To fill in the node name, the Q&A, or solution text information, the node is selected with the mouse pointer and the text is entered. Graphical answers with text can alternatively be used to replace the standard textual answers. To add more answers to a Q&A node, the node is selected and then OBJECT-ADD VALUE/TEST is selected from the menu screen. To link an answer to the next question or solution, a right arrow icon is selected in the preferred answer box then the mouse pointer is dragged to the respective question, branch or solution and the mouse button is released. This places a link or line between the two object nodes. The above steps are repeated until the desired tree is built. Objects within a screen can freely be moved around, primarily for appearance and readability, without effecting the linking. Anytime while editing a tree, one can run the diagnostics by selecting from the screen menu, FILE-RUN TEST. This will bring one into the RUNTIME (test mode) with the current tree information. To define machine specific multimedia information for any of the Q&A and solution nodes, one needs to access the presentation server screen. First, one double click on "?" in the Q&A box or just on the solution box. This brings up the question or solution editor screen and then one enters CTRL and → keys, which brings up the presentation server (screen illustrated in FIG. 11). The keys do this by executing a recorded Windows 3.0 macro. To assign the desired media (documentation, drawing, photograph or video), the button on the left is selected. A file directory box (not shown) pops up to allow one to look up the hard disk for the desired file. Once the file is selected, there is an opportunity to preview the material, define required additional information (i.e. page number within a documentation) and assign comment information before mapping. When the media is selected, it is listed in the appropriate media box as illustrated in FIG. 11. There are, preferably, five different choices of material for each of the forms of media. When all the media is assigned, OK is entered to return to the builder screen. Building Diagnostic Trees And Assigning Multimedia Information Using Graphic Icons The process here is similar to the above BUILDER process but is simpler to generate trees and assign multimedia information. There is also the use of more graphic icons (i.e. see the solution block of FIG. 12) instead of menu selections. STEP 1: To an assign symptom block (Q&A block) or solution block, an icon on the left in FIG. 12 is first selected, and located on the right side or work area of FIG. 12. To fill in the Q&A or solution block text information name, the block field with the mouse pointer is selected and the text is entered. To link an answer to the next question or solution, the link icon is selected and the respective blocks are connected. This places a link or line between the two blocks. The above steps are repeated until the desired tree is built. Blocks within a screen can freely be moved around, primarily for appearance and readability, without effecting the linking. The use of icons is a unique method for building diagnostic trees and defining multimedia information. Prior solutions required menu selections or involved accessing other screens. STEP 2: To define machine specific multimedia information for any of the Q&A and solution blocks, a media icon of choice is selected on the left side of the screen of FIG. 12. This media icon is placed near a Q&A or solution block of choice and is then linked to the desired block. By reselecting an assigned media icon on the right side, a media selection screen pops up as illustrated in FIG. 13. Once the file is selected, there is the opportunity to preview the material, define required additional information (i.e. page number within a documentation) and assign comment information before mapping. This step is unique, because of the use of direct visual aids (icons) and programming to assign the media to its respective block. This process is simpler than prior solutions because everything is accomplished on one screen. The media remains in its natural format and does not require any re-engineering. STARTUP First one turns on the computer power or reboots the system. After a few minutes (software applications are being loaded), the first screen of the system as illustrated in FIG. 14 is displayed. This initial Question & Answer node is displayed on a tree display portion of the screen. This initial node requests one to select what transfer press subsystem (Feeder, Press or Destacker) has a problem. After selection in response to an initial command, additional Question & Answer screens are displayed until one reaches a solution screen or node. Details of each of the different types of screens and their operations are described hereinbelow. QUESTION AND ANSWER SCREEN The diagnostic screen of FIG. 15 is an example of a Question & Answer (Q&A) screen. The standard Q&A screen is broken down into three major components: the question, the answer, and the placeholder. Also, in some of the Q&A screens, the Info Button is displayed, as highlighted in FIG. 15, which means that there is additional multimedia information defined with the question. QUESTION BOX For each diagnostic screen, there is a question posted and thus must be answered. The question is typically stated in text format only. ANSWER AREA In the answer area, there can be two types of answers: text or graphics with text as shown in FIG. 15. The next type is just a sentence as shown in FIG. 7. The graphics with text type shows a picture that represents the answer. To answer a question, the correct answer (line of text or picture) is selected. PLACEHOLDER Once an answer is selected, a box with a picture or text, is placed in the placeholder area or branch display portion of the tree display portion of the screen. These placeholder boxes represent the diagnostic path that has been taken. Selecting a placeholder box allows one to "BACKUP" to a previous diagnostic screen. INFORMATION By selecting the Info Button, "i", the multimedia presentation screen pops up, as shown in FIG. 9. This screen allows one to select desired media information (documentation, photographs, prints/drawings and full motion video) in response to the received user command. The multimedia information is there for the operator to help answer any questions or to explain testing or repair procedures about the current diagnostic screen. View Screen For Text Document The screen of FIG. 17 displays a text document, which can have embedded graphics, for a respective diagnostic screen. The whole page is not displayed. To view the other portions of the page, the arrow buttons (highlighted) are selected to move about the page. To look at the previous or next page within the document, the page symbol at the right hand side of the screen is selected (as highlighted). Finally, to exit and return back to the diagnostic screen "File" is selected from the menu and then "Done" is chosen from the "File Menu." View Screen For Drawing The screen of FIG. 18 displays an AutoCad drawing file (also called a print) and predefined views within an AutoCad file. These drawings can be an electrical, pneumatic, hydraulic or mechanical drawing. To exit the drawing, the screen is touched. View Screen For Still Video By selecting any of the still video (same as a photograph) buttons (the camera icon), the image is displayed in the top left side of the screen. An associated comment about the still video may be displayed above the still buttons as illustrated in FIGS. 16 and 19. View Screen For Full Motion Video By selecting any of the full motion video buttons (the video tape icon), the video image is displayed in the top left side of the screen as illustrated in FIG. 20. Prior to displaying the video, a comment is displayed at the top of the box. This gives the operator the chance to determine if it is the right video to view. If not, another video button is selected. If it is the right video, the VIEW button is selected and the VCR will start searching for the tape segment under control of the computer. Once the video is found, it is displayed in the upper left side of the screen. Volume (if speakers are attached) and brightness can be adjusted while monitoring video tape. Two other video control buttons allow the audio to be muted and the video to be frozen (the VCR is still playing at this time and only the image on the screen is frozen). To exit once the video is completed, the DONE button is selected in the video control box. Solution Screen When the last node, or the Solution, has been reached, the screen of FIG. 21 is displayed. If there is any help information assigned at this node, the help information is displayed first. At this point, one can still back up if needed or save this particular diagnostic session in a session file (*.SES). To save session To save current session from the top to current node, File-Save Session menu is selected. The appropriate file name is typed in. The default file extension is (*.SES). To restore session To restore a previously saved diagnostic session, File-Restore Session menu is selected. Then, the session file name is selected. By restoring session, one can trace the previous path or immediately return to the solution node. The system as described herein below diagnoses three primary components of a machine tool such as a transfer press: the press, the feeder, and the destacker. The press and the feeder diagnostic trees and related information are included. The press and feeder trees may address as many as 143 primary symptoms that include approximately 800 nodes. Building these two trees and accumulating and assigning the multimedia information is relatively straight forward after the paper, drawings and documentation were converted into electronic format. The method and system can be used to visually locate components on a large and complex transfer press. This has a significant impact in reducing the repair time because plant electricians can immediately locate defective component(s). The method and system is not limited to stamping press diagnostics, but may be used for other forms of diagnostics (i.e. other plant machinery and office applications) and for use on non-machine diagnostics (i.e. process diagnostics or as engineering design aid). The method and system provide the following advantages for use with a press: machine diagnostics when the machine is delivered; better transfer of technology and documentation from the vendor to the customer; reduced press down time; reduced diagnostic and repair time; better informed repair personnel, especially the apprentice; on-line training; better utilization of vendor/machine information; better service to the machine; the opportunity to capture new and refined diagnostic knowledge from plant personnel; reusability of information, that can be applied to other similar machines; and actual machine diagnostic flow and cause information can be captured to provide good feedback to the supplier with the hope of making better equipment and diagnostic models in the future. The method and system can be used to provide a multi-lingual solution. Using a stereo VCR, one audio track may contain information in a first language and the other audio track may contain information in a second language. Further, a multi-lingual solution is made possible through the selection of alternate keyboard assignments using the windows operating environment. The present system requires well disciplined and structured information management techniques to allow for ease of upgradeability, maintenance and adjustments. This process is also invisible and seamless to the people making these changes. The presented media information demands high storage space but can be used for other similar and identical machines. To optimize storage and decrease redundancy of information, there may be a centralized network/file server solution. While there is currently no clean way to store, retrieve and transmit analog information (video and audio) over a data network, a complete centralized library of machine information such as 2 and 3 dimensional animation, multi-language media, audible answers to diagnostic questions, speech, 3-D drawings, and a point-to-point distribution system can be accommodated when such is possible. While the best mode for carrying out the invention has been described in detail, those familiar with the art to which this invention relates will recognize various alternative designs and embodiments for practicing the invention as defined by the following claims.

Description

Topics

Download Full PDF Version (Non-Commercial Use)

Patent Citations (17)

    Publication numberPublication dateAssigneeTitle
    US-4656603-AApril 07, 1987The Cadware Group, Ltd.Schematic diagram generating system using library of general purpose interactively selectable graphic primitives to create special applications icons
    US-4710763-ADecember 01, 1987Texas Instruments IncorporatedMethod for generating and displaying tree structures in a limited display area
    US-4813013-AMarch 14, 1989The Cadware Group, Ltd.Schematic diagram generating system using library of general purpose interactively selectable graphic primitives to create special applications icons
    US-4893256-AJanuary 09, 1990International Business Machines CorporationInteractive video composition and presentation systems
    US-4902469-AFebruary 20, 1990Westinghouse Electric Corp.Status tree monitoring and display system
    US-4931950-AJune 05, 1990Electric Power Research InstituteMultimedia interface and method for computer system
    US-4945476-AJuly 31, 1990Elsevier Science Publishing Company, Inc.Interactive system and method for creating and editing a knowledge base for use as a computerized aid to the cognitive process of diagnosis
    US-4954964-ASeptember 04, 1990Singh Gurvinder PApparatus and method for expert analysis of metal failure with automated visual aide
    US-4954969-ASeptember 04, 1990Pfu LimitedSystem for processing various types of information in easily usable form
    US-5021976-AJune 04, 1991Microelectronics And Computer Technology CorporationMethod and system for generating dynamic, interactive visual representations of information structures within a computer
    US-5025395-AJune 18, 1991Hitachi, Ltd.Data processing system capable of executing data processing using resources by designating displayed graphic patterns representing selected resources
    US-5257185-AOctober 26, 1993Ann W. FarleyInteractive, cross-referenced knowledge system
    US-5267865-ADecember 07, 1993John R. LeeInteractive computer aided natural learning method and apparatus
    US-5295230-AMarch 15, 1994Racal-Datacom, Inc.Knowledge representation for expert system
    US-5297150-AMarch 22, 1994International Business Machines CorporationRule-based method for testing of programming segments
    US-5317732-AMay 31, 1994Commodore Electronics LimitedSystem for relocating a multimedia presentation on a different platform by extracting a resource map in order to remap and relocate resources
    US-5420977-AMay 30, 1995Vanderbilt University, Osaka Gas Co., Ltd.Multiple aspect operator interface for displaying fault diagnostics results in intelligent process control systems

NO-Patent Citations (1)

    Title
    The Relationship Between Multimedia And Expert Systems , by John P. Coyne, Multimedia Review, Summer 1991, pp. 13 16.

Cited By (273)

    Publication numberPublication dateAssigneeTitle
    US-5978784-ANovember 02, 1999Expert Systems Publishing Co.Computer-implemented decision management system with dynamically generated questions and answer choices
    US-7568126-B2July 28, 2009Evolium S.A.S.Controlled display mode diagnostic tool for communication networks using results of real tests and/or validation tests
    US-7171291-B2January 30, 2007American Calcar Inc.Technique for selecting a service provider to service a vehicle
    US-2007264622-A1November 15, 2007Accenture Global Services GmbhComputer Enabled Training of a User to Validate Assumptions
    US-7124366-B2October 17, 2006Avid Technology, Inc.Graphical user interface for a motion video planning and editing system for a computer
    US-7386524-B2June 10, 2008Accenture Global Services GmbhSimulation enabled focused feedback tutorial system
    US-8600830-B2December 03, 2013Steven M. HoffbergSystem and method for providing a payment to a non-winning auction participant
    US-7089222-B1August 08, 2006Accenture, LlpGoal based system tailored to the characteristics of a particular user
    US-6275231-B1August 14, 2001American Calcar Inc.Centralized control and management system for automobiles
    US-9621615-B2April 11, 2017Affinity Labs Of Texas, LlcSystem to communicate media
    US-7741959-B2June 22, 2010American Calcar, Inc.Centralized control and management system for automobiles
    US-6542794-B2April 01, 2003American Calcar Inc.Technique for effectively communicating information concerning vehicle service providers to a user
    US-6182249-B1January 30, 2001Sun Microsystems, Inc.Remote alert monitoring and trend analysis
    US-8523575-B2September 03, 2013Nextthinksoft Pty Ltd.Recalling items of information
    US-6259448-B1July 10, 2001International Business Machines CorporationResource model configuration and deployment in a distributed computer network
    US-6745170-B2June 01, 2004Indeliq, Inc.Goal based educational system with support for dynamic characteristic tuning
    US-5786816-AJuly 28, 1998Araxsys, Inc.Method and apparatus for graphical user interface-based and variable result healthcare plan
    US-6658398-B1December 02, 2003Indeliq, Inc.Goal based educational system utilizing a remediation object
    US-6059494-AMay 09, 2000Thermwood CorporationTool bit monitoring system for machine tools
    US-2008244398-A1October 02, 2008Lucinio Santos-Gomez, Haynes Thomas R, Cohen Gabriel ADirect Preview of Wizards, Dialogs, and Secondary Dialogs
    US-7523045-B1April 21, 2009Walker Digital, LlcMethod and apparatus for a cryptographically assisted commercial network system designed to facilitate and support expert-based commerce
    US-6016486-AJanuary 18, 2000Ac Properties B.V.System method and article of manufacture for a goal based system utilizing an activity table
    US-6587759-B2July 01, 2003American Calcar Inc.Technique for effectively providing information responsive to a notable condition in a vehicle
    US-2007112476-A1May 17, 2007American Calcar Inc.Centralized control and management system for automobiles
    US-8688085-B2April 01, 2014Affinity Labs Of Texas, LlcSystem and method to communicate targeted information
    US-9094802-B2July 28, 2015Affinity Labs Of Texas, LlcSystem and method to communicate targeted information
    US-2011191661-A1August 04, 2011Michael Phillips, Brian Cooper, Larisa FayEditing time-based media with enhanced content
    US-8626667-B2January 07, 2014Community United Ip, LlcMethod and apparatus for a cryptographically-assisted commercial network system designed to facilitate and support expert-based commerce
    US-6970858-B1November 29, 2005Accenture, LlpGoal based system utilizing an activity table
    US-8972289-B2March 03, 2015Skky IncorporatedMedia delivery platform
    US-6971070-B2November 29, 2005American Calcar Inc.Technique for automatic parking of a vehicle
    US-6587758-B2July 01, 2003American Calcar Inc.Technique for adopting an adjustment of a vehicle function
    US-6577928-B2June 10, 2003American Calcar Inc.Multimedia information and control system for automobiles
    US-5987443-ANovember 16, 1999Ac Properties B. V.System, method and article of manufacture for a goal based educational system
    US-6782374-B2August 24, 2004Accenture Global Services GmbhSystem, method and article of manufacturing for a runtime program analysis tool for a simulation engine
    US-2004036601-A1February 26, 2004Obradovich Michael LTechnique for operating a vehicle effectively and safely
    US-5893082-AApril 06, 1999Mccormick; John M.System for processing and presenting cost estimates in the construction industry
    US-5715412-AFebruary 03, 1998Hitachi, Ltd.Method of acoustically expressing image information
    US-9002549-B2April 07, 2015Talking Quick Tips, Inc.Multimedia information and control system for automobiles
    US-6703944-B1March 09, 2004American Calcar Inc.Technique for effectively maintaining a safe distance between a vehicle and an object
    US-2009222507-A1September 03, 2009Akira Koseki, Koichi TakedaMethod, system, and apparatus for supporting personal service
    CN-100463412-CFebruary 18, 2009阿尔卡特公司Device for optimizing diagnostic trees of a diagnostic tool of a communication network
    US-6438465-B2August 20, 2002American Calcar, Inc.Technique for effectively searching for information in a vehicle
    US-5826237-AOctober 20, 1998Araxsys, Inc.Apparatus and method for merging medical protocols
    US-9203870-B2December 01, 2015Skky IncorporatedMedia delivery platform
    US-5850221-ADecember 15, 1998Araxsys, Inc.Apparatus and method for a graphic user interface in a medical protocol system
    US-5892507-AApril 06, 1999Avid Technology, Inc.Computer system for authoring a multimedia composition using a visual representation of the multimedia composition
    US-7062362-B2June 13, 2006American Calcar Inc.Technique for preconditioning climate control in a vehicle
    US-7156665-B1January 02, 2007Accenture, LlpGoal based educational system with support for dynamic tailored feedback
    US-D665407-SAugust 14, 2012Microsoft CorporationDisplay screen with graphical user interface
    US-2007255805-A1November 01, 2007Accenture Global Services GmbhCreating a Virtual University Experience
    US-6628303-B1September 30, 2003Avid Technology, Inc.Graphical user interface for a motion video planning and editing system for a computer
    US-6011919-AJanuary 04, 2000Canon Information Systems Research Australia Pty Ltd., Canon Kabushiki KaishaMethod of providing efficiency to a graphical programming language with alternative form determination and cost of execution estimation
    US-6300950-B1October 09, 2001International Business Machines CorporationPresentation of help information via a computer system user interface in response to user interaction
    US-7280991-B1October 09, 2007Indeliq, Inc.Creating collaborative simulations for creating collaborative simulations with multiple roles for a single student
    US-6018731-AJanuary 25, 2000Ac Properties B.V.System, method and article of manufacture for a goal based system utilizing a spreadsheet and table based architecture
    US-6459961-B1October 01, 2002American Calcar, Inc.Technique for providing information upon a notable condition in a vehicle
    US-6064998-AMay 16, 2000Ac Properties, B.V.System, method and article of manufacture for a simulation engine with an expert system example processing engine
    US-2003120631-A1June 26, 2003Eastman Kodak CompanyMethod and system for hierarchical data entry
    US-6671655-B2December 30, 2003John A MoccioStrategy based diagnostic system
    US-9124717-B2September 01, 2015Skky IncorporatedMedia delivery platform
    US-6009420-ADecember 28, 1999Expert Systems Publishing Co.Computer-implemented decision management system with dynamically generated questions and answer choices
    US-2006200782-A1September 07, 2006American Calcar Inc.Centralized control and management system for automobiles
    US-6026386-AFebruary 15, 2000Ac Properties B.V.System, method and article of manufacture for a goal based educational system with support for dynamic media control
    US-8818173-B2August 26, 2014Avid Technology, Inc.Synchronous data tracks in a media editing system
    US-2009042175-A1February 12, 2009Accenture Global Services GmbhSimulation Enabled Accounting Tutorial System
    US-6125358-ASeptember 26, 2000Ac Properties B.V.System, method and article of manufacture for a simulation system for goal based education of a plurality of students
    US-5960419-ASeptember 28, 1999Expert Systems Publishing Co.Authoring tool for computer implemented decision management system
    US-6550055-B1April 15, 2003Intel Corp.Method and apparatus for cheating an information report resulting from a diagnostic session
    US-5737739-AApril 07, 1998Xerox CorporationSystem that accesses a knowledge base by markup language tags
    US-5883624-AMarch 16, 1999Matsushita Electric Industrial Co., Ltd.Document reference apparatus and method for displaying documents page by page and storage medium storing program used for realizing the apparatus and method
    US-7065513-B1June 20, 2006Accenture, LlpSimulation enabled feedback system
    US-7702455-B2April 20, 2010American Calcar, Inc.Personal communication system to send and receive voice data positioning information
    US-7499778-B2March 03, 2009American Calcar Inc.Technique for informing a user of a service provider for servicing a vehicle
    US-9319516-B2April 19, 2016Skky, LlcMedia delivery platform
    US-7065512-B1June 20, 2006Accenture, LlpDynamic toolbar in a tutorial system
    US-6677960-B1January 13, 2004Unisys CorporationUser assistance for heterogeneous data processing systems
    US-7337159-B2February 26, 2008Topiary Communications, Inc.System and method for sharing of expert knowledge
    US-7830547-B2November 09, 2010Xerox CorporationUser interface assistant
    US-7660778-B1February 09, 2010Accenture Global Services GmbhRuntime program analysis tool for a simulation engine
    US-7902969-B2March 08, 2011American Calcar, Inc.Technique for operating a vehicle effectively and safely
    US-7433852-B1October 07, 2008Accenture Global Services GmbhRuntime program regression analysis tool for a simulation engine
    US-2005203674-A1September 15, 2005Obradovich Michael L., Kent Michael L., Dinkel John G.Multimedia information and control system for automobiles
    US-6233506-B1May 15, 2001American Calcar Inc.Technique for effectively locating an object
    US-6260048-B1July 10, 2001Hewlett-Packard CompanyResolution of incidents which occur during the use of a product
    US-8554191-B2October 08, 2013Affinity Labs Of Texas, LlcSystem and method for managing media
    US-2006235793-A1October 19, 2006Walker Jay S, Bruce Schneier, Jorasch James AMethod and apparatus for a cryptographically-assisted commerical network system designed to facilitate and support expert-based commerce
    US-2006224537-A1October 05, 2006AlcatelDevice for optimizing diagnostic trees of a diagnostic tool of a communication network
    US-6018732-AJanuary 25, 2000Ac Properties B.V.System, method and article of manufacture for a runtime program regression analysis tool for a simulation engine
    US-8908567-B2December 09, 2014Skky IncorporatedMedia delivery platform
    US-6154128-ANovember 28, 2000Sun Microsystems, Inc.Automatic building and distribution of alerts in a remote monitoring system
    US-5623589-AApril 22, 1997Intel CorporationMethod and apparatus for incrementally browsing levels of stories
    CN-1878100-BJuly 09, 2014埃沃柳姆公司使用真实和/或验证测试结果的受控显示模式的诊断工具
    US-6029159-AFebruary 22, 2000Ac Properties B.V.System, method and article of manufacture for a simulation enabled accounting tutorial system
    US-7656310-B2February 02, 2010American Calcar Inc.Technique for operating a vehicle safely in a lane
    US-8892465-B2November 18, 2014Skky IncorporatedMedia delivery platform
    US-6341246-B1January 22, 2002Kuka Development Laboratories, Inc.Object oriented motion system
    US-7251789-B2July 31, 2007American Calcar Inc.Technique for accessing location-dependent information sources in a vehicle
    US-2005120127-A1June 02, 2005Janette Bradley, Gray Paul J., Glenn Lea, Phillips Michael E., Peter Scannell, Simms Dustin A.Review and approval system
    US-6003021-ADecember 14, 1999Ac Properties B.V.System, method and article of manufacture for a simulation system for goal based education
    US-6535861-B1March 18, 2003Accenture Properties (2) B.V.Goal based educational system with support for dynamic characteristics tuning using a spread sheet object
    US-2002122047-A1September 05, 2002Yoshiharu Dewa, Mitsuhiro MiyazakiDisplay controlling method, program and display controlling apparatus
    US-2004268224-A1December 30, 2004Balkus Peter A., Mcelhoe Glenn, Crofton T. Winton, Purcell Thomas C.Authoring system for combining temporal and nontemporal digital media
    US-7555557-B2June 30, 2009Avid Technology, Inc.Review and approval system
    US-2006006990-A1January 12, 2006American Calcar Inc.Technique for operating a vehicle effectively and safely
    US-6330497-B1December 11, 2001American Calcar Inc.Multimedia technique for operating devices in a vehicle
    US-6877115-B2April 05, 2005Sinapse Graphic InternationalInteractive on-line diagnostics for printing
    US-2006242580-A1October 26, 2006American Calcar Inc.Centralized control and management system for automobiles
    WO-0103101-A1January 11, 2001Link Resources (Qld) Pty. Ltd.Systeme de formation interactif
    US-8521140-B2August 27, 2013Affinity Labs Of Texas, LlcSystem and method for communicating media content
    US-2004056882-A1March 25, 2004Foreman Kevin J., Leblanc Darrell N., Granger Brett D., Cavero-Belaunde Ivan M.Graphical user interface for a motion video planning and editing system for a computer
    US-2008005240-A1January 03, 2008Knighton Mark S, Arney Shane R, Delaurentis Peter J, Moyer Todd CSystem to provide integrated on-line support
    US-6975932-B2December 13, 2005American Calcar Inc.Technique for maintaining a separation between a vehicle and a detectable object
    US-7621748-B2November 24, 2009Accenture Global Services GmbhComputer enabled training of a user to validate assumptions
    US-5781191-AJuly 14, 1998Fujitsu LimitedMethod and apparatus for reproducing operation guidance information, and method and apparatus for reproducing multi-media information
    US-5963931-AOctober 05, 1999Expert Systems Publishing Co.Computer-assisted decision management system
    US-5995101-ANovember 30, 1999Adobe Systems IncorporatedMulti-level tool tip
    US-7522979-B2April 21, 2009Oshkosh CorporationEquipment service vehicle having on-board diagnostic system
    US-8532641-B2September 10, 2013Affinity Labs Of Texas, LlcSystem and method for managing media
    US-6175782-B1January 16, 2001American Calcar Inc.System and method for adjusting climate control in vehicles
    US-2005030379-A1February 10, 2005Eugene Luskin, Andrew Petrochuk, David KizhnermanSmart vehicle video management
    US-9203956-B2December 01, 2015Skky IncorporatedMedia delivery platform
    US-7194444-B1March 20, 2007Indeliq, Inc.Goal based flow of a control presentation system
    EP-1319498-A2June 18, 2003Fette GmbHMéthode pour l'instruction d'un opérateur pour l'entretien et de réparation d'une presse pour comprimés
    US-2004162646-A1August 19, 2004American Calcar Inc.Multimedia information and control system for automobiles
    US-7930624-B2April 19, 2011Avid Technology, Inc.Editing time-based media with enhanced content
    US-6067537-AMay 23, 2000Ac Properties B.V.System, method and article of manufacture for a goal based educational system with support for dynamic personality feedback
    FR-2883086-A1September 15, 2006Alcatel SaDispositif d'optimisation d'arbres de diagnostic d'un outil de diagnostic d'un reseau de communication
    US-2006195232-A1August 31, 2006American Calcar Inc.Centralized control and management system for automobiles
    US-6073127-AJune 06, 2000Ac Properties B.V.System, method and article of manufacture for a goal based system with dynamic feedback information
    US-6611822-B1August 26, 2003Ac Properties B.V.System method and article of manufacture for creating collaborative application sharing
    US-7428518-B1September 23, 2008Accenture Global Services GmbhSimulation enabled accounting tutorial system
    US-6833847-B1December 21, 2004International Business Machines CorporationVisual wizard launch pad
    US-7124004-B2October 17, 2006American Calcar Inc.Technique for suggesting a service provider to service a vehicle
    US-2003200015-A1October 23, 2003Oshkosh Truck CorporationEquipment service vehicle having on-board diagnostic system
    US-2005191608-A1September 01, 2005Evolutioncode Pty Ltd.Recalling items of informaton
    US-6542795-B2April 01, 2003American Calcar Inc.Technique for providing information and control responsive to a request in a vehicle
    EP-1701473-A1September 13, 2006AlcatelDiagnostikgerät mit Baumdiagnostik-Optimierungseinrichtung für ein Kommunikationsnetzwerk
    US-6131060-AOctober 10, 2000American Calcar Inc.Method and system for adjusting settings of vehicle functions
    US-6067538-AMay 23, 2000Ac Properties B.V.System, method and article of manufacture for a simulation enabled focused feedback tutorial system
    US-9387760-B2July 12, 2016Talking Quick Tips, Inc.Multimedia information and control system for automobiles
    US-2005131595-A1June 16, 2005Eugene Luskin, Andrew Petrochuk, David KizhnermanEnhanced vehicle event information
    US-7417531-B2August 26, 2008American Calcar, Inc.Technique for monitoring a tire condition of a vehicle
    US-6542880-B2April 01, 2003Indeliq, Inc.System, method and article of manufacture for a goal based system utilizing a table based architecture
    US-6085184-AJuly 04, 2000Ac Properties B.V.System, method and article of manufacture for a dynamic toolbar in a tutorial system
    US-2006267929-A1November 30, 2006Obradovich Michael LCentralized control and management system for automobiles
    US-6028601-AFebruary 22, 2000Apple Computer, Inc.FAQ link creation between user's questions and answers
    US-6993513-B2January 31, 2006Indeliq, Inc.Interactive simulations utilizing a remote knowledge base
    US-6212449-B1April 03, 2001Crown Equipment CorporationDiagnosing malfunctions in materials handling vehicles
    US-7536363-B1May 19, 2009Accenture Global Services GmbhGoal based system, utilizing a table based architecture
    US-2002002449-A1January 03, 2002Sinapse Graphic InternationalInteractive on-line diagnostics for printing
    US-9124718-B2September 01, 2015Skky IncorporatedMedia delivery platform
    WO-2015006595-A1January 15, 2015Ifthisthen, Inc.Systems and methods for knowledge management
    US-2006224510-A1October 05, 2006Walker Jay S, Bryce Schneier, Jorasch James AMethod and apparatus for a cryptographically-assisted commerical network system designed to facilitate and support expert-based commerce
    US-8327263-B2December 04, 2012Microsoft CorporationMethod and system for caching presentation data
    US-2007168758-A1July 19, 2007Xerox CorporationUser interface assistant
    US-5666542-ASeptember 09, 1997Fujitsu LimitedMultimedia information add-on system
    US-5675753-AOctober 07, 1997U.S. West Technologies, Inc.Method and system for presenting an electronic user-interface specification
    US-7778595-B2August 17, 2010Affinity Labs Of Texas, LlcMethod for managing media
    US-9021041-B2April 28, 2015Nextpat LimitedSystem to provide integrated on-line support
    US-7463281-B2December 09, 2008Microsoft CorporationSmart vehicle video management
    US-7793219-B1September 07, 2010Adobe Systems Inc.Construction of multimedia compositions
    US-6282464-B1August 28, 2001American Calcar Inc.Technique for effectively providing audio information in a vehicle
    US-2006200781-A1September 07, 2006American Calcar Inc.Centralized control and management system for automobiles
    US-7519922-B2April 14, 2009American Calcar, Inc.Technique for effectively aiding a user to park a vehicle
    US-2004162645-A1August 19, 2004American Calcar Inc.Multimedia information and control system for automobiles
    US-6018730-AJanuary 25, 2000Ac Properties B.V.System, method and article of manufacture for a simulation engine with a help website and processing engine
    US-8326765-B2December 04, 2012Community United Ip, LlcMethod and apparatus for a cryptographically-assisted commercial network system designed to facilitate and support expert-based commerce
    US-2003011629-A1January 16, 2003Rouse Jennifer K., Meyers Chad D.System to provide instructional information
    US-7991825-B2August 02, 2011International Business Machines CorporationMethod, system, and apparatus for supporting personal service
    US-9794797-B2October 17, 2017Steven M. HoffbergMultifactorial optimization system and method
    US-5625572-AApril 29, 1997Fuji Facom Corp., Fuji Electric Co. Ltd.Multimedia process monitor and control system
    US-6134539-AOctober 17, 2000Ac Properties B.V.System, method and article of manufacture for a goal based education and reporting system
    US-7535344-B2May 19, 2009American Calcar, Inc.Technique for operating a vehicle effectively and safely
    US-7856410-B2December 21, 2010Accenture Global Services LimitedSimulation enabled retail management tutorial system
    US-6032141-AFebruary 29, 2000Ac Properties B.V.System, method and article of manufacture for a goal based educational system with support for dynamic tailored feedback
    US-8359007-B2January 22, 2013Affinity Labs Of Texas, LlcSystem and method for communicating media center
    EP-0994400-B1December 13, 2006Focke & Co. (GmbH & Co. KG)Method and device to display control instructions
    US-5760771-AJune 02, 1998At & T CorpSystem and method for providing structured tours of hypertext files
    US-6985889-B1January 10, 2006Topiary Communications, Inc.System and method for sharing of expert knowledge
    EP-1750393-A2February 07, 2007Evolium SasKommunikationsnetz-Diagnosewerkzeug mittels Testsergebnisse einer Baumdiagnostik
    US-7162370-B2January 09, 2007American Calcar Inc.Centralized control and management system for automobiles
    US-6549893-B1April 15, 2003Indeliq, Inc.System, method and article of manufacture for a goal based system utilizing a time based model
    US-6029158-AFebruary 22, 2000Ac Properties B.V.System, method and article of manufacture for a simulation enabled feedback system
    EP-1241586-A4January 28, 2004Seiko Epson CorpDispositifs de fourniture et d'utilisation de contenus
    US-9511765-B2December 06, 2016Auto Director Technologies, Inc.System and method for parking an automobile
    US-2003143515-A1July 31, 2003Reinhard Fromm-Ayass, Alastair Orchard, Uccelli Maria GiuseppinaIndustry specific suite system method & apparatus
    US-5886693-AMarch 23, 1999Araxsys, Inc.Method and apparatus for processing data across a computer network
    US-6101489-AAugust 08, 2000Ac Properties, B.V.System, method and article of manufacture for a goal based system utilizing a time based model
    US-8429112-B2April 23, 2013Accenture Global Services LimitedGoal based system utilizing a table based architecture
    US-2014279718-A1September 18, 2014Xerox Business Services, LlcMachine Assisted Troubleshooting of a Customer Support Issue
    US-7043699-B2May 09, 2006American Calcar Inc.Technique for effectively selecting entertainment programs in a vehicle
    US-6922616-B2July 26, 2005American Calcar Inc.Technique for effectively maintaining components of a vehicle
    US-2009177964-A1July 09, 2009International Business Machines CorporationVisual wizard launch pad
    US-9818136-B1November 14, 2017Steven M. HoffbergSystem and method for determining contingent relevance
    US-8626382-B2January 07, 2014Auto Director Technologies, Inc.Technique for operating a vehicle effectively and safely
    US-6237114-B1May 22, 2001Sun Microsystems, Inc.System and method for evaluating monitored computer systems
    US-2006212832-A1September 21, 2006American Calcar Inc.Centralized control and management system for automobiles
    US-6493690-B2December 10, 2002AccentureGoal based educational system with personalized coaching
    US-6987513-B2January 17, 2006Sony CorporationGraphical user interface utilizing a plurality of node processing means for view/drawing including analysis, selection, display control, view generation and re-generation
    US-2011153039-A1June 23, 2011Viktor Gvelesiani, Patrick Donald MurphySystem and method for providing diagnostic information and graphical user interface therefor
    US-9444868-B2September 13, 2016Affinity Labs Of Texas, LlcSystem to communicate media
    EP-1750393-A3July 11, 2007Evolium SasNetwork communication diagnostic tool using test results of diagnostic tree
    EP-1319498-A3May 12, 2004Fette GmbHVerfahren zur Instruktion einer Bedienperson bei Wartungs- und Reparaturarbeiten an einer Tablettenpresse
    US-6029156-AFebruary 22, 2000Ac Properties B.V.Goal based tutoring system with behavior to tailor to characteristics of a particular user
    US-9118693-B2August 25, 2015Skky IncorporatedMedia delivery platform
    US-2005277099-A1December 15, 2005Andrew Van Schaack, Lewis Andrew SSystem, apparatus and method for maximizing effectiveness and efficiency of learning, retaining and retrieving knowledge and skills
    US-9571449-B2February 14, 2017Auto Director Technologies, Inc.Technique for operating a vehicle effectively and safely
    US-2006148570-A1July 06, 2006Samuel LeopoldPortable data techniques for gaming devices
    US-7953390-B2May 31, 2011Affinity Labs Of Texas, LlcMethod for content delivery
    US-2004138867-A1July 15, 2004Simkins David JudsonSystem and method for modeling multi-tier distributed workload processes in complex systems
    US-2005216670-A1September 29, 2005Microsoft CorporationMethod and system for caching presentation data
    US-2006202808-A1September 14, 2006American Calcar Inc.Technique for operating a vehicle effectively and safely
    EP-0909494-A4April 06, 2005Walker Asset Man Ltd PartnershMethod and apparatus for a cryptographically-assisted commercial network system designed to facilitate and support expert-based commerce
    US-2003018609-A1January 23, 2003Michael Phillips, Brian Cooper, Larisa FayEditing time-based media with enhanced content
    US-2003084015-A1May 01, 2003Beams Brian R., Harris Scott B.Interactive simulations utilizing a remote knowledge base
    EP-0994400-A2April 19, 2000Focke & Co. (GmbH & Co.)Méthode et dispositif d'affichage d'instructions de commande
    US-6023692-AFebruary 08, 2000Ac Properties B.V.Goal based tutoring system with behavior to control flow of presentation
    US-2006095230-A1May 04, 2006Jeff Grier, Cancilla James J, Reddy Sunil P, Trsar Dale A, Lewis Bradley RMethod and system for enhancing machine diagnostics aids using statistical feedback
    US-2002072040-A1June 13, 2002Javier Bajer, Timothy GbedemahComputer enabled training of a user to validate assumptions
    EP-1241586-A1September 18, 2002Seiko Epson CorporationInhaltlieferndes gerät und inhaltverwendendes gerät
    US-9215310-B2December 15, 2015Skky IncorporatedMedia delivery platform
    US-7970379-B2June 28, 2011Affinity Labs Of Texas, LlcProviding broadcast content
    US-2006224509-A1October 05, 2006Walker Jay S, Bruce Schneier, Jorasch James AMethod and apparatus for a cryptographically-assisted commerical network system designed to facilitate and support expert-based commerce
    US-2006112055-A1May 25, 2006Tapio Thomas H, Clifford Wagner, Schramm Daniel MSystem and method for sharing of expert knowledge
    US-2004066395-A1April 08, 2004Foreman Kevin J., Leblanc Darrell N., Granger Brett D., Cavero-Belaunde Ivan M.Graphical user interface for a motion video planning and editing system for a computer
    US-6750879-B2June 15, 2004Intel CorporationMethod and apparatus for communicating cable modem problem demarcation through a graphical user interface
    US-6982635-B2January 03, 2006American Calcar Inc.Technique for assisting a vehicle user to make a turn
    US-6009355-ADecember 28, 1999American Calcar Inc.Multimedia information and control system for automobiles
    US-8559793-B2October 15, 2013Avid Technology, Inc.Synchronous data tracks in a media editing system
    US-2008185167-A1August 07, 2008Samsung Electronics Co., Ltd.Flat cable and electronic appliance having the same
    US-6023691-AFebruary 08, 2000Ac Properties B.V.Goal based stimulator utilizing a spreadsheet architecture
    US-6449535-B1September 10, 2002American Calcar, Inc.Method and system for adjusting a function in a vehicle
    US-2002199132-A1December 26, 2002Lachimia Joseph N., Mccracken GeorgeSystems and methods for a knowledge-based power assembly system component diagnostic tool
    US-7117189-B1October 03, 2006Accenture, LlpSimulation system for a simulation engine with a help website and processing engine
    US-2005165513-A1July 28, 2005Obradovich Michael L.Multimedia information and control system for automobiles
    US-6859687-B2February 22, 2005American Calcar Inc.Technique for temporal climate control in a vehicle
    US-6370683-B1April 09, 2002Arnold SobersComputer software for generating flowchart images of a source program
    US-6151683-ANovember 21, 2000Sun Microsystems, Inc.Rebuilding computer states remotely
    US-5864337-AJanuary 26, 1999Microsoft CorporationMehtod for automatically associating multimedia features with map views displayed by a computer-implemented atlas program
    US-9832304-B2November 28, 2017Skky, LlcMedia delivery platform
    US-7043702-B2May 09, 2006Xerox CorporationMethod for visualizing user path through a web site and a path's associated information scent
    US-8360787-B2January 29, 2013Accenture Global Services LimitedSimulation enabled accounting tutorial system
    US-2004071441-A1April 15, 2004Foreman Kevin J, Leblanc Darell N, Granger Brett D, Cavero-Belaunde Ivan MGraphical user interface for a motion video planning and editing system for a computer
    US-7054848-B1May 30, 2006Accenture, LlpGoal based system utilizing a time based model
    US-2006271380-A1November 30, 2006Chowdhury Seshadri SSystems and methods for managing product satisfaction
    FR-2786014-A1May 19, 2000Clotures Le Brun SarlSysteme de gestion des incidents pour portails industriels
    US-7549121-B2June 16, 2009International Business Machines CorporationVisual wizard launch pad
    FR-2886792-A1December 08, 2006Evolium Sas Soc Par Actions SiOutil de diagnostic de reseau de communication, a exploitation de resultats de tests reels et/ou de validation par mode d'affichage controle
    US-7176949-B1February 13, 2007Moser Albert NSystem, method and article of manufacture for an incremental explanatory object in a learning application assembly framework
    US-2002138590-A1September 26, 2002Beams Brian R., Harris Scott B.System method and article of manufacture for creating a virtual university experience
    US-2004027390-A1February 12, 2004Toshitaka Yamato, Tatsuo Ito, Shinichi HayashiControl system for electrical equipment, a software structure for GUI processing, and a method for providing a GUI for controlling an electrical equipment group
    US-2003093433-A1May 15, 2003Exegesys, Inc.Method and system for software application development and customizible runtime environment
    US-2005080528-A1April 14, 2005American Calcar Inc.Centralized control and management system for automobiles
    US-2009142736-A1June 04, 2009Accenture Global Services GmbhGoal Based System Utilizing a Table Based Architecture
    DE-19905630-A1August 17, 2000Deutsche Telekom AgVerfahren zur grafischen Darstellung und/oder Bearbeitung von Werten von Datentypen
    US-7725812-B1May 25, 2010Avid Technology, Inc.Authoring system for combining temporal and nontemporal digital media
    US-7152092-B2December 19, 2006Indeliq, Inc.Creating chat rooms with multiple roles for multiple participants
    US-2002188628-A1December 12, 2002Brian Cooper, Michael Phillips, Larisa FayEditing interactive content with time-based media
    US-2006274663-A1December 07, 2006Evolium S.A.S.Controlled display mode diagnostic tool for communication networks using results of real tests and/or validation tests
    US-7512495-B2March 31, 2009American Calcar, Inc.Centralized control and management system for automobiles
    US-9037502-B2May 19, 2015Skky IncorporatedMedia delivery platform
    US-2002130907-A1September 19, 2002Chi Ed H., Pirolli Peter L.T., Pitkow James E.Method for visualizing user path through a web site and a path's associated information scent
    US-8819535-B2August 26, 2014Avid Technology, Inc.Editing time-based media with enhanced content
    US-2006200285-A1September 07, 2006American Calcar Inc.Multimedia information and control system for automobiles
    EP-0909494-A1April 21, 1999Walker Asset Management Ltd. PartnershipMethod and apparatus for a cryptographically-assisted commercial network system designed to facilitate and support expert-based commerce
    US-9219810-B2December 22, 2015Skky IncorporatedMedia delivery platform
    US-7802198-B2September 21, 2010American Calcar, Inc.Centralized control and management system for automobiles
    WO-0233507-A2April 25, 2002Srinivas VenkatramSystemes et procedes de gestion de connaissances dirigee faisant appel a la plate-forme disha
    US-2011160964-A1June 30, 2011Obradovich Michael LTechnique for operating a vehicle effectively and safely
    US-2003023686-A1January 30, 2003Beams Brian R., Harris Scott B.Virtual consultant
    US-2006031783-A1February 09, 2006American Calcar Inc.Centralized control and management system for automobiles
    WO-0233507-A3July 25, 2002Srinivas VenkatramSystemes et procedes de gestion de connaissances dirigee faisant appel a la plate-forme disha