Guide

User Guide

The Discngine Connector allows you to connect Pipeline Pilot and TIBCO Spotfire®. Through a collection of components you will be able to build web applications, which will then be accessible from TIBCO Spotfire®. The interaction between TIBCO Spotfire® and Pipeline Pilot, made possible by the Discngine Connector, allows you to view and analyze your data in TIBCO Spotfire®, and manipulate them using Pipeline Pilot.

  • the Client Automation: interactively build TIBCO Spotfire® documents based on user input,
  • the Pipeline Pilot Data Functions: bi-directional data exchange between TIBCO Spotfire® and Pipeline Pilot,
  • the Pipeline Pilot Automation Tasks: server-side TIBCO Spotfire® document authoring from Pipeline Pilot.

The objective is to allow developers to programmatically interact with the Spotfire full client API through JavaScripting in both Analyst and Web Player clients.

Objective

Architecture overview

To integrate the content generated by Pipeline Pilot into TIBCO Spotfire®, the following components are needed:

  • the TIBCO Spotfire® Analyst and Web Player extensions: they create the Discngine Web Panel tool.
  • the JavaScript API: it allows the communication with the Discngine Web Panel tool.
  • the collection of Pipeline Pilot components: it is based on the Reporting collection which will trigger calls to the JavaScript API. The collection also includes the SBDF Writer component (Java based) to transform Pipeline Pilot data flows into a readable advanced text format for TIBCO Spotfire®. Molecules and images are supported.

The Pipeline Pilot collection provides a quick start protocol that will allow you to easily start with the Client Automation collection.

Developed in collaboration with one of the top Pharmaceutical Companies, the SWAPP (Spotfire Web Application for Pipeline Pilot) is a standalone web application designed to be used in the Web Panel. It allows you to register Pipeline Pilot protocols and run them seamlessly as web forms from TIBCO Spotfire® Analyst or Web Player.

SWAPP Form

This is done in three simple steps.

  1. First, select which Pipeline Pilot protocol you want to use. When loading the protocol, the SWAPP will suggest the best type of input for each input parameter of the protocol.
  2. Once registered, you can load the protocol through the menu. The web form will allow you to set the various input parameters based on the registered types.
  3. After submitting the job, the output HTML will be retrieved and parsed in the page. All javascript instructions generated by the Connector Components will be executed on TIBCO Spotfire®.

You can find more details on how to use the SWAPP in the relevant guide.

Data Functions are initially calculations based on S-PLUS, open-source R, SAS®, MATLAB® scripts, or R scripts running under TIBCO Enterprise Runtime for R for Spotfire, which you can make available in the TIBCO Spotfire® environment. With the Connector, you can base the Data Functions on Pipeline Pilot protocols.

With the Pipeline Pilot Data Functions, you can register TIBCO Spotfire® Data Functions that will execute Pipeline Pilot protocols. The data produced by these protocols can be inserted as a new table, new columns or new rows.

By clicking Pipeline Pilot Data Function… under the Tools menu, the user interface for managing all Pipeline Pilot data functions and registering new ones appears.

Register Pipeline Pilot Data Functions

From this user interface, you have access to the list of currently registered Data Functions. There are three different tabs, each displaying the Data Functions in a different way.

The Table View simply lists the data functions in a table; the TIBCO Spotfire® Library View uses a tree showing the location of the data functions in the TIBCO Spotfire® library; the Pipeline Pilot View also displays as a tree, this time showing the location of the protocols used by each data function in the Pipeline Pilot server.

To register a new Data Function, or to edit or delete an existing one, you must be connected to the Pipeline Pilot server.

By clicking on Register new, the tool connects to the server and then exposes the available protocols.

Pipeline Pilot protocol selection

Once a protocol has been selected, the user interface displays the input and output parameters for that protocol. You can change the name of the data function, the keywords, the cache management and the library folder where the data function will be saved.

Data Function parameters

Example protocol:

Example protocol

There are three possible types of input parameters that a Pipeline Pilot protocol might expect:

  • Data Table: if the protocol requires this type of input parameter, a SBDF Reader component needs to be added at the beginning of the protocol and the Source parameter of the component needs to be promoted.
  • Column Data: if the protocol requires the data from a column, the protocol will need to define an input parameter and select the Array check box of the Edit Parameter interface:

    Pipeline Pilot Array parameter

  • Single Value: any protocol input parameter value that is neither a URL type nor an Array type will be considered a single value parameter.

The outputs are read from the Results Web Service part of the protocols:

  • Files: there will be as many data tables as there are results properties with the "*.sbdf" pattern in the protocol. For example, if a property is called test.sbdf, the data function on the Spotfire side will have an output data table called "test". On the Pipeline Pilot side, we expect a TIBCO Spotfire® SBDF Writer component with $(rundirectory)/test.sbdf as Output File.

    Pipeline Pilot multiple files in output

    When no properties follow this pattern, the first SBDF file present in the run directory will be used.

    When Files is set to None (all options are unchecked) there will be no Table output for the Data Function.

    Pipeline Pilot no file in output

    If expected files are not found when the Data Function executes, it will fail.

  • Property: they will be sent as Output of the Data Function. When using an Array type the output will be of Column type, otherwise it will be a Value. Byte Array and XMLDocument type are converted to string, avoid using them since they do not exist in TIBCO Spotfire®.

    Pipeline Pilot Web Service results

You can use Data Functions in two ways:

  1. File > Add Data Tables...: this option allows you to load tables from different sources. One of these sources is a Data Function. If this option is selected, the list of Data Functions available in TIBCO Spotfire® are displayed and then the Pipeline Pilot Data Functions will be available for selection. Selecting one of them will lead to the setting parameter interface so that the Pipeline Pilot protocols can get the right data.

  2. Insert > Data Function...: this option allows you to choose one of the available Data Functions, and after setting the input parameters, the output of the Pipeline Pilot Data Function will be loaded as a new Data Table, a new set of columns or a new set of rows. The output form will depend on the user selection.

TIBCO Spotfire® Automation Services is a web service for automatically executing multi-step jobs within your TIBCO Spotfire® environment. See the official documentation for more details.

Briefly, a TIBCO Spotfire® Automation Services job file must be created, describing a set of pre-defined tasks. The job can then either be executed immediately or scheduled to be executed periodically using the TIBCO Spotfire® Client Job Sender.

Example protocol:

Example protocol

As in the TIBCO Spotfire® user interface, a job must always start with opening a document. The task components then follow one another, to finish with the "Run Client Job Sender" component which will write the XML task file and launch the Client Job Sender tool.

With the default settings of TIBCO Spotfire® Analyst, when a document is opened the Data panel is shown and covers the Discngine Web Panel:

Data panel

To hide this panel, go to Tools > Options, Document tab in the left panel and uncheck the box "Data panel open by default for data in memory". The setting will be applied when reopening The TIBCO Spotfire® Analyst client.