Visokio KnowledgeBase

Visokio KnowledgeBase

The KnowledgeBase contains groups of articles on more technical issues related to installing and using the various editions of Omniscope. Use the search box at lower left to find all references that may be relevant, or use the section and sub-section left-side navigational menu, or else click on the section links in the table of contents below.

For printed versions, click on ‘printer-friendly version’ at the bottom of the first page you wish to print, then use your browser Print function. If available, you can choose PDF as your printer to obtain a printable PDF version from your browser. A ‘download .PDF’ option to obtain an Adobe Acrobat version of the entire KnowledgeBase will be available soon.

Table of Contents:

01: Installation
02: Activation

03: Troubleshooting

04: Scaling & Performance

05: Data Files

06: Database Connections
07: Deployment Options

08: Automation Options

09: Integration Options

10: Web Services

11: Maps & Coordinates 
12: File Security
13: Functions Guide
14: Translation Guide
15: XML Schema

16: Flash Skins 

1: Installation - Covers installation on Windows and non-Windows operating systems, including Java support issues. Also provides options for centralised, network deployments on administered desktops with sample configuration files and test scripts. For installations accessing the Internet via a proxy server, there is guidance on how to configure your proxy server settings to enable automatic updates, bug reporting etc. to function fully.

2: Activation - Guides you through the process of online activation (which converts free Viewers into activated Standard, Professional or Enterprise Editions) and de-activation, which returns an installation to free Viewer status (there is never a need to un-install). An alternative activation procedure, browser-based activation, can be used whether the machine to be activated has Internet access or not. De-activation permits a machine to be re-formatted/re-built and permits a license key to be moved to another machine (up to 3 times). If you are going to change, re-format, or re-build an activated machine, remember that you must de-activate first to recover your key for re-use.

3: Troubleshooting - Outlines what to do if problems occur at various stages of running Visokio applications. Java update issues, work-arounds for functions requiring Internet access, and a hang diagnosis procedure are covered.

4: Scaling & Performance - Discusses the limits to the practical size of Omniscope data files in terms of cells (rows x columns) depending on the hardware are operating systems in use throughout the reporting/data publication chain. Optimisation options for increasing the scalability and performance of Omniscope files on typical user desktops are also discussed. Due to limitations in Flash, the capacity of DataPlayer .SWF files in terms of records or cells (rows x columns) is much lower than for Omniscope files. Data composition (i.e. long text strings) and other factors affecting the scalability and performance of DataPlayer .SWF files are also discussed.

5: Data Files - Discusses import and export of data to/from supported file formats such as .XLS, .CSV, .TSV, etc. and any known issues and workarounds for importing and exporting data. Also supplements information found in the User Guides relating to international differences in numerical formats, time and date formats etc.

6: Database Connections - Includes topics relating to the direct import of data from relational database views/tables using ODBC or JDBC and the Database Connection wizard. ODBC and JDBC-based examples for use with many popular databases are given. Large-scale deployment of client desktop refresh directly from relational database tables/views 'on-demand' using full ODBC connection strings embedded in Omniscope file(s) is also illustrated.

7: Deployment Options - Discusses various options for sending Omniscope .IOK files to others, including 'zero-footprint' or temporary, 'no-installation' options. Also explains how to display DataPlayer .SWF and downloadable Omniscope .IOK files on your web pages, and how to run Visokio applications from the command line.

8: Automation Options - Some editions of Visokio applications come with automation tools i.e. the Scheduler and Generator, which can be used to automate both recurring and 'on-demand' actions, such as refreshing, merging, and distributing up-dated files or displays. This section documents the use of these tools, as well as options for running them as a Windows service and defining your own custom scripts using Visokio XML Actions syntax.

9: Integration Options - Visokio applications are designed to be part of integrated data management, reporting and publishing solutions. This section discusses the many data import and refresh options available. For example, the automatic refresh feature enables any number of outstanding client side .IOK/.IOM files to be refreshed automatically over a network or the open web whenever their Source .IOK/.IOM file (effectively a data mart) is refreshed. Web integration options such as web page display of interactive Flash DataPlayer .SWF files generated 'on-demand', and the use of web links and web services integration features of Omniscope files are also discussed.

10: Web Services - Omniscope is a powerful, flexible 'hybrid' desktop/web application that is fully integrated with the web and web services. This section documents some techniques for exchanging user selected/user generated subsets of data with remote web services. For example, users can move record locations on Omniscope maps, and then export the new coordinates for each moved record back to a central data repository from which other users' files are being updated. A remote web service can be anything which applies additional data and remote processing logic to generate new results for display, either in Omniscope Web Views or the users' default browser. Responses to requests for web services can include web pages containing refreshed, personalised, interactive DataPlayers generated 'on-demand', with links to other Omniscope .IOK files containing additional web services menus, etc.

11: Maps & Coordinates - Visokio applications can display, select and filter data records containing coordinate pairs using various types of maps, including scalable, multi-layer vector maps available from our Maps Library, online maps provided as web services, such as Google Maps, and Google Earth (experimental), as well as scanned images, such as floor plans or sports fields. This section supplements the information found in the Omniscope User Guide, providing more technical detail on issues and experimental features relating to displaying, selecting and filtering data on maps.

12: File Security -

13: Functions Guide - All Visokio applications enable you to add Formula fields (columns) which calculate the values to display using the values in other fields (columns). Visokio formulae can also incorporate variables, user-defined ranges of assumed values specified in terms of maximum, minimum and default values. Formula fields are defined using standard functions using the same syntax as for Excel. Visokio applications also include a library of special Visokio DATASET functions that operate on entire data sets and are documented in this section. Example formulae useful for accomplishing common tasks are also illustrated in this section.

14: Translation Guide - Visokio applications are capable of supporting all the languages of the world, including any customised modified translations you may wish to create for your own subscribers or organisation. Whether you want to create an entirely new translation based on existing ones, or modify an existing translation, this section describes the process in detail.

15: XML Schema - Visokio applications read and write XML files that conform to the Visokio XML schema, an extremely simple XML schema for structured data somewhat analogous to the comma separated value .CSV delimited text file format. This section documents the Visokio Schema and provides examples of XML files in Visokio schema. Any XML file can be transformed into Visokio schema on import using standard XSL transform files.

16: Flash Skins - Flash .SWF DataPlayers use 'skins' to define their overall look and feel. You can modify the existing skins, or create your own according to the specifications provided in this section.


Visokio Home

Installation

Omniscope Installation

Operating system and Java installation issues

 

This section deals with installation of all Visokio applications. All Visokio applications are Java-based applications. This means that you must have a version of the free Java virtual machine (JVM) already installed on your computer before you can use Visokio applications. All Visokio applications can be installed with a dedicated version of Java that only they will use (a private virtual machine or PVM), or Visokio applications can use the version of Java already installed on your machine, provided you have Java 5 or later (the current Java version is 6). In general, we recommend always installing the latest version of Java. To see which version of Java you currently have installed, click here.

Table of contents:

1: Windows Installation issues- this section covers issues related to installation on the Windows operating system

2: Java Issues- covers known issues with Java. If you plan to use an older version of Java, or have restricted privileges on the generalised Java installation on your machine, please consult this section.

3: Non-Windows Installation- installers for operating systems other than Windows are also available.  The installer for the Mac can be activated to convert installations from a free Viewer, but activated versions are still in beta. This section covers issues related to installation on Macs, Linux etc.

4: Proxy Server Configuration- assistance in configuring your proxy server to ensure connectivity with Visokio servers

 


Knowledge Base Top

Windows Installs

Windows Installation

This section documents the Windows installation process for Visokio applications, and discusses options for deploying our applications in various organisational and network/desktop administration contexts.

Note: Visokio applications are Java applications which will run on most operating systems, including Linux and Mac. However, only the free Viewer is currently available for non-Windows operating systems. The activation process to upgrade free Viewers to Standard, Professional and Enterprise Editions is not yet supported on non-Windows operating systems. Details on installing on non-Windows operating systems are available here.

Typical Install Sequences (Windows)

The typical Windows stand-alone installation sequence for each of our products is included in the User Guides:

Omniscope Windows typical install

FeatureFinder Web Windows typical install

Administered Installations (Windows)

The sections below cover network installs and options for centralised deployment, including any known issues and workarounds:

Administered Desktops Covers roll-out installation options, including options for centralised deployment

Install Configuration Files

Class Load Logs

Test Scripts


Knowledge Base Top

Administered Desktops

Administered Windows Desktops

To install Omniscope or FeatureFinder in a corporate administered network environment you may either install individually, or deploy (roll out) to multiple terminals from a central location. Additionally, once installed, you may then need to activate your installation(s) to upgrade from the free Viewer to the Standard or Professional Edition.

Single User installation

Download the full installer files

Omniscope: download the full installer from here
FeatureFinder: download the full installer from here

Choose the full installers which are self-contained and do not trigger further downloads.

Installation by an System Administrator

As with all software, installing Omniscope requires local admin/install privileges. Most corporate environments do not grant this to all regular users, so a System Administrator will need to log in to the PC and install Omniscope themselves.

Omniscope is a quick install, and takes only a few seconds. It is advisable for the Administrator to configure the appropriate proxy settings at installation, allowing Omniscope to activate online. This can be done from Tools menu, Advanced, HTTP Proxy Settings. Alternatively you will be prompted during activation. Another alternative is to deploy a plain-text properties file into the Visokio Omniscope program folder in Program Files. See Proxy Settings for more information.

Activation

Unless the installation is intended to operate as a unactivated Omniscope free Viewer (only for viewing & filtering .IOK files), rather than an activated Omniscope- Standard or Professional (able to publish data sets as .IOM Standard or .IOK Professional files) or Professional DataPlayer (also able to produce Flash DataPlayers) the installations should be activated immediately.

Activating for a single user on one machine

If the PC is only used by one user (one login), the application can be activated by that user, which will only allow them to use the activated product feature set. If another user logged in, they would see the free Omniscope Viewer only. This approach allows you to activate separately by giving users their own keys, rather than relying on administrators to activate, and is particularly suitable to roll-out installation.

Activating for multiple users on one machine

If the PC is used by more than one user, the application should be activated by an Administrator, which will apply to all users of the PC. This should be done immediately after installation by the Administrator.

Multiple or 'Roll-out' installation

The best way to roll-out Omniscope to multiple machines in an administered network setting is to use a 3rd party application deployment management suite that will simulate the log-in of an administrator and execution of the offline installer executable.

What happens during an installation?

In addition to extracting application data to {System drive}\Program Files\Visokio Omniscope and {System drive}\Program Files\Visokio Common, the installer adds shortcuts and registry entries to implement file icons and associations for the Visokio file formats, particularly the IOK file format.

Roll-out Installation Options

Silent installation

Using the /S (capital "S") switch, the installer will run in silent mode. You can remotely execute the following command to install Omniscope without the usual sequence of interactive wizard steps.

  Z:/path/to/OmniscopeInstaller.exe /S

Deployment without using the installer

It is possible to roll out Omniscope without the installer using the following steps:

  1. Download the latest Omniscope installer. If the machines you are deploying to already have the Java 5 (or greater) plug-in (with full permissions for images, etc.) you may use the lightweight installer. If not, you must use the full installer also found on this page.
  2. On a test PC, clean out any prior Omniscope installation by deleting Visokio Common and Visokio Omniscope from Program Files.
  3. Install manually on this test PC under a local admin login.
  4. If the machines you are deploying to do not have Java 5 or higher, make sure the installer has created the Visokio Common folder, then visit www.visokio.com/getjava and download and install Java for Omniscope.
  5. The Visokio Omniscope folder (and Visokio Common if it exists) in Program Files now contain all the application program and data files you need to roll out.
  6. Deploy shortcuts: You will also need to deploy shortcuts to allow users to launch the application. These must start "launch.exe" inside the Visokio Omniscope folder, passing in %1 as a parameter, with the correct icon. On your test PC, the shortcut was installed to the Desktop and a program folder to the Start Menu, for all users. Take these files and replicate their creation as part of your deployment. See an example program folder in the Start menu
  7. Configure Proxy Settings: If you need to configure a proxy server to allow Omniscope to communicate bug reports, upgrade notifications, etc., also deploy a proxy file into the Visokio Omniscope folder See an example proxy file or the section on Configuring Proxy Settings for more information.
  8. Registry entries: Add the registry entries normally added by the installer. Most of these are static registry additions for the Visokio file formats, but Omniscope also adds right-click entries for Excel XLS and CSV files and the registry changes for this can vary depending on your Excel installation. Refer to the registry settings made by the installer on your test PC, which you will need to monitor and capture.
  9. Roll out and test your installation using Test Scripts.

 


Knowledge Base Top

Install Config File

Using the installconfig.properties File

 

Omniscope installs an optional installconfig.properties file within the application installation folder, normally C:\Program Files\Visokio Omniscope

Corporate administrators may wish to use this file to tailor their rollout of Omniscope and to support a centralised Java VM. This file is used to re-direct Omniscope to use 64-bit Java installs, and to specify corporate font folders to be available to Omniscope users. This file may also be used to assist in diagnosing problems starting or using the software (see below).

File format

The installconfig.properties file contains plain text, editable by Notepad. Comments are prefixed with a space and # symbol. See the description of all available properties in the example file, below.

Example installconfig.properties file

# This is the installation configuration file.
# This is used to configure initial startup of the application.
#
# All properties are optional, and if defined, each line must not contain redundant whitespace
# To enable/disable a property, remove/add the # sign (# means comment)

# This is an optional manually-specified Java VM installation folder.
# It should contain bin\javaw.exe, and should be Java version 5+
# JVM_DIR=C:\Program Files (x86)\Java\jdk1.5.0_14

# This is an optional manually-specified max memory cap for the Java VM, an integer specifying the
# megabytes to allow the JVM. Must be at least 64.
# If unspecified, 75% of physical RAM will be used as the cap.
# MAX_MEMORY_MB=300

# Optional property specifying additional space-separated JVM options. Default is blank.
# Example which enables "heap dump on out of memory", which generates files such as
# "java_pid4972.hprof" in the program folder, for submitting to Visokio for analysis
# (requires Java 1.5.0_07+ or Java 6):
# ADDITIONAL_JVM_ARGS=-XX:+HeapDumpOnOutOfMemoryError

# Optional property which if true causes output to be redirected to
# "Visokio_output_log.txt" in My Documents
# LOG_TO_MY_DOCUMENTS=true

# Optional property which, if true, disables the default heap tuning parameters
# which at time of writing are -Xms64M -XX:MinHeapFreeRatio=20 -XX:MaxHeapFreeRatio=30
# DISABLE_DEFAULT_HEAP_OPTIONS=true

Specifying Corporate Fonts  

If you are running on Windows go to C:\Windows\Fonts and copy all the fonts you want to make available from Omniscope. Now on the user machine go to the Omniscope installation directory (typically C:\Program Files\Visokio Omniscope ) and open the installconfig.properties file in NotePad. Add a command line option to specify which fonts are available by uncommenting (removing the space & hash) at the front of the  #ADDITIONAL_JVM_ARGS line and add the following: -DinstalledFontLocation=c:\our_fonts (case sensitive) to the end of the line. The directory after the  '=' (in this case C:\our_fonts) specifies the location of the fonts that should be available in Omniscope.  Below is an example of how the modified installconfig.properties line would look:

ADDITIONAL_JVM_ARGS=-XX:+HeapDumpOnOutOfMemoryError -DinstalledFontLocation=c:\our_fonts

Note:it is important that to copy rather than delete your fonts from the C:\Windows\Fonts location. Also note that onlyTrue Type Fonts (with .TTF extension) files can be included.

Heap dump on out-of-memory

To enable this, ensure the ADDITIONAL_JVM_ARGS line is uncommented or edited to include the option "-XX+:HeapDumpOnOutOfMemoryError". For example:

ADDITIONAL_JVM_ARGS=-XX:+HeapDumpOnOutOfMemoryError

This will cause a heap dump (*.hprof file) to be written to the install folder should you experience an out of memory situation. When this occurs, deliver this file to Visokio for diagnosis if you believe the error to be unwarranted. More information...

Further information

See Generating a class load log


Knowledge Base Top

Class Load Logs

Generating a Class Load Log

 

If requested by Visokio, a class load log can be generated as follows. This is a .TXT file containing application startup diagnosis information.
  1. Install Omniscope 2.2-pre b71 or later.
  2. Edit C:\Program Files\Visokio Omniscope\installconfig.properties.(documented fully here)
  3. Edit/Add the following properties (ensure that these properties do not appear elsewhere in the file unless they are preceded by "#"):

    ADDITIONAL_JVM_ARGS=-verbose:class -DtickLogEvery=500
    LOG_TO_MY_DOCUMENTS=true
  4. Start Omniscope
  5. Close Omniscope (and/or dismiss any dialogs, and close any console windows that may remain open)
  6. Email the file Visokio_output_log.txt (saved in your My Documents folder) to support AT Visokio.com
  7. Remove the changes you made in step 3

Knowledge Base Top

Test Script Windows

Test Script- Windows Installations

 

Below is a suggested sequence of operations for testing a deployed Omniscope installation:


  • Opening IOK files
    • Download a test IOK file from the Omniscope demos page
    • Save this file to your desktop.
    • Double-click the file, and ensure that Visokio Omniscope starts and opens the file automatically.
    • Close Omniscope, and this time open the file directly from the web page without saving to your desktop.
    • Verify again that Visokio Omniscope starts and opens the file automatically.

 

  • Filtering with Instant Query
    • Depending on the file, you will see a number of images on the left and filters on the right.
    • Adjust the filters, and the images should disappear and reappear according to your criteria.

 

  • Filtering with Power Query
    • Click the Power Query button on the main toolbar.
    • The filters should disappear.
    • Click the Tile view button on the lower toolbar, and choose Chart
    • You will see the Chart view.
    • Click on the Tv device, and it will open.
    • Click the "y" coloured region and then click the Move button on the main toolbar.
    • You will have filtered the data.
    • Click the Chart view button on the lower toolbar, and choose Table.
    • You will see the Table view with only the filtered records remaining.

 

  • Adding other views
    • Click the Add view button on the main toolbar. Choose Graph.
    • Click the Add view button again and choose Tile.

 

  • Following links
    • Close Omniscope, and open a demo file with links
    • Click on a row header to dislay details for a single record
    • In the details window that appears, click the Details link button.
    • A web page referred to in the link should open.

 

  • Activating and internet access
    • You will need a licensing key.
    • Choose Close from the File menu. You will see Omniscope in the centre.
    • Click the Upgrade to full product button.
    • Enter the serial number and click Upgrade.
    • If this fails, you will need to check and adjust proxy settings.
    • On re-starting Omniscope, you will see Omniscope or Omniscope Professional depending on wheterh actviation was successful or not

 

  • Opening CSV files
    • Copy a sample CSV file to your desktop
    • From the File menu, choose Open file... and browse to this file.
    • Verify the file opens with the chart and table views showing.

 

  • Opening Excel XLS files (depends on having an Excel installation)
    • Copy a sample XLS file to your desktop
    • From the File menu, choose Open file... and browse to this file.
    • Verify the file opens with the chart and table views showing.

 

  • Saving IOK files
    • From the File menu choose Save as IOK...
    • Click Save and an IOK file will be created
    • Close Omniscope.
    • Double-click this newly created IOK file
    • Verify Omniscope starts and opens the file automatically

 

  • Exporting data in XLS files
    • You need an Omniscope Professional license for this.
    • Choose Export --> Export... from the File menu
    • Ensure the Data tab and Excel Workbook save as type is selected.
    • Enter a new filename and click Export
    • Verify the file is created and opens in Excel.

Back to Installation


Knowledge Base Top

Rebranding Omniscope

Rebranding Omniscope

Corporations deploying Omniscope centrally have the option of rebranding Omniscope 2.3 or later to add corporate identity:

 

 

Instructions

To rebrand Omniscope deployments, include a "branding" folder within the deployed application folder (typically such as "C:\Program Files\Visokio Omniscope\branding"). Into this folder put various files. All files are optional and their presence takes precedence over the default application behaviour.

To get started, download the sample branding folder containing the optional files. Add your branding to the images as necessary. Some images are size sensitive, some are less so. Edit the config.properties file appropriately - this is documented inside the file itself.

To add custom colour themes, create the themes in an open Omniscope file using the Appearance menu and save using the Themes menu item. This will create an XML file either in the program folder or in your user profile. Move this into the Themes subfolder of the branding folder.

Edit the "config.properties" file to customise other settings such as colours and fonts - these are documented inside the file itself. Please note that further customisations are available than specified in this file - contact us for more information.

To preview your results, install Omniscope normally and put the work-in-progress branding folder inside your Omniscope program folder, then start Omniscope. 

Note: on Vista, you will need to work on the branding folder in an editable location such as My Documents, then drag with Vista UAC confirmation into the program folder when you want to see the results.  On XP, you can edit directly in the program folder.

Download

Download sample branding folder (ZIP) - requires Omniscope 2.3 or later.

Java Issues

Java Issues

 

Java is freely down-loadable, open source software that provides a 'virtual machine' or VM that permits software to run on many different machines and operating systems. For more information on Java, see Wikipedia

Visokio applications are pure Java applications that run 'on top' of a Java virtual machine which runs 'on top' of your machine's operating system. This means that you either must have Java 5 or later installed before you can install Visokio applications, or you must use the Full installer which includes Java 6, also available here.

Java is open-source software that is being continuously improved. Periodically, there is a new release of Java, and known issues in Java emerge which are relevant to installation and performance of Visokio applications.

Java compatibility

If your systems already have a conflicting version of Java installed (such as the Microsoft VM, or Java 1.3.x) you must use the full installer. This creates a private Java VM (PVM) specifically for Visokio applications which will not affect any other part of your system.

The private Java VM, installed in Program Files/Visokio Common/pvm15, must be deployed as well as the main Visokio program folder, for example the Omniscope folder: Program Files/Visokio Omniscope.

Alternatively, it is possible to specify your own Java VM, by creating/editing the installconfig.properties file within the main installation folder. See Centralised Deployment for more information.

Known Java Installation issues

In this section, we summarise known Java installation issues and implications of up-grading to the latest versions of Java. Other known issues with Java that do not affect installation, but can cause a hang with no Omniscope error messages are listed here.

Java permissions and security issues

Java has security settings which may affect the treatment of images. If user settings restrict access to certain packages in particular the sun.awt.image package within Java then certain views can be affected. The following issue has been seen before:

java.security.AccessControlException {class java.security.AccessControlException "access denied (java.lang.RuntimePermission accessClassInPackage.sun.awt.image)"
at java.security.AccessControlContext.checkPermission(Unknown Source)
at java.security.AccessController.checkPermission(Unknown Source)
at java.lang.SecurityManager.checkPermission(Unknown Source)
at java.lang.SecurityManager.checkPackageAccess(Unknown Source)
at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClassInternal(Unknown Source)

It is likely that your security policy is not letting you access to classes in java.awt.image packages.
Access to classes in AWT package, viz., and the java.awt.image packages are required.

In order to fix this problem you need to grant Omniscope users permission by adding the following statement

grant {
permission java.lang.RuntimePermission
"accessClassInPackage.sun.awt.image";
}

to any of the security policy files referred to by statements such as

policy.url.1=file:${java.home}/lib/security/java.policy
policy.url.2=file:${user.home}/.java.policy

in the java security configuration file for your installation. This file should
be located at ${java.home}/lib/security/java.security.

${java.home} refers to where java is installed i.e. "C:\j2sdk1.4.2_14".
${user.home} refers to user home directory which on Windows is "C:\Documents and Settings\<user>" where
<user> refers to the user name. For example use named David, user.home would be "C:\Documents and Settings\David"

Known Java on Vista issues

The Windows Vista operating system is not fully supported in Java versions 1.4, Java 1.5 releases prior to build Java 1.5.0_11 (Java 1.5.0_11 or later supports Vista), or Java 6 original release or 1.6.0_01 (Java 1.6.0_02 or later supports Vista). If you are running a Java version not fully supported on Vista please update to the latest release of Java at http://www.java.com or use the PVM version bundled with our applications (Java 1.5.0_11).

International fonts

Some fonts can crash earlier versions of Java and this has been fixed in latest releases of Java. Visokio applications have been modified to minimise the impact of this rare problem in the event you are running older versions of Java.

Java Daylight Savings Time (DST) Compliance

Omniscope, DataPlayer Studio and FeatureFinder are Java applications so their compliance with DST (as recently updated) depends on the Java VM used.

http://java.sun.com/developer/technicalArticles/Intl/USDST/ provides details on Java version DST status.

Our products are available both with and without a bundled private Java VM. The current bundled installers of Omniscope 2.2 and FeatureFinder 1.3 available on our website all use Java 1.5.0_11 which is DST compliant.

Other bundled installers available on our website (such as FeatureFinder 1.2, and Omniscope installers built before Feb 26th 2007) may not be DST compliant. If DST compliance is critical and you cannot upgrade to newer product versions, you must use the non-bundled installer.

If you use a non-bundled installer, it is up to you to ensure the system Java VM is compliant.


Knowledge Base Top

Get Java

Java for Visokio Software

The lightweight version of Omniscope requires Java (version 5 or later) to operate. If you don't have Java installed at all (or have an earlier version such as Java 1.3) the Visokio installer will ask if you want to download and install "Java for Visokio software" automatically. This installs a private Java VM installation ('PVM') for Visokio products only, and will not affect other applications on your PC.

Sometimes your machine could have a more recent version of Java than the one supplied with the Visokio installer, but your installation is somehow incomplete or has become somehow corrupted. In other cases, your general installation may not have all the privileges required (see known Java issues). To deal with these circumstances, we provide a private Java VM installation that will override your system installation of Java.

Alternatively, if you have access and install privileges, visit www.java.com to check you've got the latest free Java plugin.

Download Java for Visokio

We recommend using the Full version of Omniscope, which is the default, which includes a private Java VM.  However, if needed, use the following links to download the private Java VM installer for Omniscope, separately.

Private Java VM for Visokio (32-bit, based on Java 6u4) (15MB)

Private Java VM for Visokio (64-bit, based on Java 6u6, for 64-bit Windows only) (13MB)

Not permitted to install software?

If your organisation prevents you from installing software, contact your IT Help Desk and get them to download and install Visokio applications for you. Alternatively try the Web Start online launch option on the download page.

 

Back to Known Issues with Java


Knowledge Base Top

Non-Windows Installs

Non-Windows Installation


This section deals with issues relating to installation on operating systems other than Microsoft Windows.

  • Apple OS X10.3 or later
  • Linux
  • Solaris/Unix flavours

Visokio Omniscope is also available as a JAR file for any operating system


Knowledge Base Top

Proxy Settings

Proxy Settings

 

If you are in a typical medium to large organisation, your PCs may access the Internet through a proxy server. Proxy servers are separate computers that act as gateways and are used to improve security and efficiency.

At present, due to limitations in Java, Visokio applications cannot detect your proxy settings automatically in certain cases.

In order to access some Visokio services, including activation, automatic updates and sending bug reports, each Omniscope installation must be configured with the organisation's correct proxy settings. Your system administrator should be able to provide you with the settings. Regardless of your deployment/update strategy, if Visokio installations are to be activated by their users, proxy settings may need to be deployed.

Depending on the way proxy settings are configured in your organisation, Visokio functions might "just work" automatically. To test this, install on a trail machine and attempt to activate using a trial key (contact us to get one). If activation fails, you can enter the correct proxy settings manually, but it is recommended you automatically deploy these proxy settings when rolling out. At present, this is best done using a plain-text proxy settings property file, deployed into the \Visokio Omniscope (or FeatureFinder Web) program folder.

Configuring proxy settings manually

  • You will need to know the http proxy host and http proxy port of your proxy server
  • Start Omniscope/DataPlayer Studio/FeatureFinder
  • From the Tools menu, open the Advanced tools submenu and choose HTTP proxy settings...
  • In the dialog, tick the Use HTTP proxy box and enter the host and port settings
  • Click OK

Configuring whilst activating

When activating Omniscope, if the necessary proxy settings are absent, Omniscope will ask you to enter these as part of the product activation dialog steps. When the Online activation failed dialog appears, click the Proxy settings button and enter the details, as described above.

Configuring proxy settings automatically

If you are a system administrator and are deploying (rolling out) Omniscope to multiple PCs, you can simultaneously roll out proxy settings. This is useful because it allows your deployed installations to be activated by your users without any further configuration (apart from a valid license key/serial number).

  • Use a single test installation of Omniscope and configure the correct proxy settings as described above
  • Open the folder {System drive}\Program Files\Visokio Omniscope
  • You will see the file proxy.txt which contains the proxy settings you have entered, which will be similar to:
                   #Resource properties file
#Wed Feb 15 13:37:09 GMT 2006
http.proxyPort=80
http.proxyHost=proxy.visokio.com
  • Deploy this file to the same folder in your deployed Omniscope installations

Knowledge Base Top

Activation

Activating Omniscope

 

The free Omniscope Viewer is unactivated, but can open, view, navigate, filter and analyse .IOK files without size limitations (other than the amount of RAM on the machine running Omniscope relative to the amount of data in the file). All free Viewer installs also come with a 30-day trial of activated Omniscope Professional functionality, which permits you to import your own data, add maps, images, links etc., save and share the .IOK files with anyone else with the free Viewer installed. After 30 days, the trial period expires, and the installation reverts to a useful free Viewer, unless activated with a license key. It is not necessary to download a different installer to upgrade to an activated edition.

Note: Licensing is on a per-user, per-account basis. If you need to activate multiple user accounts on the same physical machine, or you have multiple virtual machines carved out of the same physical machine, you will need an activation key for each user account. Activation of multiple users on a single machine (or Citrix or VMWare-type virtual machines platform) must be done on a user-by-user basis. If you need to do this for a large number of users, please contact us for assistance. 

Purchasing a license key

To activate, you must have a valid license key, which is a sequence of letters and numbers that looks like this:

 PUWU - YHUJ - U44M - KRPV  

Contact us in order to obtain a license key.

Online Activation

Start your Free Viewer from the Desktop or the Start menu. Click Help > Check for Software Updates Now to ensure you have the latest version installed. Once you have installed the latest version, click on Help > Product Licensing and Activation. Enter your license key/serial number in the space provided.

If your machine has already been activated before, you will instead see green Refresh or red De-activate options. Use Refresh whenever you upgrade to a new version. The De-activate command is used to move your activation license key to a new machine by first removing it from the existing machine. You are allowed to do this at most 3 times.

If Activation Fails...

If you are online, and there is a problem with online activation, it is most likely caused by a lack of a direct connection between your machine and our activation server.  This can be caused by firewalls, proxy servers or both. You will most likely see this message:

If you don’t have an Internet connection or can’t activate online due to corporate firewalls, un-configured proxy server settings, etc. you can still activate manually.  Configuring your Proxy settings may solve the problem.  If not, you can Select Browser-based activation.

Browser-based Activation

Follow the same procedure as for Online Activation until you see the dialog above, then click on Browser-based activation, and you will see the following dialog:

If your machine has access to the Internet:

  1. Click on the 'Click here' link
  2. Your web browser will open and display a response code
  3. Paste the response code from the browser into the box shown above
  4. Click Submit

If your machine does not have Internet access:

  1. Copy the web address shown and go to another machine with web access
  2. Copy the address into the browser
  3. The browser will display a page with the response code
  4. Copy the code and return to your machine
  5. Enter the response code into the box shown on your machine
  6. Click Submit

Knowledge Base Top

Known Activation Issues

Known Activation Issues

 

Reverting from version 2.4 to 2.3

If you are reverting your Omniscope 2.4 installation to Omniscope 2.3 installation it is important that you deactivate your license prior to installing version 2.3. If you are upgrading from Omniscope 2.3 to Omniscope 2.4 then this does not apply and you do not need to deactivate prior to upgrading.

If you have any questions please contact us using our contact form.

 

Back to Activation


Knowledge Base Top

Troubleshooting

Troubleshooting Guide

This section covers what to do if problems occur at various stages of installing and running Visokio applications.

Java Installation Problems

Java is a free addition (plug-in) for all operating systems, including Windows, Mac or Linux/Unix. Java must be downloaded and installed on any machine before you can run Java-based programs such as Omniscope and FeatureFinder Web.

The most current version of Java is always available from the official Sun Java site. Visokio applications run on installed versions later than 1.4.3. If you are having problems, first try updating your Java installation to the latest version. Restrictive Java security and permissions settings on generalised JVM installations can cause unexpected errors... more information can be found here. Visokio applications can be run with their own versions of Java (PVM) if desired.

There are usually a few outstanding known issues in Java, which is open-source and constantly being improved. We try to anticipate and help manage these rare issues when possible until fixes are included in the next release of Java. Information on known Java installation issues is here. If you are experiencing problems installing our applications please submit an issue report.

Freezing or Hanging

If you experience hanging with no Omniscope error message, first consult the list of known Java issues below, some of which you can resolve by updating your version of Java.

Known Windows and Java issues:

1. Windows and Java do not allow file names with '?' or other special characters such as '*' in the file name- if you use a '?' or '*' or other special characters when you specify the file name, nothing will happen. Try saving the file with a different name not including unusual characters.

If your installation opens normally, but at some point experiences hanging or freezing, and you do not see an error message, and you are not experiencing a known Java problem outlined above, please follow the hang diagnosis procedure .

Functions requiring Internet access

Automatic activation, updating and bug reporting functions all depend on Visokio applications being able to access the Internet. Firewall settings and addiional machines between your machine and the Internet called Proxy Servers can interfere with the ability of the Visokio application to access the Internet. In general, correct Proxy Server configuration will ensure that all functions are available.  If not, in each case, there are work-arounds available:

Preconfigured links

YouTube Issues:

If you have Internet Explorer 7 installed, you may find that the YouTube (video only) preconfigured link displays as a white screen with nothing playing. To avoid this problem, please ensure that www.youtube.com has been added to the trusted site section in Internet Explorer 7. This is done as follows: 

1) Click on Tools menu in the toolbar.
2) Click on Internet Options
3) Click on Security tab
4) Click on Trusted sites
5) Click on the sites button.
6) Untick "Require server verification (https:) for all sites in this zone"
7) Type www.youtube.com in the Add this website to the zone text box and then click Add
8) Tick "Require server verification (https:) for all sites in this zone", if previously ticked


Knowledge Base Top


Hang Diagnosis

Hang Diagnosis Procedure

In the event of the application hanging (freezing, so no user interaction is possible), please use the following procedure to send a hang diagnosis to Visokio (Windows PCs only). Although these steps may seem complex, this will help us greatly with what can be a difficult problem to diagnose. For assistance please contact us.

Creating and sending a hang diagnosis

  1. Using Windows Explorer, navigate to the program installation folder
    (usually "C:\Program Files\Visokio Omniscope")
  2. Double-click "launch_console.exe"
  3. In the black console window:
    1. Click on the black "C:\" icon in the left of the title bar.
    2. Choose Properties from the menu that appears.
    3. In the layout tab, ensure "Screen Buffer Size" has a large value such as 300 in the Height field.
    4. Click OK
  4. In Omniscope, open the bug report dialog (triggering the hang)
  5. Switch to the black console window
  6. Press Ctrl+Break (diagnostic information will be generated)
  7. Click on the black "C:\" icon again and choose "Select All" from the "Edit" submenu.
  8. Click on the black "C:\" icon again and choose "Copy" from the "Edit" submenu
    (this will copy the diagnostic text to the clipboard)
  9. Paste this into the "Detailed information" field in the Software Issue Report submission page. Complete the other fields as indicated and click "Submit".

Forcing the application to quit (Windows)

  1. Press Ctrl+Shift+Esc (simultaneously). Task Manager will appear.
  2. In the first tab ("Applications"), right-click the hung application. Be careful to make the correct selection.
  3. In the menu that appears, choose "Go to process". An entry inside the "Processes" tab will be selected for you.
  4. Click the "End Process" button.
  5. Click "Yes" to confirm.

Knowledge Base Top

Scaling & Performance

Scaling & Performance

 

The power of Omniscope on the desktop is due in part from its unique client-side in memory architecture. All the data in the file is held in the memory of the local machine, at maximum granularity and with aggregated transforms, simultaneously.  As files get larger in terms of row and column counts, the RAM required on the local machine increases. As computers gain ever more RAM and processing power at ever lower prices, Omniscope-based solutions become ever more compelling regardless of the size of the data sets. However, some scaling and performance considerations should be borne in mind when deploying Omniscope in situations where very large data sets will be used. 

Scaling Omniscope-based solutions

Omniscope is a locally-installed in-memory application with no inherent data volume limits in terms of record or cell counts (cells = rows x columns) in the application itself. If you have sufficient memory addressing capacity in your operating system (64-bit systems have much more than 32-bit systems), plus sufficient RAM and fast processors, the upper limits of Omniscope files extend to multi-million record data sets on 64-bit systems running 64-bit Java with 2+ GB of RAM. Because reporting/publishing chains may include less powerful 32-bit machines on 'downstream' user desktops, reporting/publishing solutions involving very large data sets may require various optimisation techniques and tools. The sections below discuss options and issues related to Omniscope scaling and performance in detail:

Managing scaling & performance in Omniscope

see also

Highly-scalable Omniscope-based solutions should be organised as a 'waterfall', where the most RAM-intensive tasks are done on servers or the desktops of a few power users, such that the resulting 'downstream' report files are less RAM-intensive and perform well on the standard desktops of the downstream users. In a typical, fully-automated Enterprise-based, 'waterfall' implementation, a set of Omniscope .IOK/.IOM files are maintained as single table (and soon multi-table) data marts refreshing directly from data warehouses running on the same powerful 64-bit servers with abundant RAM. Power users at the heads of the reporting/workflow chain can use smaller, desktop versions of these .IOK/.IOM files which have the 'data mart' files (not the data warehouse SQL reporting views) as their linked source and which automatically refresh from the larger 'data mart' files kept on the server. The power users in turn re-configure their own smaller .IOK/.IOM files to generate/refresh yet smaller, more specialised reporting files for onward distribution to standard desktops. Using Omniscope Professional .IOK/.IOM as source files, even smaller reporting subsets or dashboards can also be generated as universally-accessible Flash DataPlayers for interactive web page display and embedding in documents (see below for information on the data capacity limits of DataPlayers).

Scaling DataPlayers (Flash .SWF files)

Due to inherent limitations in Flash, .SWF DataPlayers will always have much lower capacity for data in terms of record or cell counts (cells = rows x columns) than does a highly-scalable, locally-installed data analysis, management and reporting solution like Omniscope. In general, DataPlayers can contain at least 10,000 records (rows), but various factors specific to the data can affect performance and impose lower limits on record count. We are re-writing the Flash generatring code in ActionScript 3, and expect both scaling and performance improvements in DataPlayers soon. Smaller data sets, aggregations (e.g. daily data rather than hourly) or defined subsets (Named Queries) from larger Omniscope .IOK files can be automatically converted to DataPlayer 'dashboards' according to a routine schedule, or on-demand using personalised XML data sets delivered to the Generator from back-end repositories and/or analytical staging 'data marts'.

Managing .SWF DataPlayer scaling & performance

 


Knowledge Base Top

Omniscope Scaling

Managing Omniscope Scaling & Performance

File sizes & typical RAM requirements

How much data can Omniscope handle? Omniscope software has no fixed upper limit on the number of rows and columns that can be managed in a single file. The effective upper limit depends on the specification of the machine running the Omniscope file, and a complex relationship between processor speed, available Windows and Java memory addressing, data types, density of the columns and the number and type of Omniscope views employed in a given file. Effective Omniscope data volume is principally related to the number of cells (rows x columns), while the effective capacity of a computer (for this purpose) is principally related to the addressing space and amount of RAM in the machine. The best way to determine how large data sets (over 5 million cells) or very large data sets (over 15 million cells) will perform in machines with different amounts of RAM is to try it with Omniscope Professional, or request an Enterprise trial key to use more powerful 64-bit servers with more RAM.

In general, a recent 32-bit computer with:

  • 512 KB of RAM should handle files of about 5 million typical cells
  • 1.0 GB of RAM should handle files of about 15-17 million typical cells
  • 2 GB of RAM should handle about 20 million typical cells
  • Over 2 GB of RAM cannot be used by 32-bit systems, only by 64-bit systems

The less than proportional increase between 1.0 and 2.0 GB of RAM results because the 32-bit Windows/Java addressing limit is reached at about 1.2 GB...well before the 32-bit computer can utilise its full  2.0 GB. Computers running 64-bit operating systems with 2.0 GB or more of RAM will have much higher limits.  We have documented files of 8 million rows and 15 columns (120,000,000 cells) running on 64-bit servers with 8 GB of RAM, and some prototyping installations are currently using up to 16 GB of RAM.

Running on 64-bit Platforms

A 64-bit version of Omniscope is now available.  More info.

Hidden columns 

If you are dealing with very large data sets, or plan to distribute very large Omniscope report files to desktop machines with 256 MB or less of RAM, you can minimise peak Omniscope memory use by hiding all unused columns (use Edit > Manage Fields > Hide Field). A data field (column) is not loaded into memory until it is actually displayed, so opening views that display many fields, like the Chart View and the Table View, should display only the most useful fields. Fields rarely needed for filtering should be shown in views only on Report Pages for users who need to view and filter by the values in that field. Users who never open these Report Pages will have lower peak RAM requirements and better performance.

Omniscope includes tools to help analyse memory use and optimise very large files for a range of recipient machines. These tools are documented here.

Impact of Views employed

The use of certain views limits scalability and performance in the upper reaches of file size. Omniscope performance in some views is also sensitive to the number of unique category values being used in the view.

Tree View:  this view is not currently architected for very large data sets. If you do not need it, you should hide this view so that users are not tempted to try it with very large data sets.  If you need to use the Tree View with very large data sets, please contact us for assistance.  Future versions will perform better.

 

Pivot View: currently does not handle very large numbers of categories well, especially on slower processors. If you encounter slow performance, try reducing the number of unique categories used in the Pivot View by setting wider category limits ( 'buckets' ).  Future versions will perform better with more unique categories. For more information, see Pivot View Data Truncation.

 

Back to Scaling & Performance 


Knowledge Base Top

64-bit Platforms

Running Omniscope on 64-bit Platforms

Beginning with Omniscope 2.4, a 64-bit installer is now provided. From the download page you can now select "Windows (64-bit)" under the section entitled "Also available for". If you choose the full installer, a 64-bit private version of Java will also be installed. Both 64 and 32-bit versions of java can run on the same machine, but both 32 and 64-bit versions of Omniscope cannot run on the same machine at present.

File size benefits - 64-bit avoids the 32-bit Windows bottleneck on memory addressing

Devices running 32-bit Windows and Java can only allocate for Omniscope use a little over 1 GB of system memory, limiting Omniscope file size to a little over a million records. Devices running 64-bit Windows and Java are limited only by the amount of RAM physically present. It is now quite easy to purchase PCs at consumer prices with say 4 GB or more of memory, although the PC must have a 64-bit Windows operating system installed to use more than about 3 GB.

Full 64-bit platform functionality limitations - some things do not yet work

If you have 64-bit Windows, and also 64-bit Java and 64-bit Omniscope, the following will be unavailable:

  • The DataPlayer view - you will not be able to create and export interactive Flash DataPlayers
  • The Web view
  • Google Maps within the Map view

If you have 64-bit Windows and you install 32-bit Java and 32-bit Omniscope (use the offline bundled 32-bit Installer for both Java and Omniscope), full functionality will be available, but maximum file size/RAM utilisation will be the same as for 32-bit Omniscope. Note: If you have 64-bit Windows, and you install only 32-bit Java, you cannot install 64-bit Omniscope.

More detail 32 versus 64-bit 

Operating systems and programs both come in two versions; 32-bit (each instruction processed is 32 bits long) and 64-bit (each instruction processed is 64-bits long).  Most processors are 64-bit capable now, and most powerful servers have already been converted to 64-bit because of its superior speed and higher memory-addressing limits. Vista is available for the desktop in both 32-bit and 64-bit, and the trend is to convert 32-bit desktop computers to 64-bit as they are replaced over the next few years. Windows XP, 2003 Server and Vista are all available in 64-bit versions.  The 32-bit version of Omniscope (which can be installed on both 32-bit and 64-bit Windows) suffers from the Windows-imposed memory limit, effectively limiting the typical Omniscope file size to about 1.2 million records because Windows is unable to provide Omniscope with access to more than about 1 GB of installed RAM.  Running 64-bit Omniscope on 64-bit platforms removes this limit (like using longer telephone numbers permits more numbers to be issued) and allows Omniscope to scale up to multi-million record capability on machines with 4 or more GB of installed RAM.

The 64-bit version of Omniscope provides far greater capabilities in terms of data volume than the 32-bit version, but requires a 64-bit processor (almost all now are) and a 64-bit version of Windows (x64 version of XP, 2003 or Vista 64-bit) and also the 64-bit version of Java (installed along with Omniscope 64-bit full install). The 64-bit Omniscope installer is a different installer, but it installs to the same location, and there is no additional licensing implication of running on 64-bit systems. However, existing licenses should be de-activated before, and re-activated after, switching between the 32-bit and 64-bit installation. If you are installing Omniscope on a machine running a 64-bit version of Windows, for example, you will not escape the addressing memory limit in the default 32-bit Java unless you also install and run the 64-bit version of Java bundled as a PVM with 64-bit Omniscope. To switch between 32-bit and 64-bit Omniscope on a 64-bit Windows PC, you must de-activate your license (if you have one), re-install Omniscope using whichever installer you choose, then re-activate your license if your are outside the free trial period.

Customising 64-bit RAM memory allocation

By default, the 64-bit version of Omniscope limits Omniscope to 75% of physical RAM memory.  If you wish to increase or decrease this, read on.

In the Omniscope Program Folder (typically found in Windows at C:\Program Files\Visokio Omniscope ) there is a file called installconfig.properties. Open this file in Notepad (it should look similar to the text below) and look for the line starting #MAX_MEMORY_MB= (highlighted below). By default this line is commented out with a #.  Remove the # in front (and leave no spaces at the beginning of the line), and enter the value in MB (e.g. 3500 for approximately 3.5GB) at the end of the line.  Save the file with this change.  Note: if you change back to the 32-bit version, this line must be commented out again.

...

# This is an optional manually-specified max memory cap for the Java VM, an integer specifying the
# megabytes to allow the JVM. Must be at least 64.
# If unspecified, 75% of physical RAM will be used as the cap.

# MAX_MEMORY_MB=300

...

Back to Scaling Omniscope


Knowledge Base Top

Pivot View

Pivot View data truncation

 

The current version of the Pivot View has a memory use profile that prohibits large datasets and large cell counts. To avoid out-of-memory errors, which can be fatal, the Pivot View automatically truncates the number of rows and/or columns shown when necessary.

When this happens, Omniscope dipslays warning in red below the pivot table such as:


Warning: data has been truncated to show only the first 70 columns and 71 rows. Click for details.

The truncation of the X and/or Y values happens irrespective of sorts, so do not assume the smallest values are truncated first.

Reducing / avoiding data truncation

To avoid this behaviour:

  • Change the X and/or Y fields in the View Toolbar. Choose Category fields with fewer unique values
  • Reduce the amount of data (records) showing. Do this either at source or by filtering.
  • Install more RAM memory in your PC.

Disabling data truncation

If you are a power user, you may wish to experiment with disabling this safety check because the imposed limit is conservative. Please save your work before proceeding.

To disable truncation for the duration of your Omniscope session, click the red warning label and choosing Show all values.

To disable truncation permanently, un-tick Tools menu > Advanced tools > Application-wide settings > Misc. > Truncate rows/columns in Pivot view to avoid out-of-memory errors.

You may need to re-open the file.

 

Back to Scaling & Performance


Knowledge Base Top

 

Memory diagnosis

Memory diagnosis

 

Omniscope 2.3 introduced new tools to help Visokio diagnose specific memory problems, whether leaks or out of memory errors. A memory leak is when Omniscope's memory footprint increases over time during the same session for no apparent reason, resulting in eventual slow-down (typically over a significant period of time). An 'out of memory' error occurs when an operation is attempted for which there is not enough physical memory in your PC allocated to Omniscope.

To use these tools, you will need Java 1.5.0 b7+ or Java 1.6+. Check your active version of Java in Help > About. Use Java 6 if possible, as the memory tool support is much better. You will also need Omniscope 2.3 or later.

Diagnosing memory leaks

If Omniscope appears to slow down over time, when the data and view complexity is relatively constant, particularly after a long period of use, this is likely to be a memory leak. Please see Memory leak analysis.

Diagnosing out of memory errors

There are some datasets that Omniscope can't handle if there is not enough memory available. However, you may discover a fault where Omniscope attempts to request more memory than it should. If this occurs, you can configure automatic generation of memory dump files, which you can send to Visokio for analysis.

The Memory Diagnosis tool

Open the Memory Diagnosis tool by pressing Ctrl+Shift+Alt+M or choosing Tools > Advanced tools > Diagnose memory use.

If you have Java 5 (1.5) or earlier you will see a Force out-of-memory button which is used to trigger a memory dump. Naturally occuring out-of-memory errors will also trigger this. You will need to have edited your installconfig.properties file to enable "heap dump on out of memory" prior to starting Omniscope. When you are confident a memory leak is apparent, make sure you have saved your work, and click this button. This will cause a memory dump file (*.hprof) to be created in the program folder.

If you have Java 6, you will see a tickbox Dump memory on out-of-memory. Tick this box to enable memory dumping. You will also see the button Dump memory. Use this button to create an ad-hoc memory dump file - you will be prompted to choose for a save location, then Omniscope will freeze for a few seconds as it generates the dump file.

Note that memory dumps can take up a lot of space on disk, so generate memory dumps sparingly and clean up old files.

Sending us memory dumps

Please contact us before attempting to produce or send memory dumps. If you are trying to open 1 million records on a Windows 98 PC with 64 MB of RAM, for example, this will never work. Memory dumps can be large, so please compress using ZIP or another common format. Please be sure to give us the full product version (e.g. "2.3 b231") if you send us a dump file.

 

Back to Scaling & Performance


Knowledge Base Top

Leak analysis

Memory leak analysis

A memory leak may be the cause if Omniscope's memory footprint increases over time for no reason. memory leaks are unlikely in production releases of Omniscope, but more likely in daily, alpha or beta releases. If you suspect a memory leak in Omniscope, please follow these steps to verify the leak.

Verifying a memory leak

The Memory Diagnosis tool  is used to observe the patterns in the Omniscope's memory use. Press Ctrl+Shift+Alt+M in Omniscope to open this tool.

Memory management algorithms in the Java VM used by Omniscope can cause apparently random fluctuations - sudden increases and drops, or small continuous changes. We will use the Extreme GC button (which takes about 8 seconds) to ask Omniscope to free up as much non-essential memory as possible, removing this "noise" from the results. We will leave the Memory Diagnosis window open throughout this analysis.

Steps

First you must identify and narrow down the task or group of tasks causing the leak.

Then do the same exact task 3 times (or more) in a row.

After both iterations 2 and 3 (and perhaps further), click the Extreme GC button and note the memory usage. Ignore small changes (1% differences), but anything larger is a potential leak.

Example results:

Not a leak:
- exit and open report page X
- exit and open report page X -> Extreme GC -> 150mb
- exit and open report page X -> Extreme GC -> 150mb +/- approx. 1%

Probably a leak:
- exit and open report page X
- exit and open report page X -> Extreme GC -> 150mb
- exit and open report page X -> Extreme GC -> 160mb

You have to do at least 3 iterations, but may choose to do more. If, for example, you do 5 iterations, and there is a steady increase across several of the iterations, this is an even more compelling proof of a leak.

Note: it is not considered a leak if a task consumes memory which isn't released immediately, but only if the exact same task done repeatedly consumes more and more memory in a memory-confined situation (simulated by Extreme GC). This is why we discount any increase in memory used for iterations 1 to 2.

I have found a memory leak - what next?

Please report from inside Omniscope using Help > Error reporting -> Report a problem.

In the report, describe the task you are repeating in precise detail. Include the results of your memory diagnosis.

You may be subsequently contacted to ask for the IOK file (in confidence), so keep a copy of the file in the correct state needed to reproduce the problem (layout, data, settings, etc.).  We may also ask for a memory dump, although this is unlikely.

 

Back to Omniscope Scaling


Knowledge Base Top

DataPlayer Scaling

Flash .SWF DataPlayer Scaling and Performance

 

The maximum number of records that will perform well inside a DataPlayer is evolving along with Flash itself. The effective upper limit depends on the size and character of the data set (number of cells= rows x columns), and the configuration of the DataPlayer. In general, DataPlayers containing 5,000 records or less will perform very well on most modern machines. Depending on content and configuration, 10,000 record (and beyond) DataPlayers are possible. We are in the process of re-writing underlying code in ActionScript 3, which should dramatically increase the scaleability and performance of DataPlayers by early 2009.

The best way to determine how your data will perform with various record counts inside the DataPlayer is to use the free 30-day trial of Omniscope Professional to make some samples for testing.

 


Large Scale Examples

This section provides some links to working examples of DataPlayers containing relatively large record sets, together with some hints regarding performance optimisation in the data and settings necessary to accommodate relatively large numbers of records.

Bonds Example: 20 columns x 6,241 records = 124,820 cells

Arguably, this demo really has too many columns to be useful, since the values in most of the columns are not used for selecting, only shown in details. The record details could just as easily be shown on linked pages, rather than embedded inside the Flash file. This demo is displayed here for reference only.

This demo normally loads without warning notices and runs well in most recent browsers. However, when loading this page, some older browsers and less powerful machines may see a notice (sometimes repeatedly) from the Adobe Flash plug in:

"A script in this movie is causing Adobe Flash Player 9 to run slowly. If it continues to run your computer may become unresponsive. Do you want to abort this script?" If the user presses No, (sometimes repeatedly) the loading will continue and the DataPlayer should eventually display:

 

 

 

 

 

 

 

Back to Scaling & Performance


KnowledgeBase Top

Source Data Files

Importing from Source Data Files

This section covers importing and exporting data supported data file formats to/from Omniscope. This includes delimited tabular data that has been exported in data file  format from relational (SQL-compliant) database tables/views, analytical OLAP 'cubes' and other business intelligence data repositories, data warehouses, 'clouds' and 'marts', etc.

This section covers importing from/exporting to data files. Importing data directly from relational databases, using either ODBC (one database, multiple tables) or JDBC (multiple databases, multiple tables) is configurable using the Database Wizard as explained in the database connections section. Visokio applications will also import and export tagged data in XML format, assuming it has been transformed to a tabular layout using the simple Visokio XML schema (essentially the equivalent of a .CSV file expressed in XML). See XML schema for more details.

Omniscope either currently supports (or plans to support) almost all of the most appropriate data import and export file formats, whether used by desktop-installed applications, such as Microsoft Office, Corel WordPerfect X3/4, or open-source files from suites such as Open Office, IBM Lotus Symphony (and others) or by online, remote document hosting services such as Google Docs & Spreadsheets, Microsoft Office Live, etc.

Data file formats supported:

Tabular data files usually use a special character as a delimiter, a way of separating values and associated headers from the subsequent values.

.CSV: Comma separated values

Omniscope supports the most common implementation of .CSV, which is more a de-facto than a formal standard.

.TSV: tab separated values

Omniscope recognises and opens .TSV files.

.TXT: text files

Omniscope imports and exports column lists of values from a field (column) as .TXT files. Note that some files with a .TXT extension are actually tables with a tab delimiter. You must change the extension on these files to .TSV in order to open them as tables. (see .TSV files above)

Semi-colon delimited files

These files tend to be used in countries where the comma is used in numeric values as a decimal separator. These files may have .CSV or sometimes .TXT extensions. Viewing the first lines of the file in a text editor like Windows WordPad will show if the delimiter being used is a semi-colon. If you find that that your .CSV file is a semi-colon delimited file, you must change the file extension to .CSV (if it is not already). Omniscope will then permit you to import the data by setting the delimiter to semi-colon. To do this, use File > Open file to point at the .CSV file. Be sure to tick the box at lower right 'Customise data import behaviour'. This will display a list of additional options, including the option to change the delimiter character from the default comma to, in this case, a semi-colon.

Other delimiter characters

Some files with .TXT and other file extensions actually use other characters as delimiters. For example, a common SAP and SAS data file delimiter is the | (pipe) character. To open a file with an unusual delimiter, first change the file extension to .CSV, then use File > Open file to point at the file. Be sure to tick the box at lower right 'Customise data import behaviour'. This will display a list of additional options, including the option to change the delimiter character from the default comma to whatever character is used in your file.

Microsoft Office: .XLS & .XLSX Excel Workbooks

Omniscope inter-operates with Excel files for import & export, provided that the copy of Excel is installed locally on the same machine. Excel interoperability is currently on the Windows operating system only. Omniscope interoperability with Excel is constantly being improved, and will soon be available on the Mac operating system as well.

(for information regarding support for Flash DataPlayers by Microsoft Office documents/applications, please see the DataPlayer document compatibility list)

Corel WordPerfect X3/X4: .QPW Quattro Pro files

Omniscope supports Quattro Pro .QPW v9X3 & X4 files. Using Quattro Pro, Lotus 1-2-3 and Borland database files (Paradox & dBase) can be opened, saved as .QPW or other supported file formats on this page, and imported into Omniscope.

(for information regarding support for Flash DataPlayers by Corel/WordPerfect documents/applications, please see the DataPlayer document compatibility list)

Open Office/Star Office/Symphony: Open Docs

Omniscope currently does not, but will soon support the Open Docs standard for tabular data files. There is a plugin to upload Open Office documents directly from OO.org into Google Docs, the Connector for which is currently an experimental feature in Omniscope (see below).

(for information regarding support for Flash DataPlayers by Open Docs documents/applications, please see the DataPlayer document compatibility list)

Online/collaborative platform data file formats

Online document/office suite services are sometimes used to enable collaboration on the assembly, scrubbing and approval of data and image sets, together with associated web links, map coordinates, etc. Importing online data sets into Omniscope can greatly assist this process, especially during the scrubbing and approvals phase.

Google Docs & Spreadsheets

Support for Google Docs & Spreadsheets is currently an experimental feature in Omniscope. Depending on demand, support for other emerging online application suites (Zoho Sheet/CRM, Live Documents, Zimbra etc.) may also be added.

Other directly importable data files

Apache .LOG Web Access log files

Omniscope Professional & Enterprise will open Apache Web Access .LOG files directly for visualisation, analysis and reporting.

FIX logs and other file types

If you would like Omniscope to open/import or export other file formats associated with applications you control, please contact us.


KnowledgeBase Top

Database Connections

Database Connections

 

This section covers importing data directly into Visokio applications from SQL-compliant relational database tables/views using the Database Connection wizard and standard ODBC or JDBC protocols. Omniscope can import the results of any SQL statement that returns a table using either ODBC (one database, multiple tables) or JDBC (multiple databases, multiple tables) protocols.

Note: Importing and refreshing from source data files in various formats, including data files exported from relational databases, is covered in the section on importing/exporting to/from source data files .

Topics:

Introduction to ODBC & JDBC- two standard ways of connecting to relational databases, these options are sufficient for most solutions


Connecting to Relational Databases- examples of making connections to reporting views from typical relational databases from various vendors

 

Connecting to analytical databases and OLAP 'cubes'- (in progress)


DSN-less ODBC- method of connecting/refreshing multiple machines on a network without the administrative overhead of configuring the data source on each machine

 


KnowledgeBase Top

ODBC & JDBC

ODBC and JDBC

 

ODBC and JDBC are industry standard protocols for connecting directly to tables and views in relational databases. It is relatively easy for you or your Database Administrator to connect Omniscope to databases directly using the Omniscope Database Connectivity wizard and either ODBC or JDBC. Omniscope can import the results of any SQL statement/query that returns a table using either protocol. Using ODBC it is possible to connect to tables/reporting views drawn from only one database. Using JDBC, it is possible to connect to joins of tables/reporting across multiple databases. In general, JDBC connections perform somewhat better than ODBC.

 

ODBC - Open Database Connectivity provides a standard software API method for using database management systems (DBMS). The designers of ODBC aimed to make it independent of programming languages, database systems, and operating systems.  For more detail, see Wikipedia

JDBC - Java Database Connectivity is an API for the Java programming language that defines how a client may access a database. It provides methods for querying and updating data in a database and is oriented towards relational databases. The Java Platform, Standard Edition includes the JDBC API together with an ODBC implementation of the API enabling connections to any relational database that supports ODBC. For more detail, see Wikipedia

 

For more detail on how to connect Visokio applications directly to one or more databases using ODBC and JDBC see Connect to Databases.


Knowledge Base Top

Connect to Databases

Connecting to Databases

 

Omniscope includes a Database Wizard to help establish direct connections to database tables and reporting views. Omniscope will import the results of any SQL statement/query that returns a table. The Omniscope Database Wizard is accessed via the File > Connect to database command, documented here.

In order to connect directly to a database, rather than importing a .CSV or .TSV data file exported from a database, you need to know the type of database and its connection details. Using the Visokio Database Wizard, you enter the connection details for your database and choose which database table or reporting view you wish to retrieve data from. By default, this will create a persistent linked data source relationship between this database table/view and the .IOK (Omniscope) files you are creating.

If you connect via ODBC, you can access multiple tranactional tables, but only one database.  If you connect via JDBC, you can retrieve data from multiple tables in multiple databases, and performance will also be better.  If you do not know how to write the SQL query that assembles the reporting view you want to import into Omniscope, ask your Database Administrator to add the query in Omniscope so that every refresh re-creates the reporting view, drawing the latest information from multiple transactional tables within the database(s) to create a single, 'flattened' tabular view of the data for scrubbing, analysis and reporting.

Suggestion: Database tables are operational and transactional in nature. They are usually not intended to be shared with humans without some translation of the codes used in the tables. Rather than access a transactional table, try to use a reporting view that also translates obscure codes and other internal values to values meaningful to the humans receiving your reports. Also, it is better to include every record in the view, rather than making  too many pre-selections in the query assembling the reporting view. Errors in fields can result in some records not being included in the view if you are being too selective when assembling the reporting view. First try just dumping everything (people and all data linked to people, places, things etc.) into a few large reporting views extracted from the database(s). Open these views in a scalable visualisation  tool like Omniscope, then correct/scrub and filter/hide unwanted data visually. Also, speak to your database administrator about using corrections exported from Omniscope to help correct erroneous fields in the source database.

Warning: Preserving Changed and Merged Data- Omniscope does not currently support partial refresh from database tables/views. Linked data sources overwrite all the data in a given .IOK or .FFC file with data from the linked source only. If you have changed data manually, or imported columns of data from other sources, such as spreadsheets or departmental or personal databases, your changes will be lost on file refresh.  If you are using Omniscope to merge data from other sources, keep your merged data and commentary in a separate .IOK, .CSV or .XLS "merge file" to avoid those values being lost every time some of the data is refreshed from a linked source.  For more detail on using merge files to protect data from different sources, see  File > Import into current file > Merge data from another file in the Omniscope User Guide.

Connecting via ODBC

ODBC is a technology for connecting to most databases and requires you to set up a named ODBC data source in Windows. This is the approach needed to connect to an Access .mdb database, for example.  In Windows XP, go to Control Panel, Administrative tools and choose Data Sources. Click Add, choose the Access driver (or otherwise, depending on your type of database), choose the appropriate .mdb file and enter a suitable Data Source Name. Open the Omniscope Database Wizard under File > Connect to database and follow through the steps.

Connecting via JDBC

If you have a database such as Oracle or PostgreSQL, or wish to customise the database import behaviour, you can connect via JDBC using a JDBC JAR driver file obtained from the database vendor or 3rd party. This may need to be specific to your database version as well as vendor. You will need to know how to construct the "JDBC URL" for your database.

In the Database Wizard, choose JDBC and enter the JDBC JAR driver path such as:
"C:\Program Files\MyDatabase\Java\JDBC.jar", and the JDBC URL such as "jdbc:mydb:products".
Enter the username and password, if necessary, and choose the table or view you want to look at.
On the next page, you can customise the SQL statements, allowing you to JOIN multiple tables on the fly. Only change these values if you are familiar with the implementation of SQL for your database vendor and version. Finally, when connecting via JDBC, you can rename fields at import time, on the last page of the wizard, allowing you to change unreadable fields such as "CUST_ADR" to more reader friendly "Customer Address".

Guided examples of JDBC database connection parameters:

 

Working with databases

Saving the connection and refreshing

To save the connection details you have entered into the Database Wizard for subsequent refreshes, save the current file as an .IOK or .FFC file using File > Save as.... The new file will contain a highly-compressed snapshot of the data as it was when imported, plus all the database connection parameters you entered into the Wizard. Next time you open your file, you will see the old data, but you can refresh from the database view specified in the Wizard by choosing File > Import into Current File > Refresh from source.

Setting Field (column) data types

Unlike text-based data file import (such as .XLS or .CSV), Omniscope and DataPlayer/FeatureFinder do not automatically recognise and convert data drawn directly from databases upon import. Instead, the data type descriptions of the fields in your database are relied upon to determine data type in Omniscope and DataPlayer/FeatureFinder. If your database declares the field "CUST_AGE" as Text ("Char", "String" or "Varchar"), Omniscope will treat it as Text also. To avoid the need for manual changes, you must structure your source database correctly by declaring the field "CUST_AGE" as a numeric field (for example).

Editing data from databases

At present, database connections in Omniscope and DataPlayer/FeatureFinder are only one way, i.e they only import a copy of the data in the database table/view. You can make edits but cannot submit your changes back to the database table automatically. If you plan to edit data from databases in Omniscope or DataPlayer/FeatureFinder, you will need to agree a way of submitting your changes back to the database administrator (such as exporting a .CSV or .XML file and having the Administrator use some simple tools to import corrections made in Omniscope back to the database).

Warning: Preserving Edits- If you make changes to your .IOK/.IOM file, such as correcting the data type of a field, or editing data values, or adding/deleting records (rows), and you have not submitted the changes to be made back to the database administrator, your changes will be lost if you later refresh from source (see Saving the connection details, above). You can prevent accidental Refreshes from source by ticking Unlink from source in the File > Export > Export data dialogue, but this will also remove your database connection parameters from the .IOK file.

The above means that if you add, delete, rename or convert fields, these changes will not be applied to the source database unless you export a copy of the changes and discuss them with your Database Administrator. In the meantime, you will need to keep a record of your changes if you want to refresh from source. If these changes include new fields/columns which are not implemented in the database, you may need to create 2 files...one which is refreshed directly from the database, and one which you merge in yourself because it contains new or corrected fields/columns which are not carried or corrected in the database. There needs to be a column common to both files to enable you to merge them automatically...see the discussion under File > Import into current file > Merge data from another file in the Omniscope User Guide.


Knowledge Base Top

MS SQL Server-JDBC

Connecting to MS SQL Server

 

Connecting to Microsoft SQL Server 2000

The Omniscope Database Wizard under File > Connect to database guides you through the connection parameters. You will need to know the database server details (host name and port) and login details (username and password). At present, due to limitations in the Microsoft JDBC driver, your database must be configured to use Mixed Authentication and not Trusted/Windows Authentication (see here for more information).

Connecting to Microsoft SQL Server 2005

As with SQL Server 2000, your database server must be configured to use mixed mode authentication. The server must also have the TCP/IP network protocol enabled. You will need to have downloaded and installed the Microsoft SQL Server 2005 JDBC Driver. Do not use the "sa" administrative login; instead create a dedicated user for the database(s) you need to connect to.

Open the Visokio Database Wizard under File > Connect to database. Choose the "JDBC" option on the first page.

  • For Driver jar path, enter "C:\Program Files\Microsoft SQL Server 2005 JDBC Driver\sqljdbc_1.0\enu\sqljdbc.jar" or similar (depending on your installation).
  • For Driver class, enter "com.microsoft.sqlserver.jdbc.SQLServerDriver".
  • For JDBC URL, enter "jdbc:sqlserver://localhost;databaseName=AdventureWorks" (for example; see the Microsoft JDBC driver documentation for help).

Follow through the rest of the Database Wizard as usual, specifying a username and password, choosing a table, and optionally customising the SQL query.

 

Back to Database Connectivity 


Knowledge Base Top

Oracle Thin JDBC-10g

 Oracle Thin JDBC-10g

A guided example to connecting to an Oracle 10g database using the Oracle Thin JDBC driver.

Scenario

Database version: Oracle 10g version 10.1.0.2.0
JDBC driver: 'Thin' JDBC driver for Java 1.4.
Database server host name: localhost
Database server port: 1521
Database instance SID: “orcl”
Table or View name in database: TEST

Other versions of Oracle

Unless you're using a really old version of Oracle this approach should work. Alternatively, see the Oracle 8.1.7 page.

JDBC driver

You will need the Oracle JDBC driver. This is a file called “ojdbc14.jar” and is normally installed by default alongside the database server/tools. Alternatively it can be found in the download archive or installation CD, or on the Oracle website. This is a pure Java driver for connecting to local or remote Oracle databases.

Steps

Choose Connect to database from the File menu. The Database Connection Wizard will appear:

1. Connection type

  • Select JDBC data source
  • Click Next

2. JDBC Details

  • Driver jar path: enter the path to and including classes12.zip. For example:
    D:\Oracle\product\10.1.0\Db_1\jdbc\lib\ojdbc14.jar
  • Driver class:
    oracle.jdbc.OracleDriver
  • JDBC URL: of the format “jdbc:oracle:thin:@hostname:port:sid”. For example:
    jdbc:oracle:thin:@localhost:1521:orcl
  • Click Next

3. Authentication

  • Tick Authenticated, and enter the user name and password to access this database.
  • Click Next
  • If you can’t get to the next page, there’s a problem with steps 2 or 3. Go back and check your settings.

4. Choose table

  • Select the table or view from the list that you want to query. For example:
    NEW_CUSTOMERS
  • Click Next

5. Customise SQL

  • Unless you want to perform an SQL join (for example) on the fly, you can leave this unmodified and click Next.
    Note: If you enter custom SQL, the Oracle JDBC driver does not support functions; if you need to use functions, create a View using the desired functions in your database, then connect to that View as if it were a Table.

6. Columns

On this page you can change the names of columns as they appear inside the Omniscope. This allows you to change unwieldy database column names. For example, you might want to change “CUST_NAME” to “Customer Name”. But you don’t have to do anything on this page.
  • Click Next

7. Specify a title

  • If desired, you can name this dataset.
  • Click Finish

Exploring your data

Once the Omniscope has finished opening the data, you’ll see a Table, Chart and Pie View, and a set of devices on the right. You can change to different views (visualizations such as Graph and Map) by clicking “Table view”. You can filter data by dragging sliders and clicking checkboxes on the right. The green/red barometer at the top will show you records that have been included or excluded. The Reset button resets all filters to show all records.

Save your settings

It is recommended that you save an IOK file (from the File menu) to save going through the database wizard again for this particular database table. In future, you can open this IOK file, and optionally refresh data from the database (picking up any updated records).


Knowledge Base Top

Oracle 8.1.7 Example

Oracle 8.1.7 Example

Connecting to an Oracle 8.1.7 database

Oracle 8.1.7 or similar versions may connect successfully using the same approach as for Oracle 10g. However, here is a tried and tested approach with this older version of Oracle. The process is the same as for Oracle 10g but with the following changes:

JDBC driver

You will need the Oracle JDBC driver. This is a file called “classes12.zip” and can be downloaded from Oracle (search for “Oracle JDBC driver” and look for “classes12.zip” for Oracle 8.17). It should be on the Oracle CD and/or in the installation directory.

Next Step:

  • Driver jar path: enter the path to and including classes12.zip. For example:
    C:\oracle\jdbc\lib\classes12.zip
  • Driver class:
    oracle.jdbc.driver.OracleDriver

Knowledge Base Top

Connection Caching

Database Connection Caching

Since Omniscope 2.3, database connection caching is supported. This is mainly of use in server installations, and should be ignored for typical desktop use as it will provide little benefit.

Connection caching allows an Omniscope instance to retain and reuse database connection objects, which can improve performance.

By default, desktop Omniscope installations cache 1 connection for up to 5 minutes after use.

Connection caching has the following options:

NameMeaning
Default
visokio.dbcc.maxallMaximum number of cached connections for any data source
1 (5*)
visokio.dbcc.maxperMaximum number of cached connections for each data source
1 (5*)
visokio.dbcc.maxageMaximum age of cached connections (in milliseconds) - e.g. 5 minutes is 5x60x1000 = 300000
300000*
visokio.dbcc.debugTrue/False - If true, database connection caching status and activity is printed to the console - useful for debugging server configuration false

* Use zero for these options to disable caching - connections will be created and discarded immediately before and after use. The numbers in brackets are the defaults used when the Omniscope process is in headless / silent mode.

 

These options can be configured by editing installconfig.properties in the installation folder (typically C:\Program Files\Visokio Omniscope) and adding/changing the ADDITIONAL_JVM_ARGS property. For example, the following turns on debug output and a 2 second expiry:

ADDITIONAL_JVM_ARGS=-Dvisokio.dbcc.debug=true -Dvisokio.dbcc.maxage=2000

 

If you are running Omniscope Enterprise tools as a service, you instead need to edit "C:\Program Files\Visokio Omniscope\service\wrapper.conf", by adding lines such as:

wrapper.java.additional.1=-Dvisokio.dbcc.debug=true
wrapper.java.additional.2=-Dvisokio.dbcc.maxage=2000

Restart the service after making changes. Warning: at present this "wrapper.conf" file is overwritten on re-installation of Omniscope. Look in "wrapper.log" for debug output when running as a service.

Back to Database Connections 


Knowledge Base Top

ODBC without DSN

Using ODBC without DSN (Data Source Name)

The Omniscope Database Connection wizard supports ODBC data sources. Normal use of ODBC connections entails configuring an ODBC data source on each client PC requiring connectivity to the database for refresh. In Windows XP, for example, this configuration is done on the client using Control Panel, Administrative Tools, Data Sources. When distributing an .IOK file to numerous desktops within an organisation, if 'refresh from source' functionality is desired, this could require the same ODBC data source to be manually configured on every PC... potentially time-consuming for central administrators

Fortunately, it is possible to configure a "DSN-less" ODBC database connection within Omniscope. This encapsulates the full database connection parameters within the IOK file, and (providing the ODBC database driver is available) requires no administration on each client PC. This allows Omniscope to refresh data from the underlying database automaticallywhenever the .IOK file is opened on the client PCs. Omniscope can also be refreshed by users 'on-demand' using File > Import into current file > Refresh from source.

DSN-less ODBC Configuration 

Start Omniscope, and choose File > Connect to database. The Database Connection Wizard will open. Select ODBC and click Next. You will see the ODBC configuration page with the field Data Source Name.
Normally, when using a user- or system- configured ODBC data source, you would enter the name of the data source (the DSN) here. Instead, to avoid configuring the data source on all client machines,
you must enter the full DSN-less ODBC connection string. This is a line of text containing name=value definitions separated by semi-colons. Any values containing spaces are enclosed in curly braces. This describes the parameters of the ODBC data source.

For example, to connect to a sample Access database, you might use the following in the Data Source Name (DSN) field:

DRIVER={Microsoft Access Driver (*.mdb)};DBQ=C:\db1.mdb
All ODBC DSN-less connections begin with DRIVER= however all other parameters are database vendor-specific, although they often are similar.

Discovering the Connection String

To find out the connection string specific to your database vendor and configuration, use the Windows ODBC Data Source Administrator:
  • On a typical client PC, open Control Panel -> Administrative Tools -> Data Sources.
  • Select the File DSN  tab and click Add.
  • Select the appropriate driver (e.g. "Microsoft Access Driver (*.mdb)") and click Next
  • Click Browse and choose where you want to save the .dsn file (this is a temporary file you are going to delete later).
  • Click Next then Finish.
  • You will be shown the vendor-specific ODBC setup dialog. For example, with Microsoft Access, you might only need to click Select and browse to an existing .mdb file before clicking OK.
  • Browse to the location of the .dsn file and open using Notepad.

In the DSN file you might see something similar to:

[ODBC]
DRIVER=Microsoft Access Driver (*.mdb)
UID=admin
UserCommitSync=Yes
Threads=3
SafeTransactions=0
PageTimeout=5
MaxScanRows=8
MaxBufferSize=2048
FIL=MS Access
DriverId=25
DefaultDir=C:\
DBQ=C:\db1.mdb

To convert the above to the full connection strring:

  1. Omit the first [ODBC] line
  2. Put curly braces around all values containing spaces
  3. Put all name=value pairs on one line, separated by semicolons.

This gives you the full connection string. In this example, the string becomes:


DRIVER={Microsoft Access Driver (*.mdb)};UID=admin;UserCommitSync=Yes;Threads=3;SafeTransactions=0;PageTimeout=5;
MaxScanRows=8;MaxBufferSize=2048;FIL={MS Access};DriverId=25;DefaultDir=C:\;DBQ=C:\db1.mdb


Note: This is more verbose than absolutely necessary, the following will suffice, in this example:


DRIVER={Microsoft Access Driver (*.mdb)};DBQ=C:\db1.mdb


Finally, paste this connection string into the ODBC Data Source Name field of the Omniscope Database Connection wizard, as described above.

Examples:

The following examples have not been verified:

Oracle: DRIVER={Oracle ODBCDriver};UID=Kotzwinkle;PWD=whatever;DBQ=instl_alias;DBA=W

AS400: Driver={Client Access ODBC Driver (32-bit)};System=myAS400

Excel: Driver={Microsoft Excel Driver (*.xls)};DriverId=790;Dbq=c:\somepath\mySpreadsheet.xls;DefaultDir=c:\somepath

SQL Server: Driver={SQL Server};Server=MyServerName;Database=myDatabaseName

References

More information and examples for ODBC connection strings can be found on the following pages:

http://www.asp101.com/articles/john/connstring/default.asp (scroll down to ODBC DSN-less)

www.oracle.com/technology/docs/tech/windows/odbc/htdocs/817help/sqoraFormat_of_the_Connection_String_.htm

http://www.databasejournal.com/features/mssql/article.php/1491011


Knowledge Base Top

Deployment Options

Deployment Options

 

This section deals with various options for deploying Visokio application files, Omniscope .IOK/.IOM files and DataPlayer Flash .SWF files created by DataPlayer Studio/FeatureFinder Web. Omniscope .IOK files can be opened by anyone with a free Viewer installed. Omniscope .IOM files can be opened only by activated Omniscope installations, i.e. Omniscope Standard or better. Omniscope Web Start files (available soon) can be opened even on desktops with no installation privileges.

Omniscope .IOK/.IOM files, Omniscope Web Start (zero-footprint temporary install) and universally-accessible Flash DataPlayer .SWF files embedded in web pages and documents provide a wide range range of options for publishing data sets interactively, both internally and externally.

Table of Contents:

Publishing .SWFs on web pages

Web Server Configuration

Limitations of Applets

Web Start Issues

Using the Command Line


Knowledge Base Top

Publishing .SWFs

Publishing Flash DataPlayer .SWFs on the Web

Omniscope DataPlayer & Enterprise Editions export web-ready file structures (with minimalist HTML display page) containing the DataPlayer .SWF files ready for display on the open Internet.  DataPlayers produced by licensed copies of Omniscope can be displayed on any inter/intranet domain. DataPlayers produced by FeatureFinder Web will display on nominated domains/sub-domains only.

Note on managing images: Although DataPlayer .SWF files can incorporate images for use in Tile View, they will be fixed in size and often reduced resolution. The original, higher resolution images can also be displayed on the web in the DataPlayer Details View, but only if the entire folder containing the original, larger/higher resolution images is also uploaded to the web server in the same relative directory location as when the image set was originally specified in the .IOK configuration file from which the DataPlayer was exported.

Export File Set

Once you have configured an Omniscope DataPlayer .IOK project file, previewed the .SWF on your desktop and saved all your configuration settings in the .IOK data file, you are ready to export your DataPlayer SWF file set for display on the web.  Just click the 'Save for Web' button on the Save Settings and SWF page. When you click 'Save for Web', the DataPlayer is exported within a web-ready file structure with a minimalist HTML display page in the top level of the directory structure.

Copy and Edit Top Page

Once DataPlayer/FeatureFinder Studio has finished exporting the web file set containing the DataPlayer, open the resulting HTML display page (bearing the name of the project, in the top directory of the file structure) with a standard HTML editor such as Adobe DreamWeaver or Microsoft FrontPage. You will see that the exported display page is minimalist, with only enough mark-up to display the DataPlayer .SWF in a browser. The minimalist page has none of the final HTML layout, scripting or content (with which you or your web master will want to surround the DataPlayer) for display on the web.
 
Suggestion: Good practice at this point is to make a copy of the top-level, minimalist HTML display page, change its name and put the copy into the same location alongside the original. From then on, only paste your own mark-up, scripting etc. into the re-named copy. This way, if you modify the DataPlayer and re-export its file set, the original minimalist display page is overwritten, not your own elaborated version. The underlying DataPlayer files referenced in your own version of the display page are all updated, and they are still referenced properly assuming their relative position in the directory structure has not changed.

Upload

When you are happy with the look of both the DataPlayer and your own HTML mark-up and scripting surrounding it, upload the entire file set and the original images folder (if any) to your web server (preserving the directory structure).

Warning: If you are using UNIX/LINUX web hosting, remember that all file names/references will be case-sensitive. Check all the references in the files produced by Omniscope against your own namings to make sure that upper and lower case is being used consistently in the file names and all references to the files.


Knowledge Base Top

 

Web Server Configuration

Publishing .IOK files on Web/CMS Servers

MIME type configuration

Most web servers do not require any configuration at all.  However, publishing IOK files on a few web or content management servers may require the following MIME type configurations on the server:

Extension: .iok
MIME type: application/vnd.visokio.omniscope-iok   (or use the generic binary mime type application/octet-stream if this causes problems)

Example: Configuring Microsoft Internet Information Services (IIS)

  1. In IIS Administrative Console snap-in, right click the entire server and select Properties.
  2. On the Internet Information Services tab, click the MIME Types button.
  3. Add a new MIME type.
  4. In the Extension box, type ".iok" (without the quotation marks), and then in the Content type (MIME) box, type "application/vnd.visokio.omniscope-iok" (without the quotation marks).
  5. Click OK, and then restart IIS.

Server software known to require configuration:

  • Microsoft Content Management Server (configured in IIS, as above)

Server software known NOT to require configuration:

  • Apache 1
  • Apache 2

Knowledge Base Top

Applet Limitations

Applet Limitations

Background

Applets were first introduced several years ago to provide little animations inside web pages, before the days of Flash.  They are not architected for large applications and pose several problems, some insurmountable.  (please scroll to the end for discussion of alternative deployment options).

Insurmountable problems

Memory

Memory requirement in Omniscope is the result of a complex equation depending on upon data complexity, view configuration and use case. Omniscope was built to leverage the higher memory capacity of relatively modern PCs to provide a rich data navigation experience.

Applets are limited to 128mb of memory which, as a very rough guideline, may be enough to navigate smaller files with limited views. The only true way to find the applet memory limit for a particular type of data is to experiment with data size in terms of records and fields. 

Life-cycle Issues

"Life-cycle" is the manner in which an applica