GOL is Grep of Logs with interactive web GUI visualization:

Easily navigate and search log data with touch-enabled, zoomable Web user interface:

GOL: user interface for easy navigation and event search in log data

Visualize LOG DATA by timeline and by any custom content:

Image of interactive time chart for quick visual evaluation of baseline in log data Image of zoomable bar chart for navigation of log file entries

GOL provide visualization-based log data search, navigation and real-time discovery that offer interactive graphical views of massive amounts of log entries consolidated into a single GOLDB database along the events timeline.

Easily spot business-critical privacy data use log events that peak out or dive below normal baseline.

Zoom-in to closer view of log events directly in the graphs, quickly spot and categorize logged sources involved in the relevant log events for further investigation through cross-search, by person name, address, stemming, spelling, zoom-in or zoom-out, filtering or context matches.

Use either free text natural language text based search queries or 'grep' regular expressions to quickly discover, filter, pivot on log entries of interest.

GOLDB: Centralized Log Database

GOL server is a Log Data collection, search, reporting and analysis application software stores and accesses log records using a single centralized database golDB:

Schema with GOLDB architecture including most important features for log data consolidation

Database is serviced by a general purpose NoSQL document-oriented database management system with built in high-speed enterprise search engine.

golDB database is working as a simple free-format XML document database, where each log record about indiviudual person data use is stored as an XML document. It has very simple and efficient at performance meta data structure, where each tag element is named with a single or two letters only, to save storage space.

GolDB services as an ONLINE data repository for all your applications with log data.

It can scale out linearly to hundreds of servers and billions of records, and still deliver Google-like search across all log data content with free format Internet-style ad hoc queries and relevant results provided in seconds.

All of your log data can grow for months and even years with seamless database volume scalability in clusters and with virtually no search performance decline.

For mission-critical production environments you can easily configure golDB to run in multiple copies for data security and reliability, with no extra programming.

GolDB XML document structure is documented and database can be flexibly modified for integration with other applications and with new custom meta data.

GolDB database management is provided by centralized management system (Web-GUI). It allows to manage single or clustered databases, user access rights and log data through a single enterprise-grade administration system and one security policy.

Centralized LOG analytics platform with REST API

The GOL Server open REST API provides universal cross-platform way how to register log data use from any custom applications and from legacy IT systems.

Schema with GOL API for log data integration with third party applications

It enables online collection of log data in any custom format (including free text, structured and unstructured or mixed format data) into golDB database, storing and managing this data into portable industry standard XML data format.

Software delivers fast sub-second free text search in natural language and textual analytics such as stemming, proper names, spellcheck error correction etc.

Software due to its natural language queries support is a perfect solution for the collection and analytics of privacy related data log and audit record maintenance, analytics and reporting such as mandated by GDPR regulation in European Union and by personal data protection laws in other countries.

It enables to store, process and query log data in more than 160 national languages in the same cenralized log database: goldb, that can be used to quickly find relevant log data of interest for any person names, in combination with other log meta data.

Simple yet powerful REST API over web protocols (http, https) delivers operational real-time LOG data registration from any customer web and mobile applications.

Same API also delivers interactive search and querying for online reporting. GOL Server API supports software development of .NET, JAVA, PHP, PYTHON, C/C++ applications and contains more than 40 commands including CRUD operations.

GOL software platform components:

Schema with gol components for log data collection, consolidation and analysis

GOL Server: Use Cases

Clusterpark GOL Sever is an enterprise-grade log data analysis application software platform, massively scalable in a pool of inexpensive cluster equipment, complete with an open API and open industry standard XML database format.

It allows our customers to store log data for long term using cross-platform, interoperable with any 3rd party software. GOL software platform solution is based on a built-in ultra-fast enterprise search engine software.

GOL application software enables very fast log data analysis, such as detecting security breaches, application-related problem detection, log access in real-time, spotting of technical problems in network or server systems etc.

System administrators could optionally use GOL's same name command line utility that can deliver instantly relevant query-based searches in billions log entries consolidated into one centralized GOLDB database.

GOL is outperforming grep-utility several orders of magnitude in terms of pure free natural language text or phrase search speed.

Using regular expressions as in 'grep' utility on the small subset of relevant LOG data returned by GOL, administrators can avoid grepping of massive data sets with long waiting time or scrolling through all irrelevent log data to process.

The software provides massive productivity increase for system administrators, saving tons of time for them.

GOL Server Installation

GOL Server can be licensed online and downloaded as an ISO-image virtual machine software.

For onpremise customers we can offer custom made installation package, installed and configured for specific customer OSes and log record formats.

Package options are installations for Linux operating systems 32bit and 64bit versions - Suse, Centos, Debian, Fedora; FreeBSD, MacOS and MS Windows Server.

GOL operating system requirements

GOL Server works on Linux OS, FreeBSD OS and MS Windows OS servers or equivalent Virtual machnine OSes.

GOL web GUI application works with any industry standard HTML web browser supporting Javascript (MS Explorer/Edge, Firefox, Chrome, Safari etc) independently of client OS

GolLoader utility works as native softwre on Linux and MS Windows servers (with virtually installed Linux OS) and workstations.

GOL WEB GUI: LOG DATA search, reporting, visualization

Gol GUI provides visual search for log entry navigation offering highly interactive and graphical views of amounts of log entries for easy identification of meaningful log data events.

With a radically new approach to search, GOL can find in subsecond time (rather than in minutes or hours) all user, software systems, hardware, network or other logged data events.

GOL GUI features include:

Gol web GUI application is designed in HTML5 supporting all modern tablet and smartphone GUIs. It works across all major web and mobile platforms.

GOLLOADER - Client Agent For Loading Log File Data

GolLoader utility can be deployed to any virtual or non-virtual servers and workstations where log data for collection are located.

golLoder utilities deliver reliable, secure, real-time log data collection for up to tens of thousands of sources.

golLoader can collect log files from sources in local network and the ones situated in organizations VPN-protected WANs.

golLoader utility works on Linux and Windows operating systems. Optional Linux syslog and Windows event logs and other custom log data can be forwarded to golDB for consolidation and indexing.

golLoader utilities are lightweight, can be deployed quickly and configured from GOL interface at single location.

For enterprise customers we deliver golLoader source code for customization for enterprise specific log data batch and near-real-time incremental uploads.

Loader

Natural language the first class citizen in LOG DATA search

GOL Server and its GOL WEB GUI management tools are focussed on the ultimate simplicity of use and work productivity for human-friendly log files.

Essentially any authorized person to access GOL Server as administrator, having only basic IT knowledge.

For example, GOL administrator can instantly find any log event of interest, for instance, personal data use log events or a particular person or group of persons, by using few simple natural language terms or phrases for search: person's name, adress, parts of names, or their combination with parts of address etc.

Combining ad hoc queries with any known content that identifies person, GOL administrators can in few seconds narrow down on the particular person relevant log data events in portable XML data format for reporting and information disclosure needs that must be delivered to interested persons.

Image with google like three word query search results Image with google like log entry search results

Enjoy ad hoc search simplicity across all log data by using any known natural language textual content: words, phrases or their combinations. You can although search using text phrases, use word / phrase wildcards and word stemming as your query terms.

The GOL Server application will return all the matching results, that administrator can further explore by drill down, narrowing search terms scope, or make GDPR related reports, or make delivery reports in portable XML data format.

Instantly drill-down to specific LOG AND SECUROTY EVENTS of interest

Image of network chart for summarized view of log data sources Image with log data sources in the network organized visually in interactive charts

GOL provides interactive visual network graphs for summarized view of all sources sending the log data to consolidated log database allows you to quickly look at the overall infrastructure and log data transmission paths. It is useful for quick overview of log entries received from hosts, syslog servers and other devices without creation of search expressions with specific names and IP addresses.

Make Boolean expressions with AND, OR, NOT for complex search queries

Image with log entries found with boolean search Image with log entries found with combined boolean and google-like search

You can make very complex search queries with multi-level XML nesting, Boolean AND ( ), OR { }, NOT ~ logic, nest many ((( ... ))) expressions, combining Google-like text search terms

Enjoy faceted navigation enabling to instantly pivot on any segment of data

Image with example of pre-filtered facets for effective search of events Image with example of facets that characterize log events

Save your time by using pre-filtered terms to build an expression for more effective GDPR data use log event search. This becomes handy when it is difficult to identify the components that characterize events by looking at thousands of log entries.

Looking through the pre-filtered content, you can get advice on event related content, you may not have even thought to look, but that could prove to be important for further investigation of the events.

Online DASHBOARDS for real-time LOG DATA monitoring

Image of dashboard with time chart for evaluation of real-time events Image with dashboard for log data monitoring in real-time

Create dashboards to monitor your applications and infrastructure in real-time even with complex search queries. GOL dashboards continually refresh as new log data comes from logged sources.

As a result, real-time information is displayed and dashboard monitors show data with near-zero latency. GOL is uniquely capable of delivering real-time monitoring of processed terabytes of privacy related log data and delivering immediate results.

Automatic ALERTING for crucial LOG DATA events

Image with example list of real-time log data alerts Iamge with example of log event auto-detection and log data monitoring

GOL use custom search queries and rules on log data for alerts. You can get alerts by email or other media and troubleshoot problems before end-users get affected.

Use the auto-detection monitoring system both on homegrown privacy log data formats and infrastructure server logs for custom applications. GOL save your time with alerting by monitoring errors, IP addresses, problems, rules, and other patterns in real-time log data.

Query-based LOG ANALYTICS using AD HOC search expressions

Image with example of saved complex log data search query Image with example of complex boolean search query

Any query-based search or analytics expression, regardless of its complexity, can be saved for future use under the title of your choice.

Saved search terms are grouped by popularity and last created. While reviewing the list the search expressions stored below the filter name are displayed for easier selection.

Maintain your time by using saved search expressions when emerging events need quick and effective investigation.

Build your own LOG REPORTING and LOG ANALYTICS applications using GOL API

XML and JSON log data exchange with API GOL API with more than 40 commands available for application development

Enterprise developer teams will find many of ways to leverage GOL Server, centralized GOLDB database and GOL Web GUI visual search and management tools by using built-in open REST-based API.

From creation of custom applications by integrating personal data usage log data from golDB to the design of specific reports for in-depth study of log events and investigation results.

Our API is designed for REAL-TIME web and mobile application interactivity. API is available for development of .NET, JAVA, PHP, PYTHON, C/C++ applications by using more than 40 commands including google-like search and finding similar content in other event sources for correlation.