Metatron Discovery 3.0.6 is out

Metatron Discovery 3.0.6 is released. We’ve made some enhancements and fix some significant bugs. Important release features are described following.

Main Improvements

Improve handling status of datasource ingestion

One of the advantages of Metatron Discovery is that you can ingest data sources into Druid in a Web GUI environment. So far you have not been able to see the state while ingesting a data source, but from this version you can check the current state when you ingest a data source. Future versions will continue to improve on this feature.

Ingestion Status

Improve usability of partition selection when ingesting staging DB

Putting large data in a Druid is a very difficult task. In particular, if you need to ingest data from a specific partitions that are stored in Hive every day into a Druid, you need to be proficient in Druid’s Batch Ingestion. Metatron Discovery has been improving usability for a long time to solve this problem. This release has many improvements in the ability to ingest specific partitions of Hive into Druids.

Staging DB partition selection

Improve UX of Workbench

This release includes features that are minor but improve the usability of the Workbench. For more details, please visit the URL below.
https://github.com/metatron-app/metatron-discovery/issues/534

Add new string functions in dataprep

Data Preparation is the fastest improvement in Metatron Discovery. This release fixes many bugs in Data Preparation, introduces new string functions startWith and endsWith.

Also for the detailed improvements are listed below:

Enhancement

#379 Manage broken rules caused by editing previous rules
#460 Allow spaces in column names in data prep
#505 Improve handling status of datasource ingestion
#516 Support unix timestamp format in field of datasource
#534 Improve left panel and schema information popup of workbench
#542 UI improvements for viewing table names and column names
#543 to response list of grid when a excel file uploads on dataset
#550 Apply default name rules when creating datasets
#569 Load preview of dataset when requested
#584 increase csv download limit in workbench
#585 to increase the size of the rule string
#608 Improved editor name automatic naming policy (improved numbering policy)
#609 Show notifications when browsing back
#619 Improve usability of partition selection when ingesting stage db
#630 Processing when table data can not be retrieved due to restrictions in the DB server
#643 Change workspace allocation processing
#654 Show notification when you click ‘Delete’ in workbench editor
#660 Add new preparation functions startswith() and endswith()

Bug Fix

#295 global variable not work in workbench
#253 Error processing count aggregation in heatmap
#363 Quantile values in column-detail seemed not right
#472 Query editor bug fixes
#484 Cannot switch between rule editor <-> builder when edit
#547 cannot create datasource with new line data.
#549 Data type information error
#553 Information of the same dataset are different on two pages
#555 The dataflow description on the dataset detail page is incorrect.
#563 Scrolling issue when printing log and show end time
#564 Histogram bar is too short to click
#567 Invalid default value for ‘lastModifiedAt’
#573 Screen initialization during chart hierarchy configuration
#577 Small area of the search button of the workbench does not work
#580 error when select sample data after change database in Schema browser.
#583 Unexpected click event into unix time setting menu
#586 CSV file may not be uploaded
#588 Column labels and column names do not match in mysql
#595 move and replace rules are applied in an unintended way
#613 Change connection api in data prep
#617 Map chart does not appear on dashboard preview
#621 Wrong histogram when there are empty strings
#625 Unpaired single quote in CSV file causes error when importing
#631 Stream (Realtime) type display error in datasource list
#634 Can not click common settings of KPI charts
#638 Can not use function expressions on keep/delete rule
#639 BBoxFilter not working in search query API
#644 Column type change to Time/Hour is not processed properly
#648 Modify uri last path as snapshot name when creating snapshot(FileSystem)
#672 Error where multiple timestamp filters are registered in a multi data source
#676 If the error message is long on the workbench, no scroll bar generated.
#685 All datasource has same update time.
#689 Fix broken css in snapshot success popup
#690 Suppress exceptions from broken rules
#704 Numerous bugs in dataflow main grid
#707 Modify error box location at bottom of result tab
#709 Enable download HDFS snapshots
#714 Not working back button in workbench
#716 Problems with duplicate editor tab names and a confirmation window when not editing
#730 Two scrolls created in the editor screen