New Tools: DataCivilizer Finds and Links Related Data Scattered Across Digital Files, For Easy Querying and Filtering

From MIT:

The age of big data has seen a host of new techniques for analyzing large data sets. But before any of those techniques can be applied, the target data has to be aggregated, organized, and cleaned up.
That turns out to be a shockingly time-consuming task. In a 2016 survey, 80 data scientists told the company CrowdFlower that, on average, they spent 80 percent of their time collecting and organizing data and only 20 percent analyzing it.
An international team of computer scientists hopes to change that, with a new system called Data Civilizer, which automatically finds connections among many different data tables and allows users to perform database-style queries across all of them. The results of the queries can then be saved as new, orderly data sets that may draw information from dozens or even thousands of different tables.

Read the Complete Article
Direct to Data Civilizer Info Website
Direct to Research Paper: The Data Civilizer System
7 pages; PDF.
Presented at The Biennial Conference on Innovative Data Systems Research (CIDR), Chaminade, California, USA, January 2017

Filed under: Data Files, Journal Articles, News, Patrons and Users