Posts Tagged: big data

Data mining
Using data readiness levels to address challenges in data mining projects
October 11, 2017
, , , , , ,
In a blog post from earlier this year, Neil Lawrence describes some challenges to data mining projects that are familiar to many working in the domain—our team definitely included! These challenges include the availability and quality of the data available for the project. Data scientists are often faced with very detailed expectations of budgets and timelines for a project but are provided with very little information at the outset regarding what data they will have to work with, making it difficult to determine whether a project’s outline is realistic. To begin addressing this problem, Lawrence lays out a very general taxonomy of “data readiness levels,” which provides useful language to help us identify and ultimately overcome these important challenges that currently hinder many data science projects.
Data mining Science policy
Data mining: revisiting our definition
October 4, 2017
, , ,
In our ongoing blog series on data mining for policy, we’ve been trying to synthesize a lot of information into short, bite-sized chunks for our audience. Invariably, well-intentioned as such efforts are, something valuable always ends up on the cutting room floor. In this case, we were a bit too hasty in providing the definition of data mining itself, which one of our readers followed up to ask about. Our initial definition was put together through literature review and our earliest experiences with data mining, but the opportunity to revisit that definition more recently has enabled us to uncover some further nuances that we hadn’t yet appreciated.