DeepDive: Web scale Knowledge base Construction using Statistical Learning and Inference
We present an end to end (live) demonstration system called DeepDive that performs knowledge base construction (KBC) from hundreds of millions of web pages. DeepDive employs statistical learning and inference to combine diverse data resources and best of breed algorithms. A key challenge of this approach is scalability, i.e. how to deal with terabytes of imperfect data eciently. We describe how we address the scalability challenges to achieve web scale KBC and the lessons we have learned from building DeepDive.
VLDS