Probabilistic inductive logic programming : theory and applications

The question, how to combine probability and logic with learning, is getting an increased attention in several disciplines such as knowledge representation, reasoning about uncertainty, data mining, and machine learning simulateously. This results in the newly emerging subfield known under the names of statistical relational learning and probabilistic inductive logic programming. This book provides an introduction to the field with an emphasis on the methods based on logic programming principles. It is concerned with formalisms and systems, implementations and applications, as well as with the theory of probabilistic inductive logic programming. The 13 chapters of this state-of-the-art survey start with an introduction to probabilistic inductive logic programming; moreover the book presents a detailed overview of the most important probabilistic logic learning formalisms and systems such as relational sequence learning techniques, using kernels with logical representations, Markov logic, the PRISM system, CLP(BN), Bayesian logic programs, and the independent choice logic. The third part provides a detailed account of some show-case applications of probabilistic inductive logic programming. The final part touches upon some theoretical investigations and includes chapters on behavioural comparison of probabilistic logic programming representations and a model-theoretic expressivity analysis. One of the key open questions within arti?cial intelligence is how to combine probability and logic with learning. This question is getting an increased - tentioninseveraldisciplinessuchasknowledgerepresentation, reasoningabout uncertainty, data mining, and machine learning simulateously, resulting in the newlyemergingsub?eldknownasstatisticalrelationallearningandprobabil- ticinductivelogicprogramming.Amajordriving forceisthe explosivegrowth in the amount of heterogeneous data that is being collected in the business and scienti?c world. Example domains include bioinformatics, chemoinform- ics, transportation systems, communication networks, social network analysis, linkanalysis, robotics, amongothers.Thestructuresencounteredcanbeass- pleassequencesandtrees(suchasthosearisinginproteinsecondarystructure predictionandnaturallanguageparsing)orascomplexascitationgraphs, the WorldWideWeb, andrelationaldatabases. This book providesan introduction to this ?eld with an emphasison those methods based on logic programming principles. The book is also the main resultofthesuccessfulEuropeanISTFETprojectno.FP6-508861onAppli- tionofProbabilisticInductiveLogicProgramming(APRILII,2004-2007).This projectwascoordinatedbytheAlbertLudwigsUniversityofFreiburg(Germany, Luc De Raedt) and the partners were Imperial College London (UK, Stephen MuggletonandMichaelSternberg), theHelsinkiInstituteofInformationTe- nology(Finland, HeikkiMannila), theUniversit` adegliStudidiFlorence(Italy, PaoloFrasconi), andtheInstitutNationaldeRechercheenInformatiqueet- tomatiqueRocquencourt(France, FrancoisFages).Itwasconcernedwiththeory, implementationsandapplicationsofprobabilisticinductivelogicprogramming. Thisstructureisalsore?ectedinthebook. The book starts with an introductory chapter to "Probabilistic Inductive LogicProgramming"byDeRaedtandKersting.Inasecondpart, itprovidesa detailedoverviewofthemostimportantprobabilisticlogiclearningformalisms and systems. We are very pleased and proud that the scientists behind the key probabilistic inductive logic programming systems (also those developed outside the APRIL project) have kindly contributed a chapter providing an relationalsequencelearningte- niques (Kersting et al.), using kernels with logical representations (Frasconi andPasserini), MarkovLogic(Domingosetal.), the PRISMsystem (Satoand Kameya), CLP(BN)(SantosCostaetal.), BayesianLogicPrograms(Kersting andDeRaedt), andtheIndependentChoiceLogic(Poole).Thethirdpartthen provides a detailed account of some show-caseapplications of probabilistic - ductive logic programming, more speci? in protein fold discovery (Chen et al.), haplotyping (Landwehr and Mielik] ainen) and systems biology (Fages andSoliman). The ?nal parttouchesupon sometheoreticalinvestigationsand VI Preface includes chaptersonbehavioralcomparisonof probabilisticlogicprogramming representations(MuggletonandChen)andamodel-theoreticexpressivityan- ysis(Jaeger). Front Matter....Pages - Probabilistic Inductive Logic Programming....Pages 1-27 Relational Sequence Learning....Pages 28-55 Learning with Kernels and Logical Representations....Pages 56-91 Markov Logic....Pages 92-117 New Advances in Logic-Based Probabilistic Modeling by PRISM....Pages 118-155 CLP( $\cal{BN}$ ): Constraint Logic Programming for Probabilistic Knowledge....Pages 156-188 Basic Principles of Learning Bayesian Logic Programs....Pages 189-221 The Independent Choice Logic and Beyond....Pages 222-243 Protein Fold Discovery Using Stochastic Logic Programs....Pages 244-262 Probabilistic Logic Learning from Haplotype Data....Pages 263-286 Model Revision from Temporal Logic Properties in Computational Systems Biology....Pages 287-304 A Behavioral Comparison of Some Probabilistic Logic Models....Pages 305-324 Model-Theoretic Expressivity Analysis....Pages 325-339 Back Matter....Pages - "The question, how to combine probability and logic with learning, is gaining increased attention in several disciplines, e.g., knowledge representation, reasoning about uncertainty, data mining, and machine learning. The emerging field of study is known under the names of statistical relational learning and probabilistic inductive logic programming." "This book provides an introduction to the field with an emphasis on the methods based on logic programming principles. It is concerned with formalisms and systems, implementations and applications, as well as with the theory of probabilistic inductive logic programming."--Jacket This book provides an introduction to probabilistic inductive logic programming. It places emphasis on the methods based on logic programming principles and covers formalisms and systems, implementations and applications, as well as theory.