Web data management

The Internet and World Wide Web have revolutionized access to information. Users now store information across multiple platforms from personal computers to smartphones and websites. As a consequence, data management concepts, methods and techniques are increasingly focused on distribution concerns. Now that information largely resides in the network, so do the tools that process this information. This book explains the foundations of XML with a focus on data distribution. It covers the many facets of distributed data management on the Web, such as description logics, that are already emerging in today's data integration applications and herald tomorrow's semantic Web. It also introduces the machinery used to manipulate the unprecedented amount of data collected on the Web. Several 'Putting into Practice' chapters describe detailed practical applications of the technologies and techniques. The book will serve as an introduction to the new, global, information systems for Web professionals and master's level courses Cover......Page 1 Web Data Management......Page 2 Contents......Page 6 Introduction......Page 10 Part 1 Modeling Web Data......Page 16 1.1 Semistructured Data......Page 18 1.2 XML......Page 20 1.3 Web Data Management with XML......Page 31 1.4 The XMLWorld......Page 33 1.5 Further Reading......Page 43 1.6 Exercises......Page 44 2.2 Basics......Page 47 2.3 XPath......Page 57 2.4 FLWOR Expressions in XQuery......Page 69 2.5 XPath Foundations......Page 77 2.6 Further Reading......Page 82 2.7 Exercises......Page 84 3.1 Motivating Typing......Page 87 3.2 Automata......Page 90 3.3 Schema Languages for XML......Page 95 3.4 Typing Graph Data......Page 104 3.5 Further Reading......Page 106 3.6 Exercises......Page 107 4 XML Query Evaluation......Page 110 4.1 Fragmenting XML Documents on Disk......Page 112 4.2 XML Node Identifiers......Page 114 4.3 XML Query Evaluation Techniques......Page 118 4.4 Further Reading......Page 127 4.5 Exercises......Page 128 5.1 Prerequisites......Page 131 5.2 Installing EXIST......Page 132 5.3 Getting Started with EXIST......Page 133 5.4 Running XPath and XQuery Queries with the Sandbox......Page 135 5.5 Programming with EXIST......Page 138 5.6 Projects......Page 142 6.1 Tree-Pattern Dialects......Page 146 6.2 CTP Evaluation......Page 149 6.3 Extensions to Richer Tree Patterns......Page 153 Part 2 Web Data Semantics and Integration......Page 156 7.1 Introduction......Page 158 7.2 Ontologies by Example......Page 160 7.3 RDF, RDFS, and OWL......Page 163 7.4 Ontologies and (Description) Logics......Page 174 7.5 Further Reading......Page 184 7.6 Exercises......Page 185 8.1 Introduction......Page 186 8.2 Querying RDF Data: Notation and Semantics......Page 187 8.3 Querying Through RDFS Ontologies......Page 191 8.4 Answering Queries Through DL-LITE Ontologies......Page 194 8.5 Further Reading......Page 209 8.6 Exercises......Page 210 9.1 Introduction......Page 211 9.2 Containment of Conjunctive Queries......Page 214 9.3 Global-as-ViewMediation......Page 215 9.4 Local-as-ViewMediation......Page 219 9.5 Ontology-BasedMediators......Page 230 9.6 Peer-to-Peer Data Management Systems......Page 237 9.8 Exercises......Page 244 10 Putting into Practice: Wrappers and Data Extraction with XSLT......Page 246 10.1 Extracting Data fromWeb Pages......Page 247 10.2 Restructuring Data......Page 249 11.1 Exploring and Installing Yago......Page 251 11.2 Querying Yago......Page 252 11.3 Web Access to Ontologies......Page 253 12.1 YAHOO! PIPES: A Graphical Mashup Editor......Page 255 12.2 XProc: An XML Pipeline Language......Page 256 Part 3 Building Web Scale Applications......Page 260 13 Web Search......Page 262 13.1 The WorldWide Web......Page 263 13.2 Parsing theWeb......Page 265 13.3 Web Information Retrieval......Page 272 13.4 Web Graph Mining......Page 287 13.5 Hot Topics inWeb Search......Page 295 13.6 Further Reading......Page 296 13.7 Exercises......Page 298 14 An Introduction to Distributed Systems......Page 302 14.1 Basics of Distributed Systems......Page 303 14.2 Failure Management......Page 310 14.3 Required Properties of a Distributed System......Page 314 14.4 Particularities of P2P Networks......Page 318 14.5 Case Study: A Distributed File System for Very Large Files......Page 320 14.6 Further Reading......Page 323 15 Distributed Access Structures......Page 325 15.1 Hash-Based Structures......Page 326 15.2 Distributed Indexing: Search Trees......Page 340 15.3 Further Reading......Page 351 15.4 Exercises......Page 352 16 Distributed Computing with MAPREDUCE and PIG......Page 354 16.1 MAPREDUCE......Page 356 16.2 PIG......Page 363 16.3 Further Reading......Page 374 16.4 Exercises......Page 376 17.2 Indexing Plain Text with LUCENE – A Full Example......Page 379 17.3 Put It into Practice!......Page 386 17.4 LUCENE – Tuning the Scoring (Project)......Page 387 18.1 Introduction to Recommendation Systems......Page 389 18.2 Prerequisites......Page 390 18.3 Data Analysis......Page 392 18.4 Generating Some Recommendations......Page 395 18.5 Projects......Page 400 19 Putting into Practice: Large-Scale Data Management with HADOOP......Page 402 19.1 Installing and Running HADOOP......Page 403 19.2 Running MAPREDUCE Jobs......Page 406 19.4 Running in Cluster Mode (Optional)......Page 410 19.5 Exercises......Page 412 20 Putting into Practice: COUCHDB, a JSON Semistructured Database......Page 415 20.1 Introduction to the COUCHDB Document Database......Page 416 20.2 Putting COUCHDB into Practice!......Page 432 20.3 Further Reading......Page 434 Bibliography......Page 436 Index......Page 446 "The Internet and World Wide Web have revolutionized access to information. Users now store information across multiple platforms from personal computers, to smartphones, to Web sites such as YouTube and Picasa. As a consequence, data management concepts, methods, and techniques are increasingly focused on distribution concerns. That information largely resides in the network, as do the tools that process this information. This book explains the foundations of XML, the Web standard for data management, with a focus on data distribution. It covers the many facets of distributed data management on the Web, such as description logics, that are already emerging in today's data integration applications and herald tomorrow's semantic Web. It also introduces the machinery used to manipulate the unprecedented amount of data collected on the Web. Several "Putting into Practice" chapters describe detailed practical applications of the technologies and techniques. Striking a balance between the conceptual and the practical, the book will serve as an introduction to the new, global, information systems for Web professionals as well as for master's level courses"-- Provided by publisher The Internet and World Wide Web have revolutionized access to information. Users now store information across multiple platforms from personal computers, to smartphones, to websites such as Youtube and Picasa. As a consequence, data management concepts, methods, and techniques are increasingly focused on distribution concerns. Now that information largely resides in the network, so do the tools that process this information. This book explains the foundations of XML, the Web standard for data management, with a focus on data distribution. It covers the many facets of distributed data management on the Web, such as description logics, that are already emerging in today's data integration applications and herald tomorrow's semantic Web. It also introduces the machinery used to manipulate the unprecedented amount of data collected on the Web. Several 'Putting into Practice' chapters describe detailed practical applications of the technologies and techniques. Striking a balance between the conceptual and the practical, the book will serve as an introduction to the new, global, information systems for Web professionals as well as for master's level courses. Machine generated contents note: Part I. Modeling Web Data: 1. Data model; 2. XPath and Xquery; 3. Typing; 4. XML query evaluation; 5. Putting into practice: managing an XML database with EXIST; 6. Putting into practice: tree pattern evaluation using SAX; Part II. Web Data Semantics and Integration: 7. Ontologies, RDF, and OWL; 8. Querying data through ontologies; 9. Data integration; 10. Putting into practice: wrappers and data extraction with XSLT; 11. Putting into practice: ontologies in practice Fabian M. Suchanek; 12. Putting into practice: mashups with YAHOO! PIPES and XProc; Part III. Building Web Scale Applications: 13. Web search; 14. An introduction to distributed systems; 15. Distributed access structures; 16. Distributed computing with MAPREDUCE and PIG; 17. Putting into practice: full-text indexing with LUCENE Nicolas Travers; 18. Putting into practice: recommendation methodologies Alban Galland; 19. Putting into practice: large-scale management with HADOOP; 20. Putting into practice: COUCHDB, a JSON semi-structured database.