Human-Centered Information Fusion -- Table of Contents -- Preface -- Acknowledgments -- Chapter 1 Introduction: The Changing Role ofHumans in Information Fusion -- 1.1 INTRODUCTION -- 1.2 TRADITIONAL VIEWS OF DATA FUSION -- 1.2.1 The Department of Defense (DoD) Legacy -- 1.2.2 The Joint Directors of Laboratories (JDL) Data Fusion Process Model -- 1.2.3 Related Models of Data Fusion -- 1.2.4 Assessment of Fusion Technology -- 1.3 NEW ROLES FOR HUMANS IN DATA FUSION -- 1.3.1 The Changing Landscape -- 1.3.2 The Human as a Soft Sensor -- 1.3.3 Hybrid Cognition -- 1.3.4 Analytical Crowdsourcing -- 1.4 SUMMARY -- References -- Chapter 2 Sensing the Human Landscape: Issues andOpportunities -- 2.1 INTRODUCTION -- 2.1.1 Definitions -- 2.1.2 Context: Why the Current Interest? -- 2.1.3 Constituencies for Human Landscape Information -- 2.2 CONTRASTS -- 2.2.1 Similarities Between Natural Terrain and Human Landscapes -- 2.2.2 Differences Between Natural Terrain and Human Landscapes (What Google Maps Cannot Convey) -- 2.2.3 The Richness of the Human Landscape -- 2.3 ELEMENTS OF THE HUMAN LANDSCAPE -- 2.3.1 Attributes: Chosen Versus Given -- 2.3.2 Attributes: Sensed by Humans Versus Sensed by Technology -- 2.3.3 Attributes: Individual Versus Collective -- 2.3.4 Attributes as Seen by Various Disciplines -- 2.4 ISSUES IN REPRESENTING THE HUMAN LANDSCAPE -- 2.4.1 Tacit Versus Explicit Knowledge -- 2.4.2 Indirect Human Evidence Is Often More Reliable Than Direct Inquiry -- 2.4.3 Context Is Often Equally Important as Data -- 2.4.4 Representation of Time in Human Landscapes -- 2.4.5 Presence of Humans as Sensors Can Change What They Observe -- 2.4.6 Representing Uncertainty -- 2.4.7 Unique Identifiers for Humans Versus Other Entities -- 2.5 INFORMATION OVERLOAD AND OTHER COMPLICATIONS OFHUMAN LANDSCAPES: THE CASE OF THE STASI -- 2.5.1 Historical Context.

2.5.2 Information Overload -- 2.5.3 Consequences of Massive Surveillance -- 2.6 INFORMATION FUSION AND THE HUMAN LANDSCAPE -- 2.6.1 Fusion of Existing Data Sources -- 2.6.2 Fusion of Emerging Data Sources -- 2.7 CONCLUSION -- References -- Chapter 3 H-Space: Humans as Observers -- 3.1 INTRODUCTION -- 3.2 SOURCE CHARACTERIZATION CHALLENGES -- 3.3 A FRAMEWORK FOR CHARACTERIZING OBSERVERS -- 3.3.1 A Conceptual Framework -- 3.3.2 Energy to Neural Activity: A Brief Survey of the Human Senses -- 3.3.3 Attentional Focus -- 3.3.4 Perceptual Cognition -- 3.3.5 Perception of Language -- 3.3.6 Language to Reporting -- 3.4 SUMMARY -- References -- Chapter 4 Global Neighborhood Watch:The Emerging Community of Observers -- 4.1 EMERGING TRENDS IN AD HOC GLOBAL OBSERVATIONS -- 4.1.1 Cell Phones as Sensors and Sensor Platforms -- 4.1.2 Differences Between Cell Phones and Conventional Sensors -- 4.1.3 The Twitter Factor -- 4.2 HUMANS AS SENSORS AND SENSOR PLATFORMS -- 4.3 REPORTING MECHANISMS -- 4.3.1 User-Generated Content -- 4.4 CHALLENGES AND BIASES IN GROUP OBSERVATIONS -- 4.5 TASKING THE COMMUNITY -- 4.5.1 Related Tasking Issues -- 4.6 INFORMATION MANAGEMENT -- 4.6.1 Centralized Versus Localized Sensor Fusion -- 4.6.2 Routing -- 4.6.3 Representation of Uncertainty -- 4.7 CROWDS AS FUSION -- 4.8 CONCLUSION -- References -- Chapter 5 What Does It Mean to Live in a SearchableWorld? -- 5.1 INTRODUCTION -- 5.1.1 A Brief Historical Perspective -- 5.1.2 Intellectual Earthquakes -- 5.2 CONTEXT -- 5.2.1 Perspectives on Information Collection and Access -- 5.2.2 From Classification (Ontologies) to Networks (Indexing) -- 5.3 DOMAINS OF CHANGE -- 5.3.1 Intellectual Life -- 5.3.2 Commerce -- 5.3.3 Personal Empowerment -- 5.3.4 Crime and Terror -- 5.3.5 Implications of Far-Reaching Change for Human-Centered Fusion -- 5.4 LOOKING AHEAD -- 5.4.1 Where Is the Technology Headed?.

5.4.2 Issues and Concerns -- 5.5 SEARCH AND HUMAN-CENTERED FUSION -- References -- Chapter 6 Data Visualization and Understanding -- 6.1 INTRODUCTION -- 6.1.1 Definitions -- 6.1.2 Objectives of Information Visualization -- 6.1.3 A Brief Tour of Information Visualization -- 6.2 UNDERSTANDING VISUALIZATIONS -- 6.2.1 Taxonomies -- 6.2.2 Assessment and Evaluation -- 6.2.3 Visual Analytics -- 6.3 SUCCESS STORIES -- 6.4 COMMERCIAL TOOLS -- 6.4.1 Desktop Office Suite -- 6.4.2 Scientific and Technical Packages -- 6.4.3 Statistical Packages -- 6.4.4 Geographic Information Systems -- 6.4.5 Business Intelligence Tools -- 6.5 VISUALIZING PHYSICAL DATA -- 6.6 VISUALIZING NONSPATIAL DATA -- 6.7 LESSONS AND OPPORTUNITIES -- References -- Chapter 7 Beyond Visualization: Sonification -- 7.1 INTRODUCTION -- 7.2 SOUND AS INFORMATION -- 7.3 MONITORING VERSUS ANALYSIS -- 7.4 ACOUSTIC DIMENSIONS OF SOUND -- 7.4.1 Air Pressure -- 7.4.2 Pitch/Frequency -- 7.4.3 Volume/Amplitude -- 7.4.4 Timbre/Spectrum -- 7.4.5 Location/Stereo Pan -- 7.4.6 Distance -- 7.4.7 Duration -- 7.4.8 Meter and Harmony -- 7.5 PSYCHOACOUSTICS: DIMENSIONS OF HUMAN SOUNDPERCEPTION -- 7.5.1 Pitch Perception -- 7.5.2 Loudness Perception -- 7.5.3 Timbre Perception -- 7.6 AUDITORY GESTALTS -- 7.7 SONIFICATION: DESIGN CONSIDERATIONS -- 7.8 EXAMPLE SONIFICATIONS -- 7.9 APPLICATION TO CYBERSECURITY -- 7.10 SONIFICATION SOFTWARE -- 7.11 CONCLUSIONS -- References -- Chapter 8 Adapting IPB for Human TerrainUnderstanding: Informational Preparationof the Engagement Space -- 8.1 INTRODUCTION -- 8.1.1 Intelligence Preparation of Battlefield: The Traditional (Surface-Centric) Approach -- 8.2 THE TRADITIONAL (SURFACE-CENTRIC) IPB PROCESS -- 8.2.1 IPB Phase I -- 8.2.2 IPB Phase II -- 8.2.3 IPB Phase III -- 8.2.4 IPB Phase IV -- 8.3 IPB Is Continuous -- 8.3.1 Counterinsurgency (COIN) and the New JIPOE.

8.3.2 IPB in COIN -- 8.3.3 Joint Intelligence Preparation of the Operational Environment(JIPOE -- 8.4 ADAPTING IPB TO JIPOE FOR THE HUMAN TERRAIN -- 8.5 SUMMARY -- References -- Chapter 9 Information Fusion for Civilians: TheProspects of Mega-Collaboration -- 9.1 INTRODUCTION -- 9.1.1 Informational Crowdsourcing -- 9.1.2 Mega-Collaboration -- 9.2 THE ROLE OF ICT IN DISASTER RECOVERY -- 9.2.1 New Dimensions in Research in Disaster Recovery -- 9.2.2 Calls for ICT Innovation for Disaster Collaboration Support -- 9.3 INFORMATION FUSION THROUGH MEGA-COLLABORATIONPROCESSES AND TOOLS -- 9.3.1 Social and Cultural Processes -- 9.3.2 Collaboration Management -- 9.3.3 The Contribution of Artificial Intelligence -- 9.3.4 Individual and Team Interfaces -- 9.4 IMPLICATIONS FOR DESIGN AND DEVELOPMENT -- 9.4.1 Current Experimental Work -- 9.4.2 The Mega-Collaboration Tool -- 9.4.3 Use Cases -- 9.4.4 Required Features -- 9.5 CONCLUSIONS -- References -- Chapter 10 Virtual World Technologies -- 10.1 INTRODUCTION -- 10.2 OVERVIEW OF VIRTUAL WORLDS -- 10.3 TYPES OF VIRTUAL WORLDS -- 10.4 VIRTUAL WORLDS AND LEARNING -- 10.5 THE WIKIPEDIA PHENOMENON -- 10.6 VIRTUAL WORLD COLLABORATION TOOLS AND PLATFORMS -- 10.6.1 Second Life -- 10.6.2 OLIVE by Forterra -- 10.6.3 ProtoSphere by Proton Media -- 10.7 LESSONS FROM ONLINE, MULTIPLAYER GAMINGCOMMUNITIES -- 10.8 SUMMARY -- References -- Chapter 11 Information Markets and Related Forms ofCollective Processing -- 11.1 CROWDSOURCING OF ANALYSIS -- 11.2 THE WISDOM OF CROWDS -- 11.3 HOW DO CROWDS EXPRESS WISDOM? -- 11.4 WHAT KINDS OF QUESTIONS BEST LEND THEMSELVES TOGROUP WISDOM? -- 11.5 WHERE IS ERROR INTRODUCED? -- 11.6 VARIETIES OF MARKET EXPERIENCE -- 11.7 FUTURE DIRECTIONS -- 11.8 FUTUREMAP: A BRIEF CASE STUDY -- 11.9 SUMMARY -- References.

Chapter 12 Hybrid Cognition and SituationAwareness: Perspectives for the Future ofHuman-Centered Fusion -- 12.1 INTRODUCTION -- 12.1.1 Reprising the Themes of Human-Centered Fusion -- 12.1.2 Dangers of Prediction -- 12.2 REQUIREMENTS PULL FOR HCF AND SA -- 12.2.1 Commercial Forces -- 12.2.2 Asymmetric Information Warfare -- 12.2.3 Military and Governmental Expectations and Demands -- 12.2.4 Demographics -- 12.3 TECHNOLOGY PUSH: ENABLERS FOR HCF -- 12.3.1 Interconnectivity -- 12.3.2 Computational Horsepower -- 12.3.3 Data Structures -- 12.3.4 Human-Data Interaction -- 12.3.5 Computer-Enhanced Humanity -- 12.4 THE BUSINESS CASE FOR HUMAN-CENTERED FUSION -- 12.4.1 Traditional Information Economics -- 12.4.2 Emerging Information Economics -- 12.4.3 The Emerging Paradox: Competing with "Free" -- 12.4.4 The Innovator's Dilemma for Information -- 12.4.5 Three Potential Business Models for Human-Centered Fusion -- 12.5 PROSPECTS FOR IMPLEMENTATION -- 12.6 CONCLUSION -- References -- About the Authors -- Index.