Open innovation often enjoys large quantities of submitted content. Yet the need to effectively process such large quantities of content impede the widespread use of open innovation in practice. This article presents an exploration of needs-based open innovation using state-of-the art natural language processing (NLP) algorithms to address existing limitations of exploiting large amounts of incoming data. The Semantic Textual Similarity (STS) algorithms were specifically developed to compare sentence-length text passages and were used to rate the semantic similarity of pairs of text sentences submitted by users of a custom open innovation platform. A total of 341 unique users submitted 1,735 textual problem statements or unmet needs relating to multiple topics: cooking, cleaning, and travel. Scores of equivalence generated by a consensus of ten human evaluators for a subset of the needs provided a benchmark for similarity comparison. The semantic analysis allowed for rapid (1 day per topic), automated screening of redundancy to facilitate identification of quality submissions. In addition, a series of permutation analyses provided critical crowd characteristics for the rates of redundant entries as crowd size increases. The results identify top modern STS algorithms for needfinding. These predicted similarity with Pearson correlations of up to .85 when trained using need-based training data and up to .83 when trained using generalized data. Rates of duplication varied with crowd size and may be approximately linear or appear asymptotic depending on the degree of similarity used as a cutoff. Semantic algorithm performance has shown rapid improvements in recent years. Potential applications to screen duplicates and also to screen highly unique sentences for rapid exploration of a space are discussed.
Skip Nav Destination
ASME 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
August 2–5, 2015
Boston, Massachusetts, USA
Conference Sponsors:
- Design Engineering Division
- Computers and Information in Engineering Division
ISBN:
978-0-7918-5717-5
PROCEEDINGS PAPER
Large Scale Needs-Based Open Innovation via Automated Semantic Textual Similarity Analysis
Cory R. Schaffhausen,
Cory R. Schaffhausen
University of Minnesota, Minneapolis, MN
Search for other works by this author on:
Timothy M. Kowalewski
Timothy M. Kowalewski
University of Minnesota, Minneapolis, MN
Search for other works by this author on:
Cory R. Schaffhausen
University of Minnesota, Minneapolis, MN
Timothy M. Kowalewski
University of Minnesota, Minneapolis, MN
Paper No:
DETC2015-47358, V007T06A045; 11 pages
Published Online:
January 19, 2016
Citation
Schaffhausen, CR, & Kowalewski, TM. "Large Scale Needs-Based Open Innovation via Automated Semantic Textual Similarity Analysis." Proceedings of the ASME 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 7: 27th International Conference on Design Theory and Methodology. Boston, Massachusetts, USA. August 2–5, 2015. V007T06A045. ASME. https://doi.org/10.1115/DETC2015-47358
Download citation file:
13
Views
Related Proceedings Papers
Related Articles
A Method for Function Dividing in Conceptual Design by Focusing on Linguistic Hierarchal Relations
J. Comput. Inf. Sci. Eng (September,2010)
Eliciting Attribute-Level User Needs From Online Reviews With Deep Language Models and Information Extraction
J. Mech. Des (June,2021)
Formal Qualitative Physics-Based Reasoning for Functional Decomposition of Engineered Systems
J. Comput. Inf. Sci. Eng (February,2024)
Related Chapters
An Optimized Term Weights Based Clustering for Bilingual Parallel
International Conference on Advanced Computer Theory and Engineering (ICACTE 2009)
Study of GR-Chord Algorithm Based on Redundancy-Reducing of Routing Table
International Conference on Information Technology and Computer Science, 3rd (ITCS 2011)
Manipulability-Maximizing SMP Scheme
Robot Manipulator Redundancy Resolution