Abstract

Engineered products often have more social impacts than are realized. A product review was conducted to bring this to light. In this paper, we show the extent to which different social impacts in 11 impact categories are co-present in 150 products and how this can help engineers and others during the product development process. Specifically, we show how social impact categories not previously considered can be identified. The product review resulted in 13,200 data points that were divided into two data sets, one with 8800 data points from which a social impact probability table was created. The remaining data points were then used to validate the table. All data points were then combined to create a final social impact probability table. This table provides insight for how various social impact categories correlate and can assist engineers in expanding their views to include additional social impact objectives and thus achieve a design with broader social impact or a design with minimized unwanted negative social impact. A simple method for predicting social impact is also created in order to assist engineers when developing products with social impacts in mind.

References

1.
Mattson
,
C. A.
,
Pack
,
A. T.
,
Lofthouse
,
V.
, and
Bhamra
,
T.
,
2019
, “
Using a Product’s Sustainability Space as a Design Exploration Tool
,”
Des. Sci.
,
5
(
1
), p.
e1
. 10.1017/dsj.2018.6
2.
Hansmann
,
R.
,
Mieg
,
H. A.
, and
Frischknecht
,
P.
,
2012
, “
Principal Sustainability Components: Empirical Analysis of Synergies Between the Three Pillars of Sustainability
,”
Int. J. Sustainable Dev. World Ecol.
,
19
(
5
), pp.
451
459
. 10.1080/13504509.2012.696220
3.
Buchert
,
T.
,
Neugebauer
,
S.
,
Schenker
,
S.
,
Lindow
,
K.
, and
Stark
,
R.
,
2015
, “
Multi-Criteria Decision Making as a Tool for Sustainable Product Development—Benefits and Obstacles
,”
Procedia CIRP
,
26
,
70
75
.10.1016/j.procir.2014.07.110
4.
United Nations Conference on Environment and Development
,
1993
,
The Earth Summit
,
Graham & Trotman/Martinus Nijhoff
,
London, Boston
.
5.
Klemes
,
J. J.
,
2015
,
Assessing and Measuring Environmental Impact and Sustainability
,
Elsevier Science
,
New York
.
6.
Epstein
,
M.
, and
Yuthas
,
K.
,
2014
,
Measuring and Improving Social Impacts: A Guide for Nonprofits, Companies, and Impact Investors
,
Berrett-Koehler Publishers
,
San Francisco, CA
.
7.
Stevenson
,
P. D.
,
Mattson
,
C. A.
,
Bryden
,
K. M.
, and
MacCarty
,
N. A.
,
2018
, “
Toward a Universal Social Impact Metric for Engineered Products That Alleviate Poverty
,”
ASME J. Mech. Des.
,
140
(
4
), p.
041404
. 10.1115/1.4038925
8.
Rainock
,
M.
,
Everett
,
D.
,
Pack
,
A.
,
Dahlin
,
E. C.
, and
Mattson
,
C. A.
,
2018
, “
The Social Impacts of Products: A Review
,”
Impact Assess. Project Appraisal
,
36
(
3
), pp.
230
241
. 10.1080/14615517.2018.1445176
9.
Pack
,
A. T.
,
Phipps
,
E. R.
,
Mattson
,
C. A.
, and
Dahlin
,
E. C.
,
2018
, “
Social Impact in Product Design, an Exploration of Current Industry Practices
,”
International Design Engineering Technical Conferences
,
Quebec City, Canada
,
Aug. 26–29
, p.
V02AT03A049
.
10.
Burdge
,
R.
,
2004
,
A Community Guide to Social Impact Assessment
, 3rd ed.,
Social Ecology Press
,
Middleton, WI
.
11.
Pilloton
,
E.
,
2009
,
Design Revolution: 100 Products that Empower People
,
Metropolis Books
,
Melbourne, Victoria, Australia
.
12.
EyeNetra Inc.
, n.d., “
Netrometer – Lensometry Redefined
,” https://eyenetra.com/product-netrometer.html, Accessed July 21, 2017.
13.
Wood
,
M.
,
1993
, “
A Handpump for Africa: The Afridev Experience
,”
Waterlines
,
11
(
4
), pp.
29
31
. 10.3362/0262-8104.1993.020
14.
EyeNetra Inc.
, n.d., “
Netrometer – Lensometry Redefined
,” https://eyenetra.com/product-netrometer.html, Accessed July 21, 2017.
15.
Mason
,
L.
,
Laserson
,
K.
,
Oruko
,
K.
,
Nyothach
,
E.
,
Alexander
,
K.
,
Odhiambo
,
F.
,
Eleveld
,
A.
,
Isiye
,
E.
,
Ngere
,
I.
,
Omoto
,
J.
,
Mohammed
,
A.
,
Vulule
,
J.
, and
Phillips-Howard
,
P.
,
2015
, “
Adolescent Schoolgirls’ Experiences of Menstrual Cups and Pads in Rural Western Kenya: A Qualitative Study
,”
Waterlines
,
34
(
1
), pp.
15
30
. 10.3362/1756-3488.2015.003
16.
EyeNetra Inc.
,
n.d.
, “
Netrometer – Acuity Simplified
,” https://eyenetra.com/product-netrometer.html, Accessed July 21, 2017.
17.
Foster
,
T.
, and
McSorley
,
B.
,
2016
, “
An Evaluation of the BluePump in Kenya and the Gambia
,”
Technical Report
, https://doi.org/10.13140/RG.2.2.33836.67208 p.
12
.
18.
Sharma
,
S.
,
2009
, “
Rural India Calling
,”
USID Foundation, 3rd India International HCI Conference
,
Bangalore, India
,
Sept. 18–20
, p.
P-00024
, https://www.usidfoundation.org/usid2009/callforpapers/papers/Paper-P-00024.pdf
19.
Freeplay Energy Ltd.
,
n.d.
, “
Disaster Recovery and Development Aid – Freeplay Energy Products
,” http://www.freeplayenergy.com/aid-and-development/products, Accessed July 21, 2017.
20.
Smith
,
C.
,
2007
,
Design for the Other 90%
,
Cooper-Hewitt, National Design Museum Smithsonian Institution
,
New York
.
21.
Bicycle Phone Charger—Design Other 90% Network—Smithsonian Cooper-Hewitt National Design Museum, n.d., http://www.designother90.org/solution/bicycle-phone-charger/, Accessed July 21, 2017.
22.
Kusa
,
R.
,
2016
, “
Internationalization of the Entrepreneurial Activity of Social Purpose Organizations
,”
Int. J. Manage. Econ.
,
52
(
1
), pp.
77
93
. 10.1515/ijme-2016-0028
23.
General Electric Company
, n.d., Vscan Family – Ultrasound – Products. http://www3.gehealthcare.com/en/products/categories/ultrasound/vscan_family, Accessed July 21, 2017
24.
Kweka
,
E. J.
,
Lyaruu
,
L. J.
, and
Mahande
,
A. M.
,
2017
, “
Efficacy of PermaNet® 2.0 Nets Against Laboratory-Reared and Wild Anopheles Gambiae Sensu Lato Populations in Northern Tanzania
,”
Infect. Dis. Poverty
,
6
(
1
), p.
11
. 10.1186/s40249-016-0220-z
25.
Ochoa
,
A.
,
2016
, Meet the Pilot: Smart Earpiece Language Translator, https://www.indiegogo.com/projects/meet-the-pilot-smart-earpiece-language-translator-headphonestravel#/, Accessed May 30, 2017.
26.
Winter
,
A. G.
,
Bollini
,
M. A.
,
Judge
,
B. M.
,
Scolnik
,
N. K.
,
O’Hanley
,
H. F.
,
Dorsch
,
D. S.
,
Mukherjee
,
S.
, and
Frey
,
D. D.
,
2012
, “
Stakeholder-Driven Design Evolution of the Leveraged Freedom Chair Developing World Wheelchair
,”
ASME 2012 International Mechanical Engineering Congress and Exposition
,
Houston, TX
,
Nov. 9–15
, pp.
361
368
. 10.1115/IMECE2012-88881
27.
Fenix International,
2013
, Fenix and MTN Launch ReadyPay, Pay-as-You-Go Solar Power in Africa, http://www.fenixintl.com/2013/12/17/fenix-and-mtn-launch-readypay-pay-as-you-go-solar-power-in-africa/, Accessed July 26, 2017.
28.
Wilson
,
D. L.
,
Talancon
,
D. R.
,
Winslow
,
R. L.
,
Linares
,
X.
, and
Gadgil
,
A. J.
,
2016
, “
Avoided Emissions of a Fuel-Efficient Biomass Cookstove Dwarf Embodied Emissions
,”
Dev. Eng.
,
1
, pp.
45
52
. 10.1016/j.deveng.2016.01.001
29.
iDE global, n.d., iDE – Creating a Social Enterprise, https://www.ideglobal.org/story/social-enterprise, Accessed July 21, 2017.
30.
Roundabout Water Solutions, n.d., Playpumps, All Children Have the Right to Clean Water … and the Right to Play, http://www.playpumps.co.za/, Accessed July 31, 2017.
31.
Leising
,
L.
,
2017
, Better Shelter Takes Home Best Design Award for Sustainable Shelter, https://www.pastemagazine.com/articles/2017/04/ikea-takes-home-bestdesign-award-for-sustainable.html, Accessed June 28, 2017.
32.
iDE global, n.d., iDE – Solving Poverty Through Profit, https://www.ideorg.org/OurTechnologies, Accessed July 29, 2016.
33.
Safe Agua Water System—Design Other 90% Network—Smithsonian Cooper-Hewitt National Design Museum, http://www.designother90.org/solution/safe-agua-water-system/, Accessed July 31, 2017.
34.
Gist
,
R.
,
2016
,
Heart of the Hearth: Making the Popular Clean, Not the Clean Popular—Technology Research, Development, and Tools for Clean Biomass Cookstoves
,
BioLite, Inc.
,
Brooklyn, NY
.
35.
Bai
,
Z.
, n.d., AYZH – Life Saving. Life Changing, http://www.ayzh.com/, Accessed May 25, 2017.
36.
Manz
,
D. H.
,
2007
, “
BioSand Water Filter Technology Household Concrete Design
,” http://library.uniteddiversity.coop/Water_and_Sanitation/BioSand_Filters/BioSand_Water_Filter-Household_Concrete_Design.pdf, Accessed May 25, 2017.
37.
Johnson
,
N. G.
, and
Granato
,
M.
,
2014
, “
Single Cell Battery Charger for Portable Electronic Devices in Developing Countries
,”
ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Buffalo, NY
,
Aug. 17–20
, p.
V02AT03A048
.
38.
Bilton
,
A. M.
,
Wiesman
,
R.
,
Arif
,
A. F. M.
,
Zubair
,
S. M.
, and
Dubowsky
,
S.
,
2011
, “
On the Feasibility of Community-Scale Photovoltaic-Powered Reverse Osmosis Desalination Systems for Remote Locations
,”
Renew. Energ.
,
36
(
12
), pp.
3246
3256
. 10.1016/j.renene.2011.03.040
39.
Ward
,
L.
,
2010
, Electricity From a Soccer Ball – Breakthrough Award Innovator, http://www.popularmechanics.com/science/a6176/soccer-ball-that-makes-electricity-during-the-game/, Accessed July 26, 2017.
40.
Premkumar
,
R.
,
2014
,
Wireless Networks for Disaster Relief
,
Department of Computer Science and Engineering, Washington University
,
St. Louis, MO
, http://www.cse.wustl.edu/~jain/cse574-14/ftp/disaster.pdf, Accessed August 2, 2019.
41.
IKEA, n.d., SUNNAN Solar Powered Lamp –IKEA, http://www.ikea.com/ms/en_US/sunnan/sunnan.html, Accessed July 21, 2017.
42.
Baumann
,
E.
, and
Furey
,
S.
,
2013
, “
How Three Handpumps Revolutionised Rural Water Supplies: A Brief History of the India Mark II/III, Afridev and the Zimbabwe Bush Pump
,”
Environ. Sci. Technol.
,
47
(
21
), pp.
12037
12046
. 10.1021/es402086n
43.
Thacker
,
K. S.
,
Barger
,
K. M.
, and
Mattson
,
C. A.
,
2017
, “
Balancing Technical and User Objectives in the Redesign of a Peruvian Cookstove
,”
Dev. Eng.
,
2
, pp.
12
19
. 10.1016/j.deveng.2016.05.001
44.
Smith
,
C. E.
,
2011
, “
Design With the Other 90%: Cities
,”
Places J.
https://doi.org/10.22269/111017
45.
Garden-in-a-Sack - Design Other 90% Network—Smithsonian Cooper-Hewitt National Design Museum, http://www.designother90.org/solution/gardeninasack/, Accessed July 31, 2017.
46.
Seltzer
,
J. R.
,
2002
, The Origins and Evolution of Family Planning Programs in Developing Countries, RAND Corporation, Online Rand Research Documents. https://www.rand.org/pubs/monograph_reports/MR1276.html
47.
d.light A1 – Projects – IDEO.org., n.d., https://www.ideo.org/project/the-only-solar-lantern-youll-ever-need, Accessed July 21, 2017.
48.
Diagnostics For All, n.d., Immunity – DFA, http://dfa.org/immunity/, Accessed July 21. 2017.
49.
Diagnostics For All, n.d., Liver Function – DFA, http://dfa.org/liver-function/, Accessed July 21, 2017.
50.
Diagnostics For All, n.d., Nucleic Acid Detection – DFA, http://dfa.org/nucleic-acid-testing/, Accessed July 21, 2017.
51.
Diagnostics For All, n.d., Small Farmer Support – DFA, http://dfa.org/small-farmer-support/, Accessed July 21, 2017.
52.
Wood
,
A.
, and
Mattson
,
C.
,
2016
, “
Design for the Developing World: Common Pitfalls and How to Avoid Them
,”
ASME J. Mech. Des.
,
138
(
3
), p.
031101
. 10.1115/1.4032195
53.
Lampen – by Hyunsu Park/Core77 Design Awards 2016, http://designawards.core77.com/Design-for-Social-Impact/49834/Lampen, Accessed May 30, 2017.
54.
Folded Homes,
2008
. Folded Homes – UtiYurt, http://www.foldedhomes.com/our_shelters_utiyurt.html, Accessed June 28, 2017.
55.
Cline
,
B.
,
Luo
,
R.
, and
Kuhlmann
,
K.
,
2009
, “
Design and Validation of a Low-cost Microscope for Diagnostics in the Developing World
,”
Microsc. Today
,
17
(
6
), pp.
16
19
. 10.1017/S155192950999099X
56.
Kim
,
Y.
,
Hashemi
,
S.
,
Han
,
M.
,
Kim
,
T.
, and
Sohn
,
H.-G.
,
2016
, “
The Waterless Portable Private Toilet: An Innovative Sanitation Solution in Disaster Zones
,”
Disaster Med. Public Health Preparedness
,
10
(
02
), pp.
281
285
. 10.1017/dmp.2015.166
57.
D-Rev, n.d., ReMotion Knee – D-Rev, http://d-rev.org/projects/mobility/, Accessed July 21, 2017.
58.
Mattson
,
C. A.
,
Wood
,
A. E.
, and
Renouard
,
J.
,
2016
, “
Village Drill: A Case Study in Engineering for Global Development With Five Years of Data Post
,”
ASME International Design Engineering Technical Conferences and Information in Engineering Conference
,
Charlotte, NC
,
Aug. 21–24
, p.
V02AT03A053
.
59.
Design That Matters Inc., n.d., Work—Design That Matters, http://www.designthatmatters.org/work/, Accessed July 21, 2017.
60.
Lewis
,
P. K.
, and
Mattson
,
C. A.
,
2013
, “
An Optimization-Based Method for Designing Modular Systems That Traverse Dynamic S-Pareto Frontiers
,”
Struct. Multidiscip. Optim.
,
48
(
4
), pp.
747
762
. 10.1007/s00158-013-0924-7
61.
Thorpe
,
D.
,
2014
, “
The Woman Who Is Trying to Prevent 4 Million Deaths Each Year
.” https://www.forbes.com/sites/devinthorpe/2014/04/22/the-woman-who-is-trying-to-prevent-4-million-deaths-each-year/, Accessed June 28, 2017.
62.
Vechakul
,
J.
,
2008
, “
Design of Bicycle Ambulances for Zambia
,” Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA.
63.
Miner
,
E. A.
,
Missen
,
C.
,
Missen
,
C.
, and
Miner
,
E. A.
,
2005
, “
Internet in a Box: Augmenting Bandwidth With the EGranary Digital Library
,”
Afr. Today
,
52
(
2
), pp.
21
37
. 10.1353/at.2006.0012
64.
Scott
,
L.
,
Montgomery
,
P.
,
Steinfeld
,
L.
,
Dolan
,
C.
, and
Dopson
,
S.
,
2013
, “
Sanitary Pad Acceptability and Sustainability Study—Long Report
.”
65.
Nagagi
,
Y. P.
,
Temba
,
V.
, and
Komba
,
E. V.
,
2017
, “
The Efficacy of ZeroFly® Screen, Insecticide Incorporated Screen, Against Nuisance and Biting Flies on Cattle Kept Under Zero Grazing System in the Northern Zone of Tanzania
,”
Livestock Res. Rural Dev.
,
29
, p.
3
(Article 54). http://www.lrrd.org/lrrd29/3/naga29054.html
66.
Paudyal
,
S.
,
Opit
,
G. P.
,
Arthur
,
F. H.
,
Bingham
,
G. V.
,
Payton
,
M. E.
,
Gautam
,
S. G.
, and
Noden
,
B.
,
2017
, “
Effectiveness of the ZeroFly® Storage Bag Fabric Against Stored-Product Insects
,”
J. Stored Prod. Res.
,
73
, pp.
87
97
. 10.1016/j.jspr.2017.07.001
67.
Ritzer
,
G.
, and
Ryan
,
J. M.
,
2011
,
The Concise Encyclopedia of Sociology
, 1 ed.,
Wiley-Blackwell
,
Chichester, UK
.
68.
Fontes
,
J.
,
2016
,
Handbook for Product Social Impact Assessment
, 3rd ed.,
PRé Sustainability
,
Amersfoort, The Netherlands
.
69.
Weingaertner
,
C.
, and
Moberg
,
S.
,
2014
, “
Exploring Social Sustainability: Learning From Perspectives on Urban Development and Companies and Products
,”
Sustainable Dev.
,
22
(
2
), pp.
122
133
. 10.1002/sd.v22.2
70.
Ogburn
,
W. F.
, and
Nimkoff
,
M. F.
,
1950
,
Sociology
,
Houghton Mifflin
,
Boston, MA
.
71.
Bray
,
F.
,
1978
, “
Swords Into Plowshares : A Study of Agricultural Technology and Society in Early China
,”
Technol. Culture
,
19
(
1
), pp.
1
31
. 10.2307/3103306
72.
Okeagu
,
J. E.
,
Okeagu
,
J. C.
,
Adegoke
,
A. O.
, and
Onuoha
,
C. N.
,
2006
, “
The Environmental and Social Impact of Petroleum and Natural Gas Exploitation in Nigeria
,”
J. Third World Stud.
,
23
(
1
), pp.
199
218
.
73.
Brown
,
A.
, and
McGeeney
,
K.
,
2013
, In U.S., Employment Most Linked to Being Depression-Free-Gallup, http://www.gallup.com/poll/164090/employmentlinked-depression-free.aspx, Accessed June 29, 2017.
74.
Mann
,
M. M.
,
Hosman
,
C. M. H.
,
Schaalma
,
H. P.
, and
de Vries
,
N. K.
,
2004
, “
Self-Esteem in a Broad-Spectrum Approach for Mental Health Promotion
,”
Health Educ. Res.
,
19
(
4
), pp.
357
372
. 10.1093/her/cyg041
75.
Scott
,
J.
, and
Marshall
,
G.
,
2009
,
A Dictionary of Sociology (Oxford Dictionary of Sociology)
,
Oxford University Press
,
Oxford, UK
.
76.
Grusky
,
D. B.
, and
Weisshaar
,
K. R.
,
2014
,
Social Stratification: Class, Race, and Gender in Sociological Perspective
,
Westview Press
,
Boulder, CO
.
77.
Bernhardt
,
R.
,
1992
,
Encyclopedia of Public International Law
,
North-Holland Publishing Company
,
Amsterdam
.
78.
Donner
,
J.
,
2009
, “
Blurring Livelihoods and Lives: The Social Uses of Mobile Phones and Socioeconomic Development
,”
Innovations
,
4
(
1
), pp.
91
101
. 10.1162/itgg.2009.4.1.91
79.
Cowan
,
R. S.
,
1976
, “
The “Industrial Revolution” in the Home: Household Technology and Social Change in the 20th Century
,”
Technol. Culture
,
17
(
1
), pp.
1
23
. 10.2307/3103251
80.
Hill
,
Z.
,
Kirkwood
,
B. R.
, and
Edmond
,
K.
,
2004
,
Family and Community Practices That Promote Child Survival, Growth and Development: A Review of the Evidence
,
World Health Organization
,
Geneva, Switzerland
.
81.
Schwartz
,
M.
,
1976
,
Radical Protest and Social Structure: The Southern Farmers’ Alliance and Cotton Tenancy, 1880–1890
,
Academic Press
,
Cambridge, MA
.
82.
Garton
,
L. E.
, and
Wellman
,
B.
,
1995
, “
Social Impacts of Electronic Mail in Organizations: A Review of the Research Literature
,”
Annals of the International Communication Association
,
18
(
1
), pp.
434
453
10.1080/23808985.1995.11678923.
83.
Wasserman
,
S.
, and
Faust
,
K.
,
1994
,
Social Network Analysis: Methods and Applications
,
Cambridge University Press
,
Cambridge, UK
.
84.
Wheatley
,
M. A.
,
1997
, “
Social and Cultural Impacts of Mercury Pollution on Aboriginal Peoples in Canada
,”
Water, Air, Soil Pollut.
,
97
(
1–2
), pp.
85
90
. 10.1007/BF02409647
85.
Rogers
,
E. M.
, and
Shoemaker
,
F. F.
,
1971
,
Communication of Innovations: A Cross-Cultural Approach
, 2nd ed.,
Free Press
,
New York
.
86.
Nzeadibe
,
T. C.
,
Ajaero
,
C. K.
,
Okonkwo
,
E. E.
,
Okpoko
,
P. U.
,
Akukwe
,
T. I.
, and
Njoku-Tony
,
R. F.
,
2015
, “
Integrating Community Perceptions and Cultural Diversity in Social Impact Assessment in Nigeria
,”
Environ. Impact Assess. Rev.
,
55
, pp.
74
83
. 10.1016/j.eiar.2015.07.005
87.
Gramling
,
R.
, and
Freudenburg
,
W. R.
,
1992
, “
Opportunity-Threat, Development, and Adaptation: Toward a Comprehensive Framework for Social Impact Assessment
,”
Rural Sociol.
,
57
(
2
), pp.
216
234
. 10.1111/ruso.1992.57.issue-2
88.
Moyo
,
N.
, and
Müller
,
J. C.
,
2011
, “
The Influence of Cultural Practices on the HIV and AIDS Pandemic in Zambia
,”
HTS Theological Stud.
,
67
(
3
), pp.
412
417
. 10.4102/hts.v67i3.770
89.
Troxell
,
P. M.
, and
Kim
,
C.
,
2016
, “
A Method for Classifying Products Designed for the Developing World
,”
ASME 2016 International Design Engineering Technical Conferences and Computer and Information in Engineering Conference
,
Charlotte, NC
,
Aug. 21—24
, p.
V02AT03A057
.
90.
Ericsson
,
K. A.
,
Charness
,
N.
,
Feltovich
,
P. J.
, and
Hoffman
,
R. R.
,
2006
,
The Cambridge Handbook of Expertise and Expert Performance (Cambridge Handbooks in Psychology)
.
Cambridge University Press
,
Cambridge, UK
.
91.
Rahman
,
A.
,
Slamet
,
C.
,
Darmalaksana
,
W.
,
Gerhana
,
Y. A.
, and
Ramdhani
,
M. A.
,
2018
, “
Expert System for Deciding a Solution of Mechanical Failure in a Car Using Case-based Reasoning
,”
IOP Conf. Ser.: Mater. Sci. Eng.
,
288
(
1
), p.
12011
. 10.1088/1757-899x/288/1/012011
92.
Qualtrics LLC
.
The Leading Research & Experience Software—Release 2019
, Provo, UT.
93.
Rea
,
L. M.
, and
Parker
,
R. A.
,
1997
,
Designing and Conducting Survey Research: A Comprehensive Guide
, 2nd ed.,
Jossey-Bass
,
San Francisco, CA
.
94.
Mullins
,
E. R.
, and
Rosen
,
D.
,
1972
,
Concepts of Probability
,
Bogden & Quigley
,
Tarrytown-on-Hudson, NY
.
95.
Haight
,
F. A.
,
1981
,
Applied Probability
,
Plenum Press
,
New York
.
96.
Koller
,
D.
, and
Friedman
,
N.
,
2009
,
Probabilistic Graphical Models: Principles and Techniques (Adaptive Computation and Machine Learning)
,
MIT Press
,
Cambridge, MA
.
97.
IBM
, “
IBM SPSS Statistics for Windows
.” Version 25.0. Armonk, NY: IBM Corp.
98.
Koo
,
T. K.
, and
Li
,
M. Y.
,
2016
, “
A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research.
,”
J. Chiropractic Med.
,
15
(
2
), pp.
155
163
. 10.1016/j.jcm.2016.02.012
99.
Kenrose
,
S.
,
2016
, “
Intraclass Correlation—Statistics How To
”, https://www.statisticshowto.datasciencecentral.com/intraclass-correlation/, Accessed December 12, 2018.
100.
Eye
,
A. V.
, and
Mun
,
E. Y.
,
2004
,
Analyzing Rater Agreement: Manifest Variable Methods
,
Lawrence Erlbaum Associates
,
Mahwah, NJ
.
101.
Winer
,
B. J.
,
1971
,
Statistical Principles in Experimental Design
, 2nd ed.,
McGraw-Hill Series in Psychology, McGraw-Hill
,
New York
.
102.
StataCorp LLC
,
2017
, Stata Statistical Software: Release 15. College Station, TX.
103.
Klotz
,
L.
,
Weber
,
E.
,
Johnson
,
E.
,
Shealy
,
T.
,
Hernandez
,
M.
, and
Gordon
,
B.
,
2018
, “
Beyond Rationality in Engineering Design for Sustainability
,”
Nat. Sustainability
,
1
(
5
), pp.
225
233
. 10.1038/s41893-018-0054-8
You do not currently have access to this content.