A procedure was developed for systematically testing whole building energy simulation models and diagnosing the sources of predictive disagreement. Field trials of the method were conducted with a number of detailed state-of-the-art programs by researchers from nations participating in International Energy Agency (IEA) Task 12 and Annex 21. The technique consists of a series of carefully specified test case buildings that progress systematically from extremely simple to relatively realistic. Output values for the cases, such as annual loads, annual maximum and minimum temperatures, peak loads, and some hourly data are compared, and used in conjunction with diagnostic logic to determine the algorithms responsible for prediction differences. The more realistic cases, while geometrically simple, test the ability of the programs to model such combined effects as thermal mass, direct solar gain windows, window shading devices, internally generated heat, infiltration, sunspaces, earth coupling, and deadband and setback thermostat control. The more simplified cases facilitate diagnosis by allowing excitation of particular heat transfer mechanisms. The procedure was very effective at revealing bugs, faulty algorithms, and input errors in a group of building energy simulation programs that may be considered among the world’s best. The output data from the simulation programs can be used as reference ranges for comparing and diagnosing other detailed or simplified design tools.

Issue Section:
Research Papers
Topics:
Simulation, Testing, Textiles, Algorithms, Design, Errors, Excitation, Heat, Heat transfer, Peak load, Shades and shadows, Simulation models, Solar energy, Stress, Structures, Temperature, Temperature controls
1.
Alvarez, S., Rodriguez, E., Coronado, J., 1989, “Thermal Modeling of Earth-Contact Surfaces,” Proceedings of the Sixth International PLEA Conference: July 27-31, 1988, Porto, Portugal, Pergamon Press, New York, pp. 415–420.
2.
BLAST 3.0 User’s Manual, Apr. 1986, BLAST Support Office, University of Illinois, Urbana, IL.
3.
BLAST User Reference, Volume 1, 1991, BLAST Support Office, University of Illinois, Urbana, IL.
4.
BLAST User Reference, Volume 2, BLAST Support Office, University of Illinois, Urbana, IL.
5.
BLAST Support Office, Dec. 1991 and June 1992, personal communication, Department of Mechanical and Industrial Engineering, University of Illinois, Urbana, IL.
6.
Bloomfield, D., ed., Nov. 1989, Design Tool Evaluation: Benchmark Cases, IEA T8B4 Solar Heating and Cooling Program, Task VIII, Passive and Hybrid Solar Low-Energy Buildings, Building Research Establishment, International Energy Agency, Graston, U.K.
7.
DOE-2 Reference Manual (Version 2.IA) Part 1, May 1981, D. York and C. Cappiello, eds., Lawrence Berkeley Laboratory, Berkeley, CA.
8.
DOE-2 Engineer’s Manual (Version 2.1A), Nov. 1981, D. York and C. Cappiello, eds., Lawrence Berkeley Laboratory, Berkeley, CA.
9.
DOE-2 Supplement (Version 21.D), June 1989, Lawrence Berkeley Laboratory, Berkeley, CA.
10.
Eppel, H., Lomas, K., Martin, C., 1994, Empirical Validation of Thermal Building Simulation Programs Using Test Room Data. IEA A21RN399/94, DeMontfort University, United Kingdom International Energy Agency, Leicester, U.K.
11.
Haberl, J., and Yuill, G., June 1993, ASHRAE TC-4.7/SPC-140, Working document, American Society of Heating, Refrigerating, and Air-Conditioning Engineers, Atlanta, GA.
12.
Hagentoft, C., 1988, Heat Loss to the Ground from a Building-Slab on the Ground and Cellar, TUBH-1004 Lund Institute of Technology, Lund, Sweden.
13.
Hirsch, J., 1992-1993, personal communication, Camarillo, CA.
14.
Hittle, D., Mar. 1993, personal communication, Department of Mechanical Engineering, Colorado State University, Fort Collins, CO.
15.
Judkoff, R., et al., 1983, A Methodology for Validating Building Energy Analysis Simulations, SERI/TR-254-1508, Solar Energy Research Institute (now known as National Renewable Energy Laboratory), Golden, CO.
16.
Judkoff, R., Jan. 1988, Validation of Building Energy Analysis Simulation Programs at the Solar Energy Research Institute (Energy and Buildings, Vol. 10), Elsevier Sequoia, Lausanne, Switzerland.
17.
Judkoff, R., et al., 1988, International Energy Agency Design Tool Evaluation Procedure, SERl/TP-254-3371, DE88001173, Solar Energy Research Institute, Golden, CO.
18.
Judkoff, R., 1989, IEA Task 12/21c Multi-Year Research Plan, National Renewable Energy Laboratory, Golden, CO.
19.
Judkoff, R., 1994, Building Energy Simulation Test (BESTEST) and Diagnostic Method: A Procedure for Testing the Ability of Whole Building Energy Simulation Programs to Thermally Model the Building Fabric. National Renewable Energy Laboratory, Golden, CO.
20.
Judkoff, R., and Neymark, J., 1995, Building Energy Simulation Test (BESTEST) and Diagnostic Method: A Procedure for Testing the Ability of Whole Building Simulation Programs to Thermally Model the Building Fabric, (draft) IEA Technical Report, National Renewable Energy Laboratory, Golden, CO.
21.
Kataja, S., and Kalema, T., Nov. 1992, Energy Analysis Tests for Commercial Buildings (Commercial Benchmarks), (draft) IEA 12b/21c, Tampere University of Technology, International Energy Agency, Tampere, Finland.
22.
Kennedy, M., Palmiter, L., Wheeling, T., 1992, SUNCODE-PC Building Load Simulation Program, available from Ecotope, Inc., 2812 E. Madison, Seattle, WA 98112.
23.
Klein, S., et al., Sept. 1990, TRNSYS A Transient System Simulation Program, Solar Energy Laboratory, University of Wisconsin, Madison, WI.
24.
Mitalas, G., and Arsenault, J., 1971, Fortran IV Program to Calculate Z-Transfer Functions for the Calculation of Transient Heat Transfer through Walls and Proofs, National Bureau of Standards Building Science, Series 39, Use of Computer for Environmental Engineering Related to Buildings, National Bureau of Standards, Washington, D.C., pp. 633–668.
25.
Rittelmann, P., and Ahmed, S., 1985a, Design Tool Survey, International Energy Agency Task VIII, Burt Hill Koser Rittelmann Associates, Butler, PA.
26.
Rittelmann, P., Ahmed, S., 1985b, Design Tool Comparison, International Energy Agency Task VIII working document, Burt Hill Kosar Rittelmann Associates, Butler, PA.
27.
Rodriguez, E., and Alvarez, S., 1989, “Heat Transfer Analysis of Ground-Coupled Structures,” Thermal Performance of the Exterior Envelopes of Buildings IV: Proceedings of the ASHRAE/DOE/BTECC/CIBSE Conferences: December 4-7, 1989, Orlando, Florida, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Atlanta, GA., pp. 791–799.
28.
Rodriguez, E., and Alvarez, S., Nov. 1991, Solar Shading Analytic Tests(I), Universidad de Sevilla, Seville, Spain.
29.
SERIRES-1.0 Manual, Solar Energy Research Institute Residential Energy Simulator, Version 1.0, Ecotope Group, Seattle, WA.
30.
Walton, G., Mar. 1983, Thermal Analysis Research Program (TARP) Reference Manual, NBSIR 83-2655, (Note that this software is based on BLAST and the manual has a high level of technical detail. Since the BLAST Support Office does not supply an engineer’s manual, the TARP manual is used as a substitute.) National Bureau of Standards, Washington, DC.
31.
Winkelmann, P., Dec. 1991 to Feb, 1993, personal communication, Lawrence Berkeley Laboratory, Berkeley, CA.
This content is only available via PDF.
Copyright © 1995
 by The American Society of Mechanical Engineers
You do not currently have access to this content.