TecMarket Works: Evaluation Issues and Methods

This category includes a variety of evaluation studies and research papers dealing with program evaluation theories, methods, issues, standards and approaches. Topics covered in this section include: methods for measuring social interaction and peer networking and the influence of networking on the adoption of energy measures, the relationship between evaluators and program implementers, standards for conducting evaluations and the relationship between program theories and market theories and how these theories need to be incorporated into the program designing process, and other works.

Publications:

ADM Associates and TecMRKT Works. "Final Report on Statewide Survey of Multi-family Common Area Building Owners Market, Vol I: Apartment Complexes." Prepared for Southern California Edison Company, 95 pages, June 2000.

ADM Associates and TecMRKT Works. "Final Report Appendix for Statewide Survey of Multi-family Common Area Building Owners Market, Vol I: Apartment Complexes." Prepared for Southern California Edison Company, 66 pages, June 2000.

ADM Associates and TecMRKT Works. "Final Report on Statewide Survey of Multi-family Common Area Building Owners Market, Vol II: Building Owners Market." Prepared for Southern California Edison Company, 62 pages, June 2000.

ADM Associates and TecMRKT Works. "Final Report Appendix for Statewide Survey of Multi-family Common Area Building Owners Market, Vol II: Building Owners Market." Prepared for Southern California Edison Company, 64 pages, June 2000.

Bakalars, Kimberly, Lark Lee, Laura Schauer, Nick Hall, Tom Talerico, Kim Leal. Cross-cutting Function: Education and Training Year One Evaluation Report. 52 pages. March 2003.

Barrow, Julia and Nicholas P Hall, "Energy Analysis of Reduced Flow Shower Heads and Flow Restricting Devices," Energy Resources Group, State of Illinois, October 1979.

Barrow, Julia I and Nicholas P Hall, "Preliminary Study of Recycled Materials, Markets, and Products," Energy Resource Group, State of Illinois, 1978.

Buller, Susan, Miriam Goldberg, Nicholas P. Hall, et. al, "White Paper: DSM Program Evaluation Standards and Guidelines," for Association of DSM Professionals, April 1994.

Davis, Ron, Abbas Merchant, Jim Gunshenan, Carol Sabo, Nicholas P Hall, and Krista Grambrow, "Milwaukee Neighborhoods Save Energy and Win; A Study of a Community Based Program," Wisconsin Demand-Side Demonstrations, July 1995.

Erickson, Jeffry, Carol Sabo, Ceyda Can, Nicholas Hall, and John H. Reed. "Neighborhoods Energize Wisconsin: A Study of a Community-Based Program. Wisconsin Demand-Side Demonstrations," WDSD, Madison, WI, 1995.

Erickson, Jeffry J., Nicholas P. Hall, John H. Reed, and Robert K. Stoffs. "Good Neighbors Make Good Participants: Measures of Social Interaction As a Predictor of Program Participation", Proceedings: Sixth Biennial Marketing Research Symposium, Palo Alto: EPRI, 95-110, November, 1994.

Hall, Nick and Johna Roth. "Non-energy Benefits to Implementing Partners from the Wisconsin Focus on Energy Program: An Early Feedback Report." 49 pages. May 2003.

Hall, Nick, Jeff Riggert, Tom Talerico. "Non-energy Benefits Cross-cutting Report: Year One Efforts." 92 pages. January 2003.

Hall, Nick, and Tom Talerico. "A Mini Process Evaluation of the Cross-cutting statewide major markets education and training efforts." 5 pages. May 2002.

Hall, Nick. "Organizing and Delivering Energy Efficiency and Market Effects Programs - Learning from Others." A comparative examination of the Northwest Energy Efficiency Alliance and the New York Energy Research and Development Authority. 49 pages. October 2001.

Hall, Nick and John Reed. "Merging Program Theory and Market Theory In the Evaluation Planning Process," in Proceedings of the 2001 International Energy Program Evaluation Conference, Salt Lake City, UT., Vol. 10, August 2001. 28k pdf download

Hall, Nick and David Sumi (PA Consulting Group). "State of Wisconsin DOA Division of Energy, Focus on Energy II Pilot Study, Market Transformation Evaluation Research Reports," 50 pages, July 2001.

Hall, Nick, John Reed, Tom Talerico, Jeff Riggert, Andrew Oh and Sandia National Laboratories. "2001 FEMP Customer Survey," Process, market, and impact evaluation. For the US DOE, 190 pages, June 2001.

Hall, Nick, John Reed, Tom Talerico, Jeff Riggert, Andrew Oh and Sandia National Laboratories. "2001 FEMP Customer Survey, Executive Summary" Process, market, and impact evaluation. For the US DOE, 45 pages, June 2001.

Hall, Nick, Jeff Riggert, and Tom Talerico. "Process Evaluation of Cinergy's Low-Income Weatherization Program." For Cinergy Service Inc, 75 pages, March 2000.

Hall, Nick, John Reed, Andrew Oh and Jeff Riggert. "Competitive Customer-based Databases: Building Energy Service Portfolios Tailored to the Individual Customer," in the Association of Energy Service Professionals (AESP) International, pages 528-542, 11th Annuaul Conference in Lake Worth, FL, December 2000.

Hall, Nicholas P., Gretchen Jordan, and Ann Sprunt-Crawley, "Evaluations Help Demonstrate Impacts and Improve the Performance of the Federal Technical Assistance Programs," Proceedings of the 1999 International Energy Program Evaluation Conference, Denver, CO., Vol. 9, pg. 761, August 1999.

Hall, Nicholas P. and Jeff A. Riggert, "A Process and Impact Evaluation of Cinergy's Problem Diagnostic Service," TecMRKT Works, August 1999.

Hall, Nicholas P. and Dr. John H. Reed, "Market Transformation: Expectations vs. Reality," Home Energy, Vol. 16, No. 4, July/August 1999.

Hall, Nicholas P. and Dr. Gretchen B. Jordan, "An Evaluation of Selected FEMP Software Programs: Results of a 1998 Customer Survey on Building Life Cycle Costing Software Federal Energy Decision System Software," TecMRKT Works and Sandia National Laboratories, April 1999.

Hall, Nicholas P. and Jeff A. Riggert, "A Process Evaluation of Cinergy's PIPP Orientation and Education Service," TecMRKT Works, March 1999.

Hall, Nicholas P. and Jeff A. Riggert, "A Process Evaluation of Cinergy's Maintenance Service Test Program," TecMRKT Works, February 1999.

Hall, Nicholas P. and Jeff A. Riggert, "A Market Assessment of Cinergy’s Savings and Value in Energy Efficiency Construction Awards Program," TecMRKT Works, January 1999.

Hall, Nicholas P., "A Process and Impact Evaluation of Cinergy's PIPP Educational Pilot Program (The Learn and Earn Program)," TecMRKT Works, November 1998.

Hall, Nicholas P. and John H. Reed, "Process and Impact Evaluation of Missouri Gas Energy's Pilot Weatherization Program," TecMRKT Works, March 1998.

Hall, Nicholas P. and Gretchen Jordan, "Technical Assistance Assessment of US DOE (Department of Energy) Federal Energy Management Programs (FEMP) for Sandia National Laboratories," TecMRKT Works, 1998.

Hall, Nicholas P. and Roberta Walsh, "Emerging Energy Markets: Methods and Strategies for Customer Retention Through Product Identification," Proceedings for the 1997 International Program Evaluation Conference, Chicago, IL, August 1997.

Hall, Nicholas P. and Leslie Carlson, "The Working Poor: The Forgotten Market Segment," Proceedings of the 1997 International Program Evaluation Conference, Chicago, IL, August 1997.

Hall, Nicholas P., "Technical Assistance Assessment of US DOE (Department of Energy) Federal Energy Management Programs (FEMP) for Sandia National Laboratories," TecMRKT Works, April 1997.

Hall, Nicholas P., "An Impact Evaluation of Consumers Power Company's Sandy Pines Wilderness Trails Electric Golf Cart Charger Control Program," TecMRKT Works, March 1996.

Hall, Nicholas P, and John H. Reed. "Marketing Energy Efficiency As a Consumer Commodity", in Proceedings of ACEEE 1996 Summer Study on Efficiency in Buildings, Asilomar, CA. ACEEE, Washington, D. C. Vol. 5, 61 - 68, 1996.

Hall, Nicholas P., "Selecting Produces and Services to Market" Chapter in AESP White Paper on Selling Energy in a Competitive Market, AESP, Boca Ratan, FL, 1996.

Hall, Nicholas P., John Jeppesen, Art Thayer, "One-Stop-Shopping: An Impact and Process Evaluation of a Whole-House Approach To Weatherizing Low-Income Homes In Michigan," Proceedings of the 1995 International Energy Program Evaluation Conference, Chicago, IL, August 1995.

Hall, Nicholas P. "Managing The New Residential Appliance: The Electric Vehicle," in Proceedings of the 1995, US EPA (Environmental Protection Agency) Pollution Control Conference, Chicago, IL, August 1995.

Hall, Nicholas P., "Process and Impact Evaluation of Energy Management/Energy Fitness Low-Income Programs," for Detroit Edison Company, 1994.

Hall, Nicholas, J. Wintersberger, J. Reed, A. Maggiore, C. Pinkowski. "Collecting Program Planning and Evaluation Data from Low Income, Minority Households: A Case Study Baseline Survey." Proceedings: Sixth Biennial Marketing Research Symposium, Palo Alto: EPRI, 155-66, November, 1994.

Hall, Nicholas P., "A Comparative Methodology for Evaluating and Selecting Qualified Energy Performance Contracting Companies," In the ACEEE Summer Study on Energy Efficiency in Buildings, 1990.

Hall, Nicholas P. and Dr. Luther Skelton, "Projected Growth of DSM Programs 1991-1995: Results of a Program Growth Survey of Electric Utilities," Illinois Dept. of Energy and Natural Resources and Sangamon State University, August 1989.

Hall, Nicholas P., "An Evaluation of the Home Energy Loan Program: An Examination of Energy Savings and Related Consumer Behavior," Illinois Dept. of Energy and Natural Resources, June 1988.

Hall, Nicholas P., "Series of Monthly Marketing News and Views in ENR Targets," Illinois Department of Energy and Natural Resources. Nicholas P Hall wrote, edited, and managed this periodical from September 1986 to January 1988.

Hall, Nicholas P., "A Residential High Efficiency Furnace Replacement Program in Illinois: An Examination of Energy Savings and Related Consumer Behavior," Proceedings of the ACEEE Summer Study on Energy Efficiency in Buildings, Vol 9.22, 1988.

Hall, Nicholas P., "Methodology and Preliminary Results of an Evaluation of Energy Savings from the Illinois Home Energy Loan Program," In Proceedings of the 3rd Energy Conservation Program Evaluation Conference, Chicago, Ill, August 1987.

Hall, Nicholas P. and Bruce Hutton, "Issues, Policies, and Perspectives on Public Energy Conservation Programs: A Cross-Sectional Delphi Study of National Policy Makers," Illinois Department of Energy and Natural Resources, August 1986.

Hall, Nicholas P., "An Analysis of Consumer Demand for the Commercial and Apartment Conservation Service Program," In Proceedings of Energy Conservation Program Evaluation Practical Methods, Useful Results," Vol. 2, August 1984.

Hall, Nicholas P., "Commercial Energy Audits: The Illinois Survey; Attitudes and Opinions from the Illinois Business Community," Illinois Dept. of Energy and Natural Resources, June 1984.

Hall, Nicholas P., "Quincy Energy Project: Program Market Evaluation," Illinois Dept. of Energy and Natural Resources, Office of the Director, Evaluation Unit, January 1984.

Hall, Nicholas P., "Effects of Flextime Work Schedules on the General Office Division of the Illinois Department of Energy and Natural Resources," Report for the Illinois Dept. of Central Management Services Bureau of Personnel, 1983.

Hall, Nicholas P., "Project Peoria: Program Marketing Evaluation," Illinois Dept. of Energy and Natural Resources, Office of the Director, Evaluation Unit, July 1983.

Hall, Nicholas P and R R Swager, "Projected Energy Savings from 10% Reduction in Illinois State Fleet Vehicles," Energy Resources Group, State of Illinois, June 1980.

Hall, Nicholas P., "Energy Efficient Window Management," Energy Resource Group, State of Illinois, March 1980.

Hall, Nicholas P and Julia Barrow, "Explanation of Energy Savings Accounting System," Energy Resources Group, State of Illinois, January 1980.

Hall, Nicholas P., "Energy Analysis of Window Insulation Panels," Energy Resource Group, State of Illinois, January 1980.

Hall, Nicholas P., "Energy Efficient Life Cycle Costing of Floor Finishes," Energy Resources Group, State of Illinois, January 1980.

Hall, Nicholas P. and Julia Barrow, "Energy Analysis of Exterior Window Glazing," Energy Resources Group, State of Illinois, December 1979.

Hall, Nicholas P., "Energy Efficiency Life Cycle Costing of Replacement Tires," Energy Resources Group, State of Illinois, October 1979.

Hall, Nicholas P., "Analysis of Re-Refined Engine Lubrication Oils," Energy Resource Group, State of Illinois, April 1979.

Hall, Nicholas P., "Energy Analysis of Recycled Paper Products (tissues, towels, and napkins)," Energy Resources Group, State of Illinois, April 1979.

Hall, Nicholas P., "Procedure for Energy Efficient Procurement," Energy Resource Group, Department of Administration, State of Illinois, May 1978.

Jordan, Gretchen (Sandia National Laboratories), Nick Hall, and Anne Sprunt-Crawley (US DOE (Department of Energy) Federal Energy Management Programs (FEMP). "Evaluations Demonstrate Federal Technical Assistance Programs Move the Market," in Proceedings of ACEEE 2000 Summer Study on Efficiency in Buildings, Asilomar, CA. ACEEE, Washington, D. C., August 2000.

Jordan, Gretchen, Nick Hall, Jeff Riggert, and Tom Talerico. "Evaluation of the US DOE (Department of Energy) Federal Energy Management Programs (FEMP) Technical Assistance." For Sandia National Laboratories, 100 pages, March 2000.

Lin, Chin-I, John H. Reed, Andrew Oh, George Loisos, Marc Fountain, Jim Chace, and Nicholas P Hall, "Baseline Study for Assessing the PG&E Daylighting and Lighting Exchange Programs," Proceedings of the 1999 International Energy Program Evaluation Conference, Denver, CO., Vol. 9, pg. 341, August 1999.

Morgan, Rick, Van Needham, Kathy Ruthen, Nicholas P Hall, and Jeff Riggert, "An Innovative Approach to Low-Income Energy Education: Helping Customers Help Themselves Through Aggressive Energy Education," Proceedings of the 1999 International Energy Program Evaluation Conference, Denver, CO., Vol. 9, pg. 187, August 1999.

Puckett, Curt (with RLW Analytics staff) and Nick Hall. "Process, Market, and Impact Evaluation of Northern States Power Company's (NSP) Residential Central Air Conditioning Rebate Program." For NSP, 73 pages, February 2000.

Puckett, Curt (with RLW Analytics staff), Nick Hall, John Reed, Tom Talerico, and Tim Hennesey. "Evaluation of Northern States Power Saver's Switch Program - Minnesota Residential Program (a Residential AC Load Control Program)." For NSP, 117 pages, February 2000.

Puckett, Curt (with RLW Analytics staff), Nick Hall, John Reed, Tom Talerico, and Tim Hennesey. "Evaluation of Northern States Power Saver's Switch Program - Business and Residential Component (a Residential AC Load Control Program)." For NSP, 117 pages, February 2000.

Puckett, Curt (with RLW Analytics staff) and Nick Hall. "Process and Impact Evaluation of the Residential Conservation Services Delivery Program, Energy Fitness-Saver Component." For Northern States Power Company's (NSP), 54 pages, January 2000.

Riggert, Jeff and Nick Hall. "Low-Income Programs: The Best Practices, Products and Services." In Proceedings of the 2001 International Energy Program Evaluation Conference, Salt Lake City, UT., Vol. 10, August 2001.

Riggert, Jeff, Tom Talerico and Nick Hall. "Custom Solutions Trade Ally Evaluation." Prepared for Excel Energy, 24 pages, January 2001.

Riggert, Jeff, Nick Hall and Curt Puckett. "Low-Income Energy Services National Best Practices Case Studies." Prepared for Excel Energy, 67 pages, September 2000.

Riggert, Jeff, Nick Hall, John Reed, and Andrew Oh. "Non-Energy Benefits of Weatherization and Low-Income Residential Programs: The 1999 Mega-Meta-Study," in Proceedings of ACEEE 2000 Summer Study on Efficiency in Buildings, Asilomar, CA. ACEEE, Washington, D. C., August 2000.

Riggert, Jeff, Andrew Oh, Nick Hall and John Reed. "An Evaluation of the Energy and Non-Energy Impacts of Vermont's Weatherization Assistance Program." Prepared for Vermont's Office of Economic Opportunity, 99 pages, November 1999.

Riggert, Jeff A., Kathy Schroder, Rick Morgan, and Nicholas P. Hall, "Cinergy’s Home Energy House Call (HEHC) Program: An Information Program That Changes People’s Lives," in Proceedings of the 1999 International Energy Program Evaluation Conference, Denver, CO., Vol. 9, pg. 813, August 1999.

Riggert, Jeff A. and Nicholas P. Hall, "A Process and Impact Evaluation of Cinergy's Ohio Home Energy House Call Program," TecMRKT Works, November 1998.

Riggert, Jeff A. and Nicholas P. Hall, "A Process and Impact Evaluation of Cinergy's Kentucky Home Energy House Call Program," TecMRKT Works, November 1998.

Reed, John, Andrew Oh, Tom Talerico, Jeff Riggert, Nicholas Hall. "An Examination of the Results of the Apartment and Condominium Energy Services Program." 92 pages. November 2002.

Reed, John, Andrew Oh, and Nick Hall. "The Structure and Operations of the Commercial Building Market," in Proceedings of ACEEE 2000 Summer Study on Efficiency in Buildings, Asilomar, CA. ACEEE, Washington, D. C., August 2000. pdf 134k download

Reed, Dr. John H., Nicholas P. Hall, Andrew Oh, and Jeff Riggert, "Baseline Study for Assessing the Pacific Gas and Electric Daylighting Design Tools," TecMRKT Works, June 1999

Reed, Dr. John H., Andrew Oh, and Nicholas P. Hall, "Baseline Market Study Assessing the Potential for Pacific Gas and Electric's Lighting Exchange Program," TecMRKT Works, June 1999.

Reed, Dr. John H, Nicholas P Hall, and Andrew Oh, "An Impact Evaluation of the Missouri Gas Energy Low-Income Weatherization Pilot Program," TecMRKT Works, May 1999.

Reed, John, Andrew Oh and Nick Hall. "Northwest Lighting On-line Market Assessment Report." Prepared for the Northwest Energy Efficiency Alliance, 60 pages, February 1999.

Reed, John, Andrew Oh and Nick Hall. "Lighting Design Lab: Market Assessment Report." Prepared for the Northwest Energy Efficiency Alliance, 130 pages, December 1998.

Reed, Dr. John H., Nicholas P. Hall, Andrew Oh, Paul Hoover, and John Oh, "An Impact Evaluation of Vermont's Weatherization Assistance Program," TecMRKT Works, December 1997.

Reed, Dr. John H and Nicholas P. Hall, "Market Effects Study of PG&E Energy Center," TecMRKT Works, December 1997. pdf 705k download

Reed, Dr. John H. and Nicholas P Hall, "Methods for Measuring Market Transformation," Proceedings for the 1997 International Program Evaluation Conference, Chicago, IL, August 1997.

Reed, Dr. John H. and Nicholas P Hall, "Methods for Measuring Customer Satisfaction," Proceedings for the 1997 International Program Evaluation Conference, Chicago, IL, August 1997.

Reed, Dr. John H., Jeffry J. Erickson, Jeff Ford, Nicholas P. Hall. "The After-Effects of a Residential Marketing Program: Implications for Understanding Market Transformation," in Proceedings of the Association of Energy Services Professionals Members. Association of Energy Services Professionals, Boca Raton, 1996.

Reed, Dr. John H., Jeff Erickson, Jeff Ford, and Nichols P. Hall, "The After Effects of a Residential Marketing Program: Implications for Understanding Market Transformation," Proceedings in the Association of Energy Service Professionals," Chapter 11, December 1996.

Reed, Dr. John H., and Nicholas P. Hall. "Evaluating Community-based Programs -Establishing an Evaluation Framework," in Proceedings of the 1995 International Energy Program Evaluation Conference. Chicago, IL, August 1995.

Reed, Dr. John H., Chris Pinkowski, Jim Mapp, Stanley White, Nicholas Hall, Bernadette Caldwell. "Lessons From A Daylighting Retrofit: A Case Study of a Building." Wisconsin Demand-Side Demonstrations. Madison, WI, 1995.

Reed, Dr. John H, Nicholas Hall, and Robin Calhoun. "Evaluation and Implementation: How Long an Arm is Needed in the "Arms-Length" Relationship?", in Proceedings of the 1993 International Energy Program Evaluation Conference. Chicago, 1993 pp. 724-732; also in Energizing the Energy Policy Process: The Impact of Evaluation, Roberta W. Walsh and John G. Heileman, eds., Westport, CT: Quorum Press, 1994.

Reed, Dr. John and Nicholas P. Hall, "WDSD's Strategic Evaluation Plan". Wisconsin Demand-Side Demonstrations. Madison, WI, 1994.

Reed, John H., Nick Hall, and Robin Calhoun, "Evaluation and Implementation: How Long an Arm is needed in the 'Arms-Length' Relationship?." 1993 International Energy Programs Evaluation Conference (IEPEC) Conference Proceedings, pg 724, August, 1993.

RLW Analytics and Nicholas P. Hall, "Process, Market, and Impact Evaluation of Northern States Power Company’s Commercial and Industrial (C&I) Custom Rebate Program," RLW Analytics, Inc. and TecMRKT Works, July 1998.

Skelton, Luther and Nicholas P Hall, "Professional Standards and Ethics for Demand-Side Management Evaluation", The Institute of Technology Assessment, Inc., Springfield, IL, 1991.

TecMRKT Works, SERA Inc. and Megdal & Associates. "Low-Income Public Purpose Test (LIPPT): Final Report updated for LIPPT Model v. 2.0." Prepared for California's RRM's Cost Effectiveness Committee, PG&E, SCE, SoCalGas, and SDG&E, 226 pages, May 2001. 1.4MB doc download

Services and Capabilities

Evaluation Services

Market Analysis

Customer Needs and Satisfaction

Performance Measurement and Management

Innovative Research Designs, Methods and Analysis

Product Development and Evaluation

Data Collection and Analysis