2017 Knowledge Assessment

From Glen Canyon Dam AMP
Revision as of 09:23, 4 May 2017 by Cellsworth (Talk | contribs)

Jump to: navigation, search


StatusTrendSymbolSet.jpg
DC EMA SymbolSet.jpg

2017 Knowledge Assessment (KA)

The 2017 KA was carried out at the request of the TWG, with advice and support from the Science Advisors-Executive Coordinator. The following report was produced by the Science Advisers-Executive Coordinator for the TWG, the purpose of which was to review the purposes, methods, and results of the KA carried out in FY 2017, offer recommendations for improving the KA process, help the TWG use the results of this year’s KA in the development of the FY 18-20 TWP, and decide how to proceed as to whether and how to improve the process for future budget cycles.

The 2017 KA had three objectives:

  • Summarize what is known.
  • Assess needs for monitoring to sustain crucial knowledge.
  • Identify critical knowledge gaps and weaknesses that require attention.

The resulting information provides crucial guidance for work planning and budgeting. The TWG also conceived the FY 2017 KA as a trial with two additional objectives:

  • Test a standardized process for conducting the KA and compiling its findings that can be repeated with minimal effort and high consistency.
  • Test the utility of presenting the KA findings in the form of a set of simple tables and graphical symbols to facilitate communication. Such tools and graphics are sometimes termed a “scorecard.”

The present (FY 2017) knowledge assessment is timed to coincide with and inform the Annual Reporting process and development of the next GCDAMP Triennial Work Plan for FY 2018-2020. This knowledge assessment is testing a methodology for better organizing, displaying, and communicating its findings, potentially to carry forward to guide future knowledge assessments as well. [1]

--
--
--

Report Summary

Introduction

The FY 2017 KA addressed three broad spheres of knowledge for each of these eleven focal resource topics:

  • Status and Trend: How closely does the condition of the resource currently approach management objectives and, if the current condition shows any trend, is this a trend toward or away from management objectives?
  • Drivers and Constraints: What environmental factors, including human actions and basic dam operations, most strongly affect resource status and trend, how strong are these effects, and do these effects constrain or drive resource condition toward or away from management objectives?
  • LTEMP Experimental and Management Actions: Which LTEMP experimental and management actions are expected to affect resource condition and trend, how strong are these effects expected to be, and are these effects expected to drive resource condition toward or away from management objectives?

More specifically, the FY 2017 KA posed three sets of core questions for each of the eleven focal resource topics:

  • Status and Trend
  1. What is the present understanding of the status of the condition(s) addressed by the topic?
  2. What is the present understanding of the direction of any trend(s) in these conditions?
  3. How certain or uncertain is this understanding?
  • Drivers and Constraints
  1. What is the present understanding of the drivers and constraints that most significantly shape the status and trends in these conditions?
  2. What is the present understanding of the strength and direction of these effects?
  3. How certain or uncertain is this understanding?
  • Effects of Experimental and Management Actions
  1. What is the present understanding of the ways in which each type of LTEMP experimental or management action could affect the status and trends in these conditions?
  2. What is the present understanding of the likely strength and direction of these effects?
  3. How certain or uncertain is this understanding?

The last of these three sets of questions focused on eleven specific experimental management actions identified in the LTEMP FEIS and ROD as features of the Preferred Alternative:

The Preferred Alternative in the LTEMP FEIS and ROD also includes summer low flow experiments. However, these will not be attempted until during the second 10 years of implementation of the LTEMP. The FY 2017 Knowledge Assessment focused on topics that might bear on the GCDAMP Triennial Work Plan for FY 2018-2020 and therefore did not address the potential effects of summer low-flow experiments.

Through its answers to the three sets of core questions presented above, the FY 2017 Knowledge Assessment sought to:

  • Summarize information on status, trends, and the state of knowledge for the eleven focal resource topics.
  • Document the state of knowledge of how antecedent conditions (external drivers and constraints) may affect the outcomes of different management actions.
  • Identify potential needs for continuing, increasing, reducing, revising, or adding monitoring, research, and other information-gathering efforts to address potentially crucial gaps in knowledge.

Status and Trends

The experts for the other ten resources assessed the current status of seven overall as meeting the criteria for “Moderate Concern,” and assessed two, aquatic food base and recreational experience, as meeting the criteria for “Significant Concern” overall. Only one resource, invasive fish species (nonnative invasive species), received an overall rating of “Good Condition.” Since this last resource topic focuses on a threat, its status indicates that, nonnatives, invasive fish species overall currently pose only a limited threat to other species in the system. However, the expert teams consider six of the ten assessed resources currently to be experiencing either no net trend in status, and four – aquatic food base, archaeological and cultural resources, hydropower and energy, and the recreational experience – to be experiencing deteriorating trends in status. The experts did not identify any resource as currently experiencing a net improving trend in status. Tables outlining status and trends for each resource characteristic can be found here.

StatusTrendResource.jpg

Drivers and Constraints

The assessment of drivers and constraints identified numerous factors that influence the status of the ten assessed focal resources. These factors fall into thirteen proposed overarching categories: aquatic food base dynamics (primary and secondary production), aquatic invasive species, archaeological site disturbance, boat and aircraft launches, dam design and operational constraints, humpback chub dynamics, Lake Powell conditions, rainbow trout dynamics, riparian vegetation dynamics, river flow variation, river water quality, river water temperature, and sediment dynamics (above and below baseflow stage).

Unfortunately, there is no simple way to summarize these results. As explained earlier (see Roll-Up Method, above), it is not meaningful to average the rating values for the drivers and constraints affecting an entire resource topic across all associated resource characteristics. In addition, each expert team independently developed its own list of drivers and constraints. This produced a total of 88 different driver and constraint names, with no two expert teams using the same names for any drivers and constraints. As a result, it is not possible to directly compare the ratings for individual drivers across resource topics.

However, it is possible to organize the 88 drivers and constraints into a smaller number of categories. Table 10 identifies 13 categories or types of drivers and constraints, incorporating all 88 original “raw” types identified by the ten expert teams (see Appendix C). Other groupings are possible (see Recommendations, below). Table 10 also shows the numbers of individual drivers and constraints in each category, both overall and for each affected resource. Table 10 lists the proposed driver/constraint categories in order based on their overall frequency of identification across all resource topics.

DC Resource.jpg
DC Resource2.jpg

Effects of LTEMP Experimental and Management Actions

The results in Table 12 indicate that the expert teams expect the net effects of the various LTEMP experimental and management actions (across all resource characteristics for the ten resources) to be a “mixed bag.” Each action is expected to have a mixture of net positive to negative and net strong to weak effects on each of the ten resources, on average across all the individual resource characteristics for each resource. No single action is expected to consistently provide a net benefit to all resources. Similarly, with the exception of recreational experience, no single resource is expected to be affected consistently by all actions. In the case of recreational experience, the results indicate that the expert team expects the net effects of all actions on all resource characteristics to be neutral (neither positive nor negative). However, the tables in Appendix D show that these average effects mask a range of variation in effects across individual resource characteristics.

EMA Resource.jpg

The assessments of status and trend, drivers and constraints, and the potential effects of LTEMP experimental and management actions for the ten assessed resources also identified numerous gaps and areas of uncertainty in critical knowledge. The resources with the highest frequencies of such gaps and uncertainties were (in descending order of frequency): water quality, riparian vegetation, the rainbow trout fishery, the aquatic food base, humpback chub, invasive fish species, and sediment. The raw spreadsheet entries indicate that the expert teams reported these gaps and uncertainties because of difficulties with unclear or undefined management objectives for individual resource characteristics; temporal or spatial gaps in the available data; insufficient numbers of suitable data points; or high temporal or spatial variability in the available data. These findings highlight topics that could benefit from improved management objectives, continuing and/or improved monitoring, and/or research to address critical gaps and uncertainties.

The concluding recommendations identify needs and opportunities for the TWG and GCMRC to improve the assessment methods and their implementation under five headings: What to assess and when, assessment structure and process, the spreadsheet tool, the scorecard display system, and the default method used to average together the findings across multiple lines of evidence for each resource topic.


Links and Information

Reports

Final Knowledge Assessment Summary Tables for All Resources (4/24/17)

Presentations

Recommendations

What to Assess and When

  • Establish a regular schedule of knowledge assessments, integrated with the development of at least the triennial work plans and the cumulative findings of the Annual Reporting cycle.
  • The TWG and GCMRC need not repeat the assessment of knowledge about the potential effects of the LTEMP experimental and management actions.
  • Every effort should be made to include the assessment of “Other Native Fishes” in all future KAs.
  • Every effort should be made to ensure that future KAs include the assessment of “Tribal Resources,” however these come to be defined.
  • The TWG and GCMRC should consider expanding the assessment of the “Natural Processes” resource topic to include processes other than the two included in the FY 2017 KA.
  • The LTEMP and its ROD limit the “Nonnative Invasive Species” resource topic to invasive aquatic organisms, but do not limit it to fishes. The TWG and GCMRC should consider expanding the assessment of this topic to include other aquatic invasive species if ecologically appropriate.

Assessment Structure and Process

  • The TWG should make clear from the outset precisely what objectives the expert teams should to use for each resource topic, against which to assess status and trend.
  • The process and its guidance need to be improved to encourage the expert teams to address a smaller number of truly “key” resource characteristics for each focal resource.
  • The expert teams need to be encouraged to read and follow the formal guidance for the KA – and conversely to provide feedback on how the guidance could be improved.
  • Integration of the work of the individual expert teams could be improved by developing a standard, master list of drivers and constraints.
  • The FY 2017 KA did not address or could have better addressed some environmental factors that recent Annual Reporting Meetings, past KAs, and GCMRC publications have identified as potentially relevant to the GCDAMP.
  • Integration of the results from repeated KAs would also benefit from the development of standardized lists of resource characteristics for each focal resource topic, the GCDAMP FY 2017 Knowledge Assessment Final Report, Executive Coordinator for the Science Advisors Program examination of which could be repeated in successive KAs.
  • The KA process would benefit from the formal inclusion of the effort in annual or triennial work plans, so that all participating experts know this will be an expected matter of attention.
  • The schedule for each KA should include a more formally recognized period or opportunity for all stakeholders to provide feedback to the expert teams.
  • The TWG has proposed, and Reclamation and the SAP-EC have requested in the draft FY 2018-2020 Triennial Work Plan and Budget, that the GCDAMP re-establish a “Standing Panel” as part of the SAP, to provide routine review services to the GCDAMP.

Spreadsheet Tool

  • The FY 2017 KA expert teams – or at least the team leaders – should be polled for feedback on the spreadsheet tool, on ways in which the tool or its associated guidance might be improved.
  • The spreadsheet should include places where the expert teams can or record or find several additional pieces of information, including:
  1. Explicit documentation of the objectives and benchmarks used for assessing status and trend
  2. The definitions of all resource characteristics and technical measures addressed in the KA
  3. The definitions of all drivers and constraints addressed in the KA (see recommendations above on Knowledge Assessment Structure and Process)
  4. Citations for important reference works relevant to ratings and considered in rationale narratives.
  • The “Unknown” category for status, trend, strength, and direction could be split into two variants to recognize two possibilities: there may not be enough evidence with which to even attempt an assessment, or the available evidence, while perhaps nominally sufficiently plentiful, may be too “noisy” to support any firm conclusion.
  • The guidance provided with the spreadsheet tool, and the Data Validation functions incorporated into the tool, should be improved to promote greater consistency in how the expert teams fill in the tables in the tool.

Final Knowledge Assessment Tables for Individual Resources (4/7/17)

Aquatic Food Base

Archaeological & Cultural Resources

Humpback Chub

Hydropower & Energy

Invasive Fish Species

Other Native Fish Species

  • still to be completed

Rainbow Trout Fishery

Recreational Experience

Riparian Vegetation

Sediment

Tribal Cultural Values

  • still to be completed

Water Quality

Participants

  • Aquatic Food Base: Ted Kennedy (Team Lead), Jeff Muehlbauer, Chris Budwig, Shane Capron, Bill Davis, Craig Ellsworth
  • Archaeological and Cultural Resources: Jan Balsom (Team Lead) and Jen Dierker
  • Humpback Chub: Charles Yackulic (Team Lead), Randy Van Haverbeke, Kirk Young
  • Hydropower and Energy: Craig Ellsworth (Team Lead), Shane Capron, Clayton Palmer, Dave Welker, Chrystal Dean (WAPA); Paul Davidson and Nick Williams (Reclamation); Lucas Bair (GCMRC); Leslie James (CREDA); Cliff Barrett (UAMPS); Jenika Raub (SRP); Ben Reeder (SEAHG chair); Peggy Roefer (CRC); Arash Moelemi (NTUA)
  • Invasive Fish Species: David Rogowski (Team Lead), Ken Hyde
  • Other Native Fish Species: Brian Healy (not completed)
  • Rainbow Trout Fishery: Mike Yard (Team Lead), Clay Nelson, Michael Dodrill, and Kimberly Dibble, with Chris Budwig, John Jordan, John Hamill, and Joe Miller
  • Recreational Experience: Lucas Bair (Team Lead), Ben Reeder, Chris Budwig, Kevin Dahl, David Rogowski
  • Riparian Vegetation: Emily Palmquist (Team Lead), Barb Ralston, Joel Sankey, John Spence, Larry Stevens
  • Sediment: Paul Grams (Team Lead), David Topping (Team Lead), Joel Sankey, and Helen Fairley with Lucas Bair, Daniel Buscombe, Joseph Hazel, Erich Mueller, and Jack Schmidt
  • Tribal Cultural Values: tbd
  • Water Quality: Robert Radtke (Team Lead), Marianne Crawford, Katrina Grantz; Bridget Deemer, Charles Yackulic, Nicholas Voichick; Peggy Roefer (Team Lead); Todd Tietjen; Mark Anderson