In this study, categories, dimensions, and criteria for evaluating regional climate services are derived by a participatory approach with potential service users at the German Baltic Sea coast. The development is carried out within nine face-to-face interviews conducted with decision makers, working in climate sensitive sectors at the German Baltic Sea coast. Three main groups of categories were localized which seem to matter most to the considered stakeholders and which seem to be crucial evaluation categories for regional climate services: (1) credibility, (2) relevance, and (3) appropriateness. For each of these evaluation categories several dimensions emerged, indicating certain perspectives of stakeholder demands. When summarizing these evaluation categories and their dimensions, 13 evaluation criteria for regional climate services can be derived (see Table 1). The results show that stakeholders do mainly address components other than those found in the literature (e.g. inputs, process, outputs, outcomes, and impacts). This might indicate that an evaluation, following solely literature-based (non-participative) components, is not sufficient to localize deficiencies or efficiencies within a regional climate service, since it might lead to results which are not relevant for potential users.