How to create an artist selection rubric

An artist selection rubric states what you assess, what each score means and how much each criterion contributes. It helps reviewers explain their judgment against the same brief. The criteria should follow your program's purpose and the evidence you ask artists to submit.

Use this guide alongside writing an open call and running the selection process. Artsume's scoring tools let organizations apply a rubric within review.

This guide gives Artsume's practical recommendations. The examples explain a process; they do not report customer results. A funder's rules apply to that funder's programs. Check your own program's requirements before using them.

Choose criteria that answer the brief

Start with the decision you need to make. For a commission, relevant criteria might include the proposed work, response to the site and delivery feasibility. For a residency, you may need the practice, proposed use of the residency and fit with available facilities.

Keep eligibility outside the weighted score. A required location or available date should be checked against the published rule. Do not bury that requirement inside a low score for artistic merit.

Avoid two criteria that assess the same thing under different names. If originality and innovation both mean the same quality to your panel, the rubric may give it twice the weight you intended.

Define the evidence for each criterion

Give every criterion an evidence source: work samples, a proposal, a schedule, a budget or relevant career experience. Reviewers should know where to look and what would support their score.

Do not treat a prestigious institution as a substitute for assessing the submitted work. A confirmed career credit can establish that an organization confirms a specific entry. It does not certify the whole person or the quality of their art. See credit confirmation.

The NEA review process publishes the criteria it uses within its own grant process. Your rubric should likewise connect its criteria to your program, rather than borrowing official-sounding labels without a definition.

Anchor the scores in observable differences

A number needs a meaning. Define the lower, middle and upper ends of the scale before reviewers start. An anchor should describe the evidence, not merely repeat poor, average and excellent.

For a feasibility criterion, a low anchor might describe a proposal with unresolved dependencies and no delivery plan. A middle anchor could describe a plausible plan with specific gaps. A high anchor could describe a supported plan with resources, responsibilities and a workable schedule.

Do not make reviewers infer facts that are absent. If an answer is missing, use the missing-information policy. A zero should mean what the scale defines, not whatever a reviewer could not find.

Work through the weights before review

The following is a teaching example for an exhibition proposal. It is not an Artsume default or a recommended rubric for every program. The example uses a zero-to-five scale, with weights totaling one hundred percent.

For this example, each contribution is the score divided by five, multiplied by the weight. The total is 24 + 18 + 25 + 12 = 79.

If your scale starts at one, decide whether the minimum contributes zero or a positive share. Those are different calculations. Check the actual normalization in your review tool and explain it in the panel briefing. Do not compare totals from different scale rules as if they mean the same thing.

Decide what happens with missing evidence

Choose a consistent policy before applications open. If a required document is missing, that may be an administrative completeness question. If the document exists but does not support a criterion, that is an assessment question.

A reviewer should not silently replace a missing score with zero or change the remaining weights. Both actions change the total. Ask for clarification or use the recorded handling rule so the panel can understand the result.

Keep a distinction between a reviewer who has not finished and an applicant who has supplied insufficient evidence. A partially completed review should not look like a final low score.

Test the rubric with the panel

Use a shared practice application to check whether reviewers understand the anchors. Ask them to explain the evidence behind their scores before discussing the total.

If scores differ because the criterion is unclear, revise its wording before live review. If they differ because reviewers make different artistic judgments, record those reasons. A rubric can make disagreement visible; it cannot remove judgment.

Set a rule for conflicts of interest. Blind review can hide selected identity fields, but artists can remain recognizable through their work, text or linked materials. Reviewers still need a way to disclose recognition and conflicts.

Set the tie and decision rules

Choose how the panel handles equal totals before it sees the final ranking. You might discuss a published priority criterion or seek an additional independent assessment. Use the same rule for equivalent cases.

Avoid changing weights after reviewing the pool to produce a preferred winner. If the program's circumstances materially change, document the change and assess its effect on everyone who applied.

A final selection can include budget, available places or curatorial considerations if the call explains their role. Record the decision separately from the score. Do not present a recommendation as an acceptance before the authorized person releases it.

Put the rubric into Artsume

Create the rubric through your organization's scoring settings. Name the criteria, set their scales and weights, and attach the rubric in the program's Review settings. Rubric scoring is part of Artsume Pro for organizations. Free recommendation review remains available.

Read reviewing applications for the current controls and permissions. Confirm the tool's displayed total with a practice review before the panel begins. Keep the published criteria consistent with the rubric your reviewers receive.

A funder example: published criteria

The Canada Council describes peer committees that read and score applications against published criteria. Committees then rank applications or select prize winners. This describes the Council's process. It does not validate the teaching weights in this guide.

Keep your criteria tied to the evidence you collect. Explain how the panel uses scores and judgment. Artsume recommends testing that explanation with a practice application before review.

Use the review instructions to configure the program and brief the people who will assess it.