Evaluator Guide

Help curate great content by reviewing submissions.

Quick Access
Go to My Events → Select an event → Submissions (Evaluator section)

Welcome, Evaluator!

As an evaluator, you help select the best talks for the event.

Your Role

What Evaluators Do

Review assigned submissions
Provide ratings
Give feedback
Help select content

What Evaluators See

Assigned submissions only
Submission details
Other evaluator scores (if enabled)

Getting Started

Access Evaluator Dashboard

Log in to Kite
Go to the event
See Evaluator Dashboard

View Assignments

Go to My Assignments or Submissions
See submissions to review
Track progress

Reviewing Submissions

Open a Submission

Click on submission title
Read full details:
- Title
- Abstract
- Speaker info
- Custom fields

Evaluate

Rating

Provide your score:

5: Excellent - Must include
4: Very Good - Strong candidate
3: Good - Consider if space
2: Fair - Below average
1: Poor - Do not accept

Feedback

Write your thoughts:

What's strong
What's weak
Suggestions
Concerns

Submit Evaluation

Enter rating
Add feedback (optional)
Click "Submit"
Move to next

Evaluation Criteria

Consider

Criterion	Questions
Relevance	Does it fit the event?
Quality	Is the proposal clear?
Speaker	Are they qualified?
Interest	Will attendees enjoy it?
Originality	Is it fresh?

Stay Objective

Focus on content
Set aside personal bias
Be consistent
Consider the audience

Managing Your Queue

Track Progress

See your status:

Total assigned
Completed
Remaining

Priority

Review in order:

Deadline approaching
Newest first
Or your preference

Pace Yourself

Set daily goals
Don't rush
Take breaks

Feedback Guidelines

Good Feedback

"Strong technical topic that would interest our
audience. The speaker's background in Kubernetes
makes them credible. The abstract is clear but
could benefit from specific takeaways."

What to Include

Overall impression
Specific strengths
Areas for improvement
Recommendation

What to Avoid

Personal attacks
Vague comments
Bias based on speaker
Comparing to other submissions

Conflicts of Interest

When to Recuse

Recuse yourself if:

You know the speaker personally
You work at same company
You're competing on same topic
Any other conflict

How to Recuse

Don't rate the submission
Notify organizers
Request reassignment

Timeline

Typical Process

Receive assignments
Review period (1-3 weeks)
Submit all evaluations
Organizers compile results

Deadlines

Check your deadline
Complete all reviews
Request extension if needed

Communication

Questions

Contact organizers if:

Unclear criteria
Technical issues
Need more time
Conflict of interest

Discussion

If enabled:

See other ratings
Discuss borderline cases
Collaborate on decisions

Best Practices

Be Thorough

Read entire submission
Consider all aspects
Think about audience

Be Fair

Consistent standards
Objective evaluation
Constructive feedback

Be Timely

Meet deadlines
Communicate issues
Complete all reviews

Resources

Previous: Attendee Guide Next: Sponsor Guide

My Profile

Review Submissions