Skip to content

Question

What is human-feedback data?

By SourceX Editorial · Updated

Short answer

Human-feedback data is information in which people evaluate or correct AI or other outputs: ratings, pairwise preferences, rankings, edits and written critiques, plus demonstrations of the correct answer. AI developers use it to align models with human judgment, most notably through reinforcement learning from human feedback (RLHF). Businesses sometimes hold naturally occurring feedback, such as reviewer edits or QA scores.

Part of: Human-generated data

Explanation#

Feedback data is typically produced by hired annotators, but real-world review processes (editor corrections, QA scoring) can provide similar signals.

Its value depends on the expertise of the reviewers and the consistency of guidelines.

Examples#

  • QA scorecards on support conversations
  • Senior editor corrections to junior drafts
  • Ranked alternative answers

Rights and privacy#

  • Reviewer and employee consent
  • Removal of personal data in reviewed content

How licensing works#

A business describes its data, buyer demand is assessed, scope and permitted use are proposed, the data is prepared and de-identified, an agreement is signed, and the approved dataset is delivered. See data licensing for detail.

Relevant industries

Relevant data types

Related questions

Sources

  1. Ouyang et al., Training language models to follow instructions with human feedback (2022)
  2. Christiano et al., Deep reinforcement learning from human preferences (2017)

General information, not legal advice. Editorial policy.

Related resources

See if your company qualifies

A short company assessment. No data uploads are needed.

See if your company qualifies Talk to SourceX
See if your company qualifies