Awesome
awesome-annotation-tools
A curated list of awesome annotation tools. Please feel free to pull requests to add links.
Text
Caution: This is based on my survey about a year ago. I will update it asap.
Supporting Tasks
| Classification | Sequence Labeling | Seq2seq | Relation | Dictionary | Choice | |
|---|---|---|---|---|---|---|
| doccano | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | |||
| Prodigy | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | |
| Prodigy Teams | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ? | :heavy_check_mark: |
| tagtog | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ||
| LightTag | :heavy_check_mark: | :heavy_check_mark: | ||||
| Dataturks | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | |||
| Smart | :heavy_check_mark: | :heavy_check_mark: | ||||
| Universal Data Tool | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ? | :heavy_check_mark: |
| Label Studio(OSS) | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ? | :heavy_check_mark: |
| Label Studio(Enterprise) | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ? | :heavy_check_mark: |
| Humanloop | :heavy_check_mark: | :heavy_check_mark: | ? | :heavy_check_mark: | ? | :heavy_check_mark: |
| Snorkel Flow | :heavy_check_mark: | ? | ? | ? | ? | :heavy_check_mark: |
| Taggle | :heavy_check_mark: | :heavy_check_mark: | ? | :heavy_check_mark: | ? | :heavy_check_mark: |
| UBIAI | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ? |
| Annotation Lab | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
Supporting Active Learning or Auto Labeling
| Active Learning | Auto Labeling | Model Training | API Access | |
|---|---|---|---|---|
| doccano | :heavy_check_mark: | |||
| prodigy | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | |
| Prodigy Teams | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | |
| tagtog | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | |
| LightTag | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | |
| Dataturks | :heavy_check_mark: | |||
| Smart | :heavy_check_mark: | :heavy_check_mark: | ||
| Universal Data Tool | ||||
| Label Studio(OSS) | :heavy_check_mark: | :heavy_check_mark: | ? | |
| Label Studio(Enterprise) | :heavy_check_mark: | :heavy_check_mark: | ? | ? |
| Humanloop | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ? |
| Snorkel Flow | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ? |
| Taggle | :heavy_check_mark: | :heavy_check_mark: | ? | ? |
| UBIAI | ? | :heavy_check_mark: | :heavy_check_mark: | ? |
| Annotation Lab | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: |
Price and other
| Price range(12 month) | Customizable | On-premise support | Collaboration | OSS | Quality Control (e.g. benchmarking, IRR/IAA) | |
|---|---|---|---|---|---|---|
| doccano | $0 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | |
| Prodigy | $390-$10,000 | :heavy_check_mark: | ||||
| Prodigy Team | ? | :heavy_check_mark: | :heavy_check_mark: | |||
| tagtog | $0-$12,000 | :heavy_check_mark: | :heavy_check_mark: | |||
| LightTag | $1,200 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ||
| Dataturks | $0-3,600 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ||
| Smart | $0 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | IRR |
| Universal Data Tool | $0 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | Course/Benchmarking |
| Label Studio(OSS) | $0 | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ||
| Label Studio(Enterprise) | ? | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | ||
| Humanloop | $0 - $999 | ? | :heavy_check_mark: | :heavy_check_mark: | ||
| Snorkel Flow | ? | ? | ? | :heavy_check_mark: | ||
| Taggle | ? | ? | ? | :heavy_check_mark: | ||
| UBIAI | $0 - $1000 | :heavy_check_mark: | ? | :heavy_check_mark: | IAA | |
| Annotation Lab | Free | :heavy_check_mark: | :heavy_check_mark: | :heavy_check_mark: | Analytics & IAA |
Contribution
Welcome to the Pull Requests!