Wikipedia:WikiProject User warnings/Testing/28bot
This space is for documentation on an A/B test with 28bytes' 28bot.
Hypothesis
Based on what we've seen through qualitative coding of new user contributions, the majority of first edits to Wikipedia are simple tests – tinkering with formatting, adding or removing random text, inserting [[File:Example]] into articles, etc. Some of these users probably don't even know their edits are visible to everyone until they receive a template warning, like the ones issued by 28bot. We'd like to test whether a few specific changes to the content of the message might increase retention of future good editors and decrease the likelihood that malicious test editors become persistent vandals. Specifically, we want to test for the effects of:
- personalization - a message written in the active rather than passive voice, with more friendly, welcoming, and encouraging language. Also, personalization in the sense that we will do different messages for registered and anonymous users.
- directives - a more detailed explanation of why their edit was reverted, where they can edit safely, where they can ask for help, and where/why to register an account (for anonymous editors)
- length - a much shorter message that only includes the most important links
Templates
Current
{{uw-test1}}
Welcome and thank you for your contributions. This is a notice that your test has been reverted or removed. If you would like to experiment further, please use the sandbox instead. Please take a look at the welcome page to learn more about contributing to this encyclopedia. This is an automated message from 28bot. False positive? Please report it.
New draft(s)
- Registered-only
Hello and thank you for editing Wikipedia! I just wanted to let you know that I undid a recent change you made, since it seemed to be a test or a simple mistake. Don't worry, it's great that you were bold and edited a page. It's also possible I was wrong, so if you feel I shouldn't have undone your edit, please let me know. Thanks again! ~~~~
- Anonymous-only
Hello, and thank you for editing Wikipedia! I just wanted to let you know that I undid your recent change to [[:{{{1}}}]], since it seemed to either be a test or simple mistake. Don't worry, it's great that you were bold and edited a page. I hope you'll stick around and help us improve the encyclopedia by signing up for a free account. It's possible I made a mistake, so if you feel I should not have reverted your edit, please let me know. Thanks again! ~~~~
Analysis
Outcomes we will want to measure include...
- Retention: how many editors edit after receiving the warning? 30 days after? 60 days after?
- Contact: how many editors (IP or registered) contact the bot or warning user? Is this contact constructive or not?
- Improvement: how many editors receive further warnings (from any user or bot) or are blocked?
- Registrations: how many IP editors go on to register accounts after being warned vs. those not given the warning?
Other notes and comments
- Should/can we alter the bot to send different templates to IPs and registered editors?