Do you think ClueBot NG has a substantial impact on the volume of edits you need to review?
Do you review ClueBot NG's edits or false positive reports? If so, how do you find this process?
Are there any feature requests you have for ClueBot NG?
Open questions about use on the English Wikipedia
How would English Wikipedia evaluate Automoderator to decide whether to use it?
To me at least, the really relevant portion is "what edits could Automoderator catch that ClueNG isn't already". So any evaluation would be easied by seeing examples/scale of what it's catching. Attached to that is being confident that automoderator isn't making more false positives than ClueNG (we could already configure ClueNG to catch way more problematic edits if we accepted twice the false positive rate, so 0.1% or less would be needed). Nosebagbear (talk) 11:16, 25 August 2023 (UTC)[reply]
Would the community rather test this software early (e.g. in log-only modes), or wait until further in development after other communities have trialled it?
What configuration options would you want to see in the tool?
@Xaosflux Thanks for the suggestion! At the moment the machine learning models that we're using only support the main namespace, which is the same as ClueBot NG as I understand it. If that changes, I think a namespace filter sounds like a fairly straightforward configuration to add. Samwalton9 (WMF) (talk) 13:41, 25 August 2023 (UTC)[reply]
Open questions about Automoderator in general
What is the support model for this feature?
Who specifically will be responsible for bug fixes and feature requests for this utility? If this includes paid WMF staff, are any SLOs going to be committed to? — xaosfluxTalk13:10, 25 August 2023 (UTC)[reply]
@Xaosflux The Moderator Tools team will be responsible for development and ongoing maintenance of the Automoderator configuration interface, and the Machine Learning and Research teams are responsible for the model and its hosting via LiftWing. SLOs aren't something we've talked about for this project in particular, but I think it's an interesting idea, so let me chat about it and I'll get back to you. Samwalton9 (WMF) (talk) 13:48, 25 August 2023 (UTC)[reply]
Where does Automoderator sit in the workflow?
The description says "prevent or revert", will this tool function at multiple layers? There are many steps of the publish workflow today, where in the workflow would this tool function? Specifically before/after which step, keeping in mind certain existing/planned steps such as editcheck, captcha, sbl, abusefilter, ores, publish, copyvioscore, pagetriage. — xaosfluxTalk13:18, 25 August 2023 (UTC)[reply]
