Sort of like a test run for this weekends Engagement League. Potentially, both these numbers will be added and scored.
I'm trying to improve, without breaking, how to gauge interaction and engagement with regards to the Engagement League I host each week, which is sponsored by @curie. The sponsorship and level of support shown for the post means that I take it seriously, and wish for it to be as fair and interesting as possible.
Counting the number of unique individuals engaged with each week seems like it might fit the bill for a new metric. And in turn, the total number of unique individuals that replied to you could also be of worth - maybe a combination/calculation of both is in order?
For the 'individuals spoken to', here's what I have so far:
select count(distinct parent_author) from Comments WHERE parent_author <> 'abh12345' and author = 'abh12345' AND created > DATEADD(day, -7, getutcdate()) AND depth > 0
So basically, the number of people that replied to me (who were not me!). This one is pretty straight-forward, and I think i'm OK with the result.
For the number 'who spoke to you', we have options.
- Do you think that the number of people that spoke to you, excluding top level replies to posts, is the way to go? Or do you think top level replies should also be counted?
- Also, do you think that one or both of the above counts should require a minimum character count for the comment/reply?
e.g. 'Nice post, resteem me sir' will not be counted if the reply is shorter than 40 characters
The SQL here could be something like:
-- PEOPLE WHO SPOKE TO YOU
select count(distinct author) from Comments WHERE parent_author = 'abh12345' and author <> 'abh12345' AND created > DATEADD(day, -7, getutcdate()) AND depth > 0
-- PEOPLE WHO SPOKE TO YOU excluding top level replies
select count(distinct author) from Comments WHERE parent_author = 'abh12345' and author <> 'abh12345' AND created > DATEADD(day, -7, getutcdate()) AND depth > 1
-- PEOPLE WHO SPOKE TO YOU excluding top level replies and replies less than 50 characters
select count(distinct author) from Comments WHERE parent_author = 'abh12345' and author <> 'abh12345' AND created > DATEADD(day, -7, getutcdate()) AND depth > 1 AND len(body)>50
Regarding scoring unique interactions
Engagement can be considered to me, an in-depth discussion requiring many replies between two people. It is also, a shorter two/three threaded (depth) conversation.
Which of the above holds more value?
Because If these metrics are added, the people who engaged with the greater number of people would benefit the most. Is that fair?
Gamification - just say 'thanks but no thanks, sir'
Since I released all the metrics used earlier in the year, I've always had slight concerned about the possibility of gaming the results.
Thus far though, I'm happy to report that there has been little to no match-fixing going on. And whilst I try to check each week on suspicious looking activity, I also place a little of this on the entrants and ask them to check on how folks are generating their numbers. Members have also come to me and ask to be removed. e.g. due to there copy/paste commenting for a community initiative, where they would go crazy if they were to type the same thing over and over.
I would like to hear peoples views on the potential changes above, before I go ahead and alter the scoring structure. Mainly because I don't want to balls things up, and well, the Engagement League is here because of you guys - you should have some sort of say, right?
Today i'm going to bribe you for your 'number of people spoken to', 'number of people who spoke to you' by offering these numbers, IF you give some sort of feedback on the above!
Let's hear what you got to say :)
Almost forgot, your reply might include this:
| Metric | Count |
|---|---|
| Unique accounts you spoke to | 178 |
| - | - |
| Unique accounts that spoke to you | 174 |
| Unique accounts that spoke to you, excluding top level replies | 116 |
| Unique accounts that spoke to you, excluding top level replies and replies < 50 chars | 88 |
In other news, my auto-voter is off for 12 hours starting from now, that's what you get for hitting the button 800/900 times each week :(
Thanks in advance!
Asher