Regarding Recent Changes to Architect
blah blah blah blah blah... Seriously, Arcanaville lost me at "orthogonal".
|
What I am getting out of this is that it's infinitely simpler to attach human eyes and experience to the process, mod the AE and forget all about trying to fully automate the system.
Hell, if Paragon is too cheap to hire playtesters to approve arcs that qualify to get rewards, they might find some willing volunteers right here on this forum. To speed up the process, certain authors, respected and proven to be dedicated, might earn a kind of passport where their newly-published arcs get fast-tracked to full status. |
I think vetting "certain authors" would be a bad idea because it opens up a big ol' hole just ripe for easy abuse.
More automation will only create more holes for exploiters to slip through, and plugging them all will ruin the AE for legit uses. The collateral damage you're doing to legit arcs is not worth it. Quit wasting your energies playing the numbers game with farmers and exploiters. You will not win.
|
blah blah blah blah blah... Seriously, Arcanaville lost me at "orthogonal".
|
Solving Venture's problem gets you to the right longitude, but it does nothing to get you to the right latitude. Orthogonal.
What I am getting out of this is that it's infinitely simpler to attach human eyes and experience to the process, mod the AE and forget all about trying to fully automate the system. Hell, if Paragon is too cheap to hire playtesters to approve arcs that qualify to get rewards, they might find some willing volunteers right here on this forum. To speed up the process, certain authors, respected and proven to be dedicated, might earn a kind of passport where their newly-published arcs get fast-tracked to full status. |
More automation will only create more holes for exploiters to slip through, and plugging them all will ruin the AE for legit uses. The collateral damage you're doing to legit arcs is not worth it. Quit wasting your energies playing the numbers game with farmers and exploiters. You will not win. |
[Guide to Defense] [Scrapper Secondaries Comparison] [Archetype Popularity Analysis]
In one little corner of the universe, there's nothing more irritating than a misfile...
(Please support the best webcomic about a cosmic universal realignment by impaired angelic interference resulting in identity crisis angst. Or I release the pigmy water thieves.)
It's like how toon names names are or are not allowed. They literally do not have the time to check every name everyone registers for their toons - it would take far more people than they can afford far more time than they can. Unless you parade your toon in front of a mod/dev on a server, they won't see it untill someone reports it, they depend on us to help them track down the infrngers, people who use inappropriate words in their names, etc. So you can consider yourself a willing volunteer as of right now - "Go. Hunt. Report arcs" - go nuts!
|
I've seen little proof that the "Report Arc" button really accomplishes anything. If so, I would see far fewer complaints about how the MA is clogged. In the current system, the report button seems to mean "Report this arc and we will do nothing." Again, this is another example of Paragon's failure to step up and take responsibility. They shy away and bury their heads in complex mathematical equations deploying automated systems rife with flaws and bugs that do little good and alot of bad.
Besides, if I am reviewing arcs, I don't want to hunt for bad arcs. I don't want anything to do with bad arcs. I want to be able to pull from a queue where authors have submitted their arcs and said "Hey, my arc has no exploits and I think it deserves to give rewards." Those are the arcs I want to play.
I think vetting "certain authors" would be a bad idea because it opens up a big ol' hole just ripe for easy abuse.
|
Crime will always be with us but that doesn't mean it's pointless or useless passing laws against it. By the very nature of the relationship devs will be behind the curve - they have to play the "wait and see what they find, then fix it" game with the exploiters. That said, the holes exploiters can find will keep getting smaller and smaller until they're so small it's not worth their time when it's easier to go farm a standard arc.
|
(snip)... Solving Venture's problem gets you to the right longitude, but it does nothing to get you to the right latitude. Orthogonal.
|
This infinitely simpler process doesn't seem to have a simple way to select and vet player-reviewers, or deal with the potential backlash to players moderating players.
|
The devs need to get better, certainly. But personally, I think in a game of numbers my own chances would be better than average.
|
Its not quite that bad, because you only need to consider the case of a reasonably straight-forward solution to the mission, and then search for all possible ways to complete it quicker. All ways slower don't count. |
There's an orthogonal problem to allowing higher than standard rewards in AE missions, and that is the simple fact that there is no proportionality between "difficulty" and reward rates. |
Further downthread....
I am not buying this "they don't have time" excuse. It's a cop-out. It's laziness. |
We are rapidly closing in on 400,000 keys used. While the vast majority of those are no longer in the system (much of the turnover is due to the aforementioned "publish and perish" method used by exploiters, or idiots who publish their arcs to test them and then delete and republish), it is fair to say there are still thousands of arcs available. I don't recall the exact number that was given recently but it was on the order of tens of thousands of extant arcs, so let's go with that.
Assume there are 10,000 arcs (there are probably many more). Now assume that it "only" takes 15 minutes, on the mean, to thoroughly examine one, an estimate that based on my own experience in reviewing over 150 arcs may be charitably described as laughingly optimistic, but we'll roll with it. You're looking at 150,000 man-minutes, or 2500 man-hours, to check them all. That's 62.5 man-weeks, assuming 40-hour weeks. The last estimate I heard of Paragon Studio's staff size was on the order of 50, so if they put 10% of their staff on doing nothing but checking MA arcs they'll be done in about 3 months...and then they can get started on all the arcs that were submitted in that time.
That's using numbers that are almost certainly way too low.
How fast arcs are being added to the system is harder to estimate, because of things like the maximum number of arc slots and how willing people are to delete arcs to make room for new ones, but I think it is fair to say that we are getting on the order of hundreds of new arcs per week (proof does not fit in this margin). Every 100 new arcs would require 25 man-hours to vett with the above assumption of 15 minutes/arc. It should be clear they can't afford to put enough people on this to keep up. It's not laziness.
Current Blog Post: "Why I am an Atheist..."
"And I say now these kittens, they do not get trained/As we did in the days when Victoria reigned!" -- T. S. Eliot, "Gus, the Theatre Cat"
But they don't check every arc; they check arcs that are reported. Nobody knows how that system works or how many arcs are reported in a given time period.
I know that they can restore an unpublished arc so they are probably all still on the server and just no longer showing up in searches, which means that they can still check an arc that was published briefly, violently exploited, and then unpublished.
I still think what we need is a great purge. Mark all arcs currently in the system and hide them from searches that don't specifically target their ID numbers or authors. Remove the mark when an arc is republished. This would push abandoned arcs under the rug while authors who care about their work won't be affected beyond a five minute republishing spree.
Winner of Players' Choice Best Villainous Arc 2010: Fear and Loathing on Striga; ID #350522
Right, let me break this down for you.
We are rapidly closing in on 400,000 keys used. While the vast majority of those are no longer in the system (much of the turnover is due to the aforementioned "publish and perish" method used by exploiters, or idiots who publish their arcs to test them and then delete and republish), it is fair to say there are still thousands of arcs available. I don't recall the exact number that was given recently but it was on the order of tens of thousands of extant arcs, so let's go with that. Assume there are 10,000 arcs (there are probably many more). Now assume that it "only" takes 15 minutes, on the mean, to thoroughly examine one, an estimate that based on my own experience in reviewing over 150 arcs may be charitably described as laughingly optimistic, but we'll roll with it. You're looking at 150,000 man-minutes, or 2500 man-hours, to check them all. That's 62.5 man-weeks, assuming 40-hour weeks. The last estimate I heard of Paragon Studio's staff size was on the order of 50, so if they put 10% of their staff on doing nothing but checking MA arcs they'll be done in about 3 months...and then they can get started on all the arcs that were submitted in that time. That's using numbers that are almost certainly way too low. How fast arcs are being added to the system is harder to estimate, because of things like the maximum number of arc slots and how willing people are to delete arcs to make room for new ones, but I think it is fair to say that we are getting on the order of hundreds of new arcs per week (proof does not fit in this margin). Every 100 new arcs would require 25 man-hours to vett with the above assumption of 15 minutes/arc. It should be clear they can't afford to put enough people on this to keep up. It's not laziness. |
The "everybody republish your arcs" idea that FredrikSvanberg has is pretty good, but I'd hate to think we might lose some good ones just because an author left the game and isn't around to do it. Then again, considering what we stand to gain... I might be able to live with it.
But they don't check every arc; they check arcs that are reported. |
I know that they can restore an unpublished arc so they are probably all still on the server and just no longer showing up in searches, which means that they can still check an arc that was published briefly, violently exploited, and then unpublished. |
I still think what we need is a great purge. |
Current Blog Post: "Why I am an Atheist..."
"And I say now these kittens, they do not get trained/As we did in the days when Victoria reigned!" -- T. S. Eliot, "Gus, the Theatre Cat"
It seems clear to me that interest in MA is at a low point right now.
You can tell just by looking at this message board forum. This is the only thread on this forum that seems to be really active at this time.
My 5 star arc with 46 plays has gotten no plays in weeks. In fact the only plays any of my arcs have gotten in a very long time are from 2 in game friends and PW because I asked for a review.
At the moment I have no motivation to update any of my arcs because I don't have any idea what sort of fix is coming or even for sure when it will be implemented.
Where I work as a software developer, if there is ever a fix that breaks things it is backed out. I strongly feel that the recent fix should be backed out because it hurts the people who care about MA. Exploiters will always find ways to exploit and it seems the wrong people have been hurt by the fix.
I also strongly agree with a purge of arcs that have not been published/republished in say 90 days. Of course devs choice/HOF arcs would be excluded and perhaps even 5 star arcs with more than some fixed number of plays (if the number is high enough it would be easy to check if they are legit).
It is very sad to me that a tool with such great potential to add so much to the game is in the state that it is in now. I hope something is done soon.
@Gypsy Rose
In Pursuit of Liberty - 344916
The Vigilante - 395861
Suppression - 374481 - Winner of The American Legion's February 2011 AE Author Contest
The "everybody republish your arcs" idea that FredrikSvanberg has is pretty good, but I'd hate to think we might lose some good ones just because an author left the game and isn't around to do it. Then again, considering what we stand to gain... I might be able to live with it.
|
Winner of Players' Choice Best Villainous Arc 2010: Fear and Loathing on Striga; ID #350522
I also strongly agree with a purge of arcs that have not been published/republished in say 90 days. |
Current Blog Post: "Why I am an Atheist..."
"And I say now these kittens, they do not get trained/As we did in the days when Victoria reigned!" -- T. S. Eliot, "Gus, the Theatre Cat"
How about this then: the arcs can still be found by searching for the author or ID, and the first time they are played (completed) after the purge they get unmarked and shows up in searches once again. That way anyone can "reinstate" an arc by simply looking it up and playing it. Admittedly a few arcs might be lost because nobody can remember its ID number or the author.
|
I also agree with Arrowrose and others that MA is at an extreme low point right now and do fear that bundling the fix with GR will be too little too late. As a matter of normal course AE arcs see sharp drops in plays each time a new issue is released for a week to maybe a month or so. With such a large addition to the game like GR I would expect at least a month of slow time. Combined with two plus months of slow time post patch may put MA in a place it can't bounce back from.
WN
Check out one of my most recent arcs:
457506 - A Very Special Episode - An abandoned TV, a missing kid's TV show host and more
416951 - The Ms. Manners Task Force - More wacky villains, Wannabes. things in poor taste
or one of my other arcs including two 2010 Player's Choice Winners and an2009 Official AE Awards Nominee for Best Original Story
@Gypsy Rose
In Pursuit of Liberty - 344916
The Vigilante - 395861
Suppression - 374481 - Winner of The American Legion's February 2011 AE Author Contest
Eva Destruction AR/Fire/Munitions Blaster
Darkfire Avenger DM/SD/Body Scrapper
Arc ID#161629 Freaks, Geeks, and Men in Black
Arc ID#431270 Until the End of the World
Winner of Players' Choice Best Villainous Arc 2010: Fear and Loathing on Striga; ID #350522
The Great Purge would only clear out the dreck currently in the system. In order to keep the system clear they would need to do purges every few months, because if it was simply a system of "x days without an update or a play = hidden" then the outdated arcs would get plays, just to tick us off.
Yes, it sounds like a lot of effort to go to just to tick us and the devs off. I fully believe that some people are willing to go to any lengths to be jerkasses, feel free to prove me wrong.
Eva Destruction AR/Fire/Munitions Blaster
Darkfire Avenger DM/SD/Body Scrapper
Arc ID#161629 Freaks, Geeks, and Men in Black
Arc ID#431270 Until the End of the World
Why do I picture some lone jerkass clicking "play" on every outdated single-mission Steel Canyon blinky grab he can find? |
Current Blog Post: "Why I am an Atheist..."
"And I say now these kittens, they do not get trained/As we did in the days when Victoria reigned!" -- T. S. Eliot, "Gus, the Theatre Cat"
Agreed, but the original proposal was to automate evaluation of potential reward rates directly, not "difficulty".
|
You could come up with a heuristic (as opposed to an algorithm) that could guess whether or not an arc would be abusive, with varying degrees of accuracy, but that has its own problems, left as an exercise for the reader. |
So you could catch the worst offenders with a boundary checker, but in terms of what the upstream poster was talking about - allowing the AE to include higher than standard rewards - an abuse checker would need to also look at whether higher than normal but not astronomical rewards were not abusive in some way. Or to put it in the way they did, those rewards have to have an appropriate "cost." Which is why I mention that even if you could datamine difficulty and reward rates, neither one of those directly determines cost, the target you want to hit.
[Guide to Defense] [Scrapper Secondaries Comparison] [Archetype Popularity Analysis]
In one little corner of the universe, there's nothing more irritating than a misfile...
(Please support the best webcomic about a cosmic universal realignment by impaired angelic interference resulting in identity crisis angst. Or I release the pigmy water thieves.)
The difficulty in creating a clear and unambiguous definition of "exploit" reminds me of the similar difficulty in creating a legal definition of "pornography" which led to the famous declaration of Justice Potter Stewart that "I know it when I see it".
Come to think of it, there are a number of other parallels between exploits and pornography.
@SPTrashcan
Avatar by Toxic_Shia
Why MA ratings should be changed from stars to "like" or "dislike"
A better algorithm for ordering MA arcs
Ok, since my first suggestion seems to be a math and coding nightmare can one of the math guru's tell me what the problem would be with simply placing a cap on the XP obtainable per mission?
The devs have been data mining for some time now and I suspect they have a good idea what kind of XP an average 8 player pug can produce by doing scanners for example. Given the fact a solo player can set their difficulty to be equal to a team of 8, why can't they just say no matter what you put in the mish the maximum amount of XP obtainable is "X"?
If you fill a map with enough enemies to go over that limit they produce nothing. Would you then be able to roll some things back into the MA that have been removed because they cannot produce accelerated rewards?
I am also all for a complete mission purge. Allow folks enough time, and send an email notice to folks that have been away, so they can unpublish their work. Then wipe the slate clean and insitute some form of Venture's system where once an arc is published it must be attended to by the author or played by the public during a certain period of time or it will be automatically removed from the listing.
The Revenants and Vengeance Imperium-Triumph, Champion & now flavoring Justice!
Tanker Tuesdays & Brutal Thursdays. If you like fun, look'em up!
Shhh! Rangle is plotting.
This is pretty far afield from the original topic, but regarding "purging" old arcs, I think you could implement a much less drastic solution as follows:
* Create a new "freshness" classification for arcs. An arc can be "fresh" or "stale".
* A newly published arc is marked "stale".
* An arc is marked "fresh" if someone (including the author) plays through the arc from beginning to end.
* An arc is marked "stale" if the author republishes it. (But becomes "fresh" again if the author playtests it.)
* Every patch (or possibly only patches that affect MA) automatically marks all arcs "stale", except for honored arcs (guest author, dev choice, hall of fame). Honored arcs are permanently "fresh".
* Add a "freshness" search criteria allowing users to search for "fresh" "stale" or "don't care" on freshness.
* Set the default search to only search for "fresh" arcs.
Advantages:
* Automatically expires old arcs that are not maintained, without actually deleting them. (However, you can save a beloved arc whose author has vanished by playing through it on your own.)
* Encourages authors to playtest their own arcs after each republish and after each patch. (This is a good practice in general.)
* Low development effort (at least, I think so)
* If you vanish for a year and your arc goes stale, you can come back and it's still there, though it may need some sprucing up.
This doesn't address the exp issues, but would address the clutter issues. Not sure if cleaning up the arc clutter is even on dev radar at this point (I'm sure there's a lot of bigger fish to fry), but thought I'd put this forward just in case.
@PW - Police Woman (50 AR/dev blaster on Liberty)
TALOS - PW war journal - alternate contact tree using MA story arcs
=VICE= "Give me Liberty, or give me debt!"
Ok, since my first suggestion seems to be a math and coding nightmare can one of the math guru's tell me what the problem would be with simply placing a cap on the XP obtainable per mission?
|
The problem the ally nerf was intended to solve wasn't that people were actually getting more XP/mission. The problem is that they were getting said XP faster and more safely. Compare the kill rate of an SO'd Scrapper to that of a heavily IOd Scrapper with perma-hasten, soft-capped defense and added HP, regen, and recovery. The IOd Scrapper can survive tougher spawns and kill them faster. A map full of allies can, in seconds, give anyone that survivability and kill speed, that would otherwise take billions of inf to achieve.
Eva Destruction AR/Fire/Munitions Blaster
Darkfire Avenger DM/SD/Body Scrapper
Arc ID#161629 Freaks, Geeks, and Men in Black
Arc ID#431270 Until the End of the World
This is pretty far afield from the original topic, but regarding "purging" old arcs, I think you could implement a much less drastic solution as follows:
* Create a new "freshness" classification for arcs. An arc can be "fresh" or "stale". * A newly published arc is marked "stale". * An arc is marked "fresh" if someone (including the author) plays through the arc from beginning to end. * An arc is marked "stale" if the author republishes it. (But becomes "fresh" again if the author playtests it.) * Every patch (or possibly only patches that affect MA) automatically marks all arcs "stale", except for honored arcs (guest author, dev choice, hall of fame). Honored arcs are permanently "fresh". * Add a "freshness" search criteria allowing users to search for "fresh" "stale" or "don't care" on freshness. * Set the default search to only search for "fresh" arcs. Advantages: * Automatically expires old arcs that are not maintained, without actually deleting them. (However, you can save a beloved arc whose author has vanished by playing through it on your own.) * Encourages authors to playtest their own arcs after each republish and after each patch. (This is a good practice in general.) * Low development effort (at least, I think so) * If you vanish for a year and your arc goes stale, you can come back and it's still there, though it may need some sprucing up. This doesn't address the exp issues, but would address the clutter issues. Not sure if cleaning up the arc clutter is even on dev radar at this point (I'm sure there's a lot of bigger fish to fry), but thought I'd put this forward just in case. |
I'd hate to lose the plays and stars I already have on my arc(s), but if it means actually fixing the system and getting rid of all the ****, I'll deal.
My characters at Virtueverse
Faces of the City
This is pretty far afield from the original topic, but regarding "purging" old arcs, I think you could implement a much less drastic solution as follows:
* Create a new "freshness" classification for arcs. An arc can be "fresh" or "stale". <snip> This doesn't address the exp issues, but would address the clutter issues. Not sure if cleaning up the arc clutter is even on dev radar at this point (I'm sure there's a lot of bigger fish to fry), but thought I'd put this forward just in case. |
So.... who do I have to bribe, and how much, to get the Devs to implement this.
I'm a published amateur comic book author: www.ericjohnsoncomics.com
******MA Arcs****
Arc 5909: "Amazon-Avatars"
Arc 6143: "Escalation" (Nominee: Architect Awards, Nominee: Player Awards, and Dev's Choice!)
Still, it would not be easy.
There's an orthogonal problem to allowing higher than standard rewards in AE missions, and that is the simple fact that there is no proportionality between "difficulty" and reward rates. There is only an implicit threshold of difficulty for a given reward rate which the situations must meet. In other words, even if it was possible to compute "difficulty" as a number, the appropriate reward rate for that mission isn't necessarily a function of that number.
The actual boundaries on reward rates for individual situations have as much to do with conditions outside of but related to those situations as within them. For example, the value of the reward that Hamidon generates has as much to do with how repeatable the trial is and how stackable the reward could be as it does how difficult the Hamidon trial actually is. Those types of variables are much more difficult to control for in the AE because people can easily publish many copies of the same missions with minor non-material (to rewards) changes.
Almost regardless of the difficulty of the arc, if the arc is indefinitely repeatable that already places a limit on the rewards that arc should generate. And that makes it difficult to allow more than trivial increases in reward rate above the standard one.
What I am getting out of this is that it's infinitely simpler to attach human eyes and experience to the process, mod the AE and forget all about trying to fully automate the system.
Hell, if Paragon is too cheap to hire playtesters to approve arcs that qualify to get rewards, they might find some willing volunteers right here on this forum. To speed up the process, certain authors, respected and proven to be dedicated, might earn a kind of passport where their newly-published arcs get fast-tracked to full status.
More automation will only create more holes for exploiters to slip through, and plugging them all will ruin the AE for legit uses. The collateral damage you're doing to legit arcs is not worth it. Quit wasting your energies playing the numbers game with farmers and exploiters. You will not win.