Blacklisted Betas instead of Whitelisted Betas!


BBhumeBB

 

Posted

Why not? Give the customers what they want. :P

Edit: OMG. NOOO. I somehow got green rep.


 

Posted

Quote:
Originally Posted by The_Coming_Storm View Post
Why not? Give the customers what they want. :P

Edit: OMG. NOOO. I somehow got green rep.
Ya, I got green reped as well.

Not sure what you mean by a blacklisted vs whitelisted beta.


 

Posted

Aren't Open betas a lot like blacklisted access? Those not in good standing order are not allowed? It's only closed betas that are Whitelisted.



Home server: Victory
Characters on: Victory & Virtue
My first 50(0)! 18/11/11
@Oneirohero

 

Posted

Quote:
Originally Posted by je_saist View Post
TCS: you need to read the current five posts at this link: http://www.gamenikki.com/g3/blogs/Ja...stIndexItem=45

(note: due to the tracking nature of the blog system in use, these 5 posts will change and be sorted further down the list)
That article is too cynical.


 

Posted

Closed then open provides the Devs with focused feedback early in the process. The smaller groups leads to a much better ability to manage them



@Catwhoorg "Rule of Three - Finale" Arc# 1984
@Mr Falkland Islands"A Nation Goes Rogue" Arc# 2369 "Toasters and Pop Tarts" Arc#116617

 

Posted

Quote:
Originally Posted by Catwhoorg View Post
Closed then open provides the Devs with focused feedback early in the process. The smaller groups leads to a much better ability to manage them
How can a larger pool not give more focused feedback?


 

Posted

Too much incoherent screaming. You know these forums.


 

Posted

Quote:
Originally Posted by The_Coming_Storm View Post
How can a larger pool not give more focused feedback?
More people, more voices, less focus.

In Catwhoorg's sentence above "more" modifies focused, not feedback. More focused, not more feedback.

In the early stages, it's not about the quantity of responses and people looking at things, or about loading the servers and systems. It's about noticing important bugs and pinning down how to reproduce them so they can be seen by the devs and fixed.

When there's a lot of people in a beta, and a lot of people posting, it quickly becomes impossible to pin down the responses and reports you need from the people working on the bugs you're interested in.

Essentially, we used to have blacklist betas. There was no such thing as closed betas for most of the early issues. They went to a closed beta system, and since then by and large Issues have come out with far fewer bugs in most cases. Truth of the matter is, they flat out work better (or they wouldn't keep doing them).


"Null is as much an argument "for removing the cottage rule" as the moon being round is for buying tennis shoes." -Memphis Bill

 

Posted

Quote:
Originally Posted by Lemur Lad View Post
More people, more voices, less focus.

In Catwhoorg's sentence above "more" modifies focused, not feedback. More focused, not more feedback.

In the early stages, it's not about the quantity of responses and people looking at things, or about loading the servers and systems. It's about noticing important bugs and pinning down how to reproduce them so they can be seen by the devs and fixed.

When there's a lot of people in a beta, and a lot of people posting, it quickly becomes impossible to pin down the responses and reports you need from the people working on the bugs you're interested in.

Essentially, we used to have blacklist betas. There was no such thing as closed betas for most of the early issues. They went to a closed beta system, and since then by and large Issues have come out with far fewer bugs in most cases. Truth of the matter is, they flat out work better (or they wouldn't keep doing them).
More people to notice the important bugs. Heck, maybe there are even more people like me that are perhaps more motivated then some of the current testers now, but can't test because of this restriction.


 

Posted

Like we're trying to tell you. More people is not better. It's about having people that can observe, report, and follow instructions.

As for people not inside being more motivated than the people who are? That's a really low blow. I've been there, several times. Most of the people who make it take it seriously and get a lot done. From what little I remember of your posting history, I don't think you'd do better.

I don't doubt for a second that some awesome testers get left out. I don't for a second think the solution is letting everyone in and hoping the good ones can make themselves heard over the roar.


"Null is as much an argument "for removing the cottage rule" as the moon being round is for buying tennis shoes." -Memphis Bill

 

Posted

Quote:
Originally Posted by The_Coming_Storm View Post
How can a larger pool not give more focused feedback?
It's why we raise our hand to talk in school. You can't hear 30 people at once.

And you can't read ten thousand bug reports a day.

And you can't change how Closed Beta works no matter how many times you post about it, whether whining, complaining, or 'innocent questioning' about it.


Speeding Through New DA Repeatables || Spreadsheet o' Enhancements || Zombie Skins: better skins for these forums || Guide to Guides

 

Posted

Quote:
Originally Posted by The_Coming_Storm View Post
How can a larger pool not give more focused feedback?
Come on now storm. You're trying too hard. My rep suggests i'm better than you at this. :P


 

Posted

Quote:
Originally Posted by The_Coming_Storm View Post
More people to notice the important bugs. Heck, maybe there are even more people like me that are perhaps more motivated then some of the current testers now, but can't test because of this restriction.
Even if you gave a thousand typewriters to a thousand monkeys, I'm sure they won't be able to reproduce the complete works of Shakespeare faster than he himself produced them.


Quote:
Originally Posted by Arcanaville View Post
Samuel_Tow is the only poster that makes me want to punch him in the head more often when I'm agreeing with him than when I'm disagreeing with him.

 

Posted

Quote:
Originally Posted by Lemur Lad View Post
Like we're trying to tell you. More people is not better. It's about having people that can observe, report, and follow instructions.

As for people not inside being more motivated than the people who are? That's a really low blow. I've been there, several times. Most of the people who make it take it seriously and get a lot done. From what little I remember of your posting history, I don't think you'd do better.

I don't doubt for a second that some awesome testers get left out. I don't for a second think the solution is letting everyone in and hoping the good ones can make themselves heard over the roar.
Oh wow. a PERSONAL insult? For shame.


 

Posted

Quote:
Originally Posted by Red Valkyrja View Post
Why don't they just have another Open Closed Beta, that worked out so well last time.


/endsarcasm
If anything, it was the devs' fault. I don't know when that was.


 

Posted

Quote:
Originally Posted by The_Coming_Storm View Post
Oh wow. a PERSONAL insult? For shame.
It wasn't intended as an insult. If you took it as such, that's just your own issue.

It's a valid comparison from what I remember of reading your posts, and compared to the people I know and remember from past Closed Betas. I didn't say you'd do worse, I said you wouldn't do better. There's a difference.

Besides, if you're going to dish it out by implying you somehow know you'd be better than the people who made it, then you should be able to hack being told you probably wouldn't.


"Null is as much an argument "for removing the cottage rule" as the moon being round is for buying tennis shoes." -Memphis Bill

 

Posted

Quote:
Originally Posted by Lemur Lad View Post
It wasn't intended as an insult. If you took it as such, that's just your own issue.

It's a valid comparison from what I remember of reading your posts, and compared to the people I know and remember from past Closed Betas. I didn't say you'd do worse, I said you wouldn't do better. There's a difference.

Besides, if you're going to dish it out by implying you somehow know you'd be better than the people who made it, then you should be able to hack being told you probably wouldn't.
o.o then I'd refer you to my plethora of ORIGINAL bug reports in i16 open beta. Not once did I repost an already reported bug (Was on early so mine were all unreported... then people kept flooding the bug report thread with the same thing I found and it was a mess u.u). I also helped verify something for someone. Also, find ways to break things... A year ago or so I figured out how to kill RWZ dummies and citizens and have notified Castle of the methods. Castle then stealth nerfed the way to kill RWZ dummies with the MM pet attack speed recharge change. I am, to my knowledge, the first to realize that Maneuvers is bugged on teammates/pets in PvP zones as it misses several of the defense values on targets not yourself. Two years ago, I found a little bug that made PBAoEs hit less targets than they should. Found that when I noticed a Cone of the same radius hit more targets when the mobs were perfectly aligned and immoble. The missed mobs were at the very edge of the PBAoE.

O.o


 

Posted

Quote:
Originally Posted by The_Coming_Storm View Post
If anything, it was the devs' fault. I don't know when that was.
Having the very limited, slowly growing pool of closed beta testers works out MUCH better than the "Everyone in the pool!" open betas. People mention a bug, then the (say) 100 other people in there take a look and test it, quickly. There's usually MUCH more focused discussion. That small core then becomes a resource when the next (say) 250 people come in (I am, of course, making up the numbers, I have no idea how many people in each 'wave') they can answer questions and help direct testing. (The direction not being intentional, but someone coming in, say, wave 3 and seeing "Oh, looks like they fixed this, anyone else still having Mastermind henchmen prefer walking on the ceiling?" is probably going to test that early.) It's also easier, with that smaller pool, for Devs to ask for specific feedback - it's like turning a rudder on a small motorboat instead of on an oil tanker, they'll get a faster reaction.

Plus, as far as focus, if the devs have a specific requirement they're looking for - say, more direct PVP changes - they can tailor their "invitation list" as needed to get more PVPers in early. If they want to test, say, a wide variety of people with ATI cards, they can browse the forums and see who asks about ATI issues and who posts about them, and invite them specifically. They can't do that with an open beta since it, by definition, is open to everyone - and then they have to weed out specific responses from the "This is cool!" "This sux!" "Oh, I just got a puppy this week!" posts.

When there's just a small issue without many major changes, the "All in" is probably (by comparison) fine. With something like what we know is coming with I17 (and with whatever we don't know about it,) the closed -> growing pool -> open model works better, IMHO.

Edit:
And

Quote:
Not once did I repost an already reported bug
Just have to point out that you can't know that. Can't go by forum posts - the times I've been in beta, open or closed, as well as on live most of my bug reporting is in-game via /bug, not forum posts, and you as a player won't see those.


 

Posted

Quote:
Originally Posted by The_Coming_Storm View Post
o.o then I'd refer you to my plethora of ORIGINAL bug reports in i16 open beta. Not once did I repost an already reported bug (Was on early so mine were all unreported... then people kept flooding the bug report thread with the same thing I found and it was a mess u.u). I also helped verify something for someone. Also, find ways to break things... A year ago or so I figured out how to kill RWZ dummies and citizens and have notified Castle of the methods. Castle then stealth nerfed the way to kill RWZ dummies with the MM pet attack speed recharge change. I am, to my knowledge, the first to realize that Maneuvers is bugged on teammates/pets in PvP zones as it misses several of the defense values on targets not yourself. Two years ago, I found a little bug that made PBAoEs hit less targets than they should. Found that when I noticed a Cone of the same radius hit more targets when the mobs were perfectly aligned and immoble. The missed mobs were at the very edge of the PBAoE.

O.o
Thanks for telling me how awesome you are. Doesn't change my point in the least, but I'm sure your mom must be proud.

My point stands. It doesn't matter how good you are there are people who are just as good or better or worse in there right now, finding stuff just like you would. The system works. When I get in to be part of it, I help. When I don't get in, I trust the people who did to do just as well without me.

The process has been demonstrated time and again to work this way. It's also been demonstrated not to work well when done in the way you suggest above. Can't argue with facts.


"Null is as much an argument "for removing the cottage rule" as the moon being round is for buying tennis shoes." -Memphis Bill

 

Posted

Quote:
Originally Posted by Lemur Lad View Post
Thanks for telling me how awesome you are. Doesn't change my point in the least, but I'm sure your mom must be proud.

My point stands. It doesn't matter how good you are there are people who are just as good or better or worse in there right now, finding stuff just like you would. The system works. When I get in to be part of it, I help. When I don't get in, I trust the people who did to do just as well without me.

The process has been demonstrated time and again to work this way. It's also been demonstrated not to work well when done in the way you suggest above. Can't argue with facts.
i15 turned out the way it did because there was some Green developer given too much free reign without oversight from his superiors. Not the fault of the testers.


 

Posted

Quote:
Originally Posted by Memphis_Bill View Post
Having the very limited, slowly growing pool of closed beta testers works out MUCH better than the "Everyone in the pool!" open betas. People mention a bug, then the (say) 100 other people in there take a look and test it, quickly. There's usually MUCH more focused discussion. That small core then becomes a resource when the next (say) 250 people come in (I am, of course, making up the numbers, I have no idea how many people in each 'wave') they can answer questions and help direct testing. (The direction not being intentional, but someone coming in, say, wave 3 and seeing "Oh, looks like they fixed this, anyone else still having Mastermind henchmen prefer walking on the ceiling?" is probably going to test that early.) It's also easier, with that smaller pool, for Devs to ask for specific feedback - it's like turning a rudder on a small motorboat instead of on an oil tanker, they'll get a faster reaction.

Plus, as far as focus, if the devs have a specific requirement they're looking for - say, more direct PVP changes - they can tailor their "invitation list" as needed to get more PVPers in early. If they want to test, say, a wide variety of people with ATI cards, they can browse the forums and see who asks about ATI issues and who posts about them, and invite them specifically. They can't do that with an open beta since it, by definition, is open to everyone - and then they have to weed out specific responses from the "This is cool!" "This sux!" "Oh, I just got a puppy this week!" posts.

When there's just a small issue without many major changes, the "All in" is probably (by comparison) fine. With something like what we know is coming with I17 (and with whatever we don't know about it,) the closed -> growing pool -> open model works better, IMHO.

Edit:
And

Just have to point out that you can't know that. Can't go by forum posts - the times I've been in beta, open or closed, as well as on live most of my bug reporting is in-game via /bug, not forum posts, and you as a player won't see those.
1. How can the greater number of people not test things the way you said in the first post?

2. Polls on forums can be a quick way to ask for feedback

3. i16 Open Beta specifically said to /bug in game AND post it on the forums. I followed both instructions


 

Posted

I'm shocked to learn that this suggestion of a wholesale change to the process is motivated by the OP's own desire to get into closed beta.

Shocked.