U.S. Scale Masters

USSMA General Discussions => Flightline Chatter => Topic started by: rcphotog on Tue, 09/11/12, 04:41 PM

Title: Scoring Normalization - questions and answers - to better understand it.
Post by: rcphotog on Tue, 09/11/12, 04:41 PM
Something new may sometimes be a little scary or at the least - intimidating.

Keeping an open mind about change and concern for the future of the Association, lets talk about this.

I think many of us ( who don't compete in IMAC or Pattern ) will have questions and concerns and possibly some difficulties understanding - Scoring Normalization.

I think I see some advantages for this regarding - flight scoring - However, I'm still trying to wrap my little brain around - Static scoring normalization. ???
It seems to me that now we are not receiving a score that reflects the model's individual scale accuracy but rather ( how the model COMPARES to the other models in a particular class ). Please help me understand normalization for STATIC JUDGING.

Regards,
Ken Young
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Skymaster on Wed, 09/12/12, 10:55 AM
Ken,

I was a former IMAC pilot, now converted to a full blown scale nut! Going through the Normalization of scores was a little scary when IMAC did it. Collectively we saw it as a good thing for the organization, and it has paid off for IMAC.

I understand your question why normalize the static score. First let me touch on flight scores. For those of us who compete regularly know that there is variability in judging, and that will NEVER go away. So long as they are consistent that's fine. When you have judges that give lower score, their score are almost always dropped. It's a fact, even when I've flown at Top Gun, I had a tendency to think, well this is my throw away flight. Normalizing flight scores creates the reality that the scores from the "tough judges" will be used in the final scoring.

In instance for static scoring, (as I understand it, I'm by no means a computer expert) all the scores need to be "normalized" in order for the program to work. We still do, and did get, our regular "raw" scores for both static and flying rounds." I do not know if there is the ability to post raw static score in the final standings.

Hope this helps.
John Boyko

Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mitchell Baker on Wed, 09/12/12, 11:26 AM
For the right price... I can post anything... :)  Working on a section which will have both raw and normalized scores so people can see it all...  Taking a little bit since the current version of the normalized scoring sheets does not have any good reporting features in it...  Everything is manual...  But will get posted as I get time.

See-ya
Mitch
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: rcphotog on Wed, 09/12/12, 04:21 PM
Some food for thought ???

I just compared the two scoring method totals and found something interesting.

   Using the "old way" ( raw scores ) .... BOB PATTON is the Grand Champion.
   Using the "new way" ( normalization ) ....SCOTT HARRIS is the Grand Champion.

According to ( normalization ) Scott's placements are as follows: (rd1) 7th, (rd2) 6th, (rd3) 6th, (rd4) 3rd, (rd5) 2nd *best round*
"                "        "                   Bob's   placements are as follows: (rd1) 3rd, (rd2) 7th, (rd3) 1st, (rd4) 4th, (rd5) 1st... *two 1st place*
Static scores (raw-old way):
Scott's - 99.5   Bob's - 98.25 only a 1 and a 1/4 point difference
Flight scores (raw-old way):
Scott's - 93.333 avg.  Bob's - 95.000 avg.
Scott's total - (raw-old way) 192.833
Bob's total - (raw-old way)  193.250 *Winner* using the "old way"

Something to think about.

Ken.
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: wrench4alivin on Wed, 09/12/12, 08:59 PM
Yes, seeing it that way Ken what do competitors like Dave Johnson, Mike Barbee think on the new scoring?

Jim
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: bwboland on Wed, 09/12/12, 10:25 PM
Hello All,

Mike Barbee, Dave Johnson voted for normalization for the records. The vote was put to all of the pilots at the pilots meeting after a detail description on the process and impact. All but one pilot voted for normalization. The buzz at the event on the new scoring was incredibly positive!

Bernie
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: j_whitney on Thu, 09/13/12, 12:06 AM
Ken, the normalization is only for placement.  As John mentioned, the raw scores are still retained, you are being judged individually, then your scores are "normalized" - the best static score is still the best static score, it only makes it easier for placement.

Something new may sometimes be a little scary or at the least - intimidating.

Keeping an open mind about change and concern for the future of the Association, lets talk about this.

I think many of us ( who don't compete in IMAC or Pattern ) will have questions and concerns and possibly some difficulties understanding - Scoring Normalization.

I think I see some advantages for this regarding - flight scoring - However, I'm still trying to wrap my little brain around - Static scoring normalization. ???
It seems to me that now we are not receiving a score that reflects the model's individual scale accuracy but rather ( how the model COMPARES to the other models in a particular class ). Please help me understand normalization for STATIC JUDGING.

Regards,
Ken Young
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Skymaster on Thu, 09/13/12, 12:56 PM
Hey!
I see a possible point of contention/ place for the membership to have an issue with normalization. Yes it DID change the outcome of who won, and some may feel that's not fair.

Bob Patton is the contestent to have the most to gain and loose by going to normalization of scores. So, I had a direct conversation with him this morning about how he feels about the outcome, and asked if I can post it here, and he agreed.

He has alway been in favor of normalizing flight scores, and has been for years. He also understands that someone may get "burned" (for lack of a better word) when the change is made. The irony is that it's him that got the short deal. His feels that at the end of the day, this is going to be better for the organization as a whole and we need to keep it. Bob has been flying scale for years and is one of the few guys that still designs and flys new airplanes. If ANYONE should have a gripe its him, AND HE DOSEN'T!

He did bring up an interesting point. Why normalize the static score. He did the math, and that did change the standings. In reality, we did it because of the program, but is doesnt need to be done, since we all get judged by the same judges in each class,. The whole reason to normalize in the first place. As we upgrade the program to go "live, hopefully our "tech" guys can look into keeping the raw scores for static.

My dollars worth
John Boyko
East Coast Area Director
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: bwboland on Thu, 09/13/12, 02:24 PM
Hello all,

The only reason static was normalized was to keep it as an even score to the normalized flight scores.

Cheers,

Bernie
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Skymaster on Thu, 09/13/12, 02:29 PM
Bernie,

I figured that's why. Anyway to keep the static score a raw score, and keep the computer program happy.

John
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mike Barbee on Thu, 09/13/12, 05:49 PM
Hi everyone
Just read the form well parts on normalization and someone asked what I think. Now after reviewing the out come and why I think I may have voted too quickly. We were kind of under the gun it would seam to get it done but after my 4 hour drive home and a chance to think about it for the past 3 days I am not so sure. Reason number one, I have been a proponent to get the rules closer to all the scale org. NASA ,TG,SM but this isn't going to help. With the two year rule cycle of the AMA and as it's current president I don't see it being adapted to the AMA scale rule book. I have already been emailed by NASA members with their concerns against the change. I had a brief talk with Frank T and he also did not see a change in his rules yet. So now just another obstacle or difference in our rules. Second reason I would have liked to see Bob win. Don't get this wrong Scott did a great job flying and in static but if we did not change the rule he would not have won. Bob has been a long time supporter and competitor I feel bad for his efforts. I still hope we can get the big three scale bodies closer together with their rules.
Mike 
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: wrench4alivin on Thu, 09/13/12, 11:20 PM
Thanks Mike on your input was wondering why it was ask at the Finals and the pilots sorta put in a position without being notified beforehand on this type scoring change.

Jim
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Skymaster on Mon, 09/17/12, 12:13 PM
As the dust has settled from the Masters finals, I've been able to get out and fly with some of the local club guys. I've also spoke to some of the desinger guys from the northeast, as well as emailed Frank Tiano about "normalization" of flight scores. At the local level and with the past Masters desinger competitors, they do not understand normalization, and don't really care about going to it. In fact, I was told "Why are we making more rule and scoring changes that ADD to the confusion/differences between the 3 different rule bodies."

As I recall in the board meeting, we are suppose to be bringing the 3 organizations closer together, not further apart.



Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mitchell Baker on Mon, 09/17/12, 12:38 PM
Some good info here...

First, I'm not against normalizing the scores.. I understand it and have seen it working within IMAC.

Second, I agree we need to move the three rule bodies closer together.  There was an attempt at this a few years ago when USSMA introduced the Advanced class.  We were a little ahead of AMA in our classification but somewhere along the way AMA choose to use the term "Open" and not Advanced.  Go figure...  I have worded hard to educate the CD's on which AMA events equate to USSMA classes.  I feel we should work harder to move closer to AMA classification and not Top Gun.  Top Gun is one event a year, AMA scale contests are more frequent. Top Gun is not an even for the novice, AMA is.  Makes more since to me to align closer to AMA/NASA as there is where the grown potential comes from.

See-ya
Mitch
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: josieaune on Mon, 09/17/12, 06:10 PM
Okay for what my two cents are worth - I am with Mike Barbee.  I think the clean, clear, raw scores are the way to go with this HIGH END, Best of  the Best Competition.  It also standardizes with the AMA and Top Gun scoring.  I might be great for IMAC competition but feel this USSM is not the correct venue for this scoring.
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: rcphotog on Mon, 09/17/12, 07:46 PM
It seems to me that some people want the Scale Masters to be just another Flying contest and not to give much attention to Craftsmanship skills, talent or individual expression - the build. :(

I always loved the original IDEA of the U.S. Scale Masters - "Best of the Best" at building and flying.
...and the idea that the Masters was a very unique and special Association of "Like Minded Individuals" who appreciate building skills as well as flying skills.

I think the future I see ( from what I read about the "Rebirth" and "new scoring methods ) is one that focuses more on simplicity ( all the same type of model planes ) and less about diversity.

I revell in the diverse models that I see each year at our local Qualifiers and "Dream" about - one day I want to build and fly something as special as that.
So far I'm not optimistic for "Preserving The Dream". :'(

Ken.
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: wrench4alivin on Mon, 09/17/12, 09:02 PM
 " As the dust has settled from the Masters finals, I've been able to get out and fly with some of the local club guys. I've also spoke to some of the desinger guys from the northeast, as well as emailed Frank Tiano about "normalization" of flight scores. At the local level and with the past Masters desinger competitors, they do not understand normalization, and don't really care about going to it. In fact, I was told "Why are we making more rule and scoring changes that ADD to the confusion/differences between the 3 different rule bodies."

As I recall in the board meeting, we are suppose to be bringing the 3 organizations closer together, not further apart.

Thanks Ken-Josie!   Not to harp on this but Why did it have to be sprung in at the Finals?  And does IMAC have Documentation for Static to equal 100 not to familiar with the IMAC rules?   OK done here - But if the Finals come closer east there might be an increase in turnout at the Masters. Top Gun proves that.

Jim
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mitchell Baker on Tue, 09/18/12, 08:26 AM
Why it was sprung at the finals is still a mystery to me.  As I understand it, from most of the BoD who attended a mid-year phone conference ( I was not able to attend) The NC brought up normalizing,  it was agreed to use it along side the traditional scoring, then report/compare the results. It was not until arriving at the champs and hearing the announcement by the NC that we were aware of that change.  I pushed for the pilots that at the very least there should be a vote to see if they wanted it or not.  And that it should not be a "majority rules" vote, but if any pilot objected, it should not be used.  At least there was a vote. 

It's no secret I strongly objected to "springing" this on the pilots at the last minute.

See-ya
Mitch
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mitchell Baker on Tue, 09/18/12, 08:38 AM
It seems to me that some people want the Scale Masters to be just another Flying contest and not to give much attention to Craftsmanship skills, talent or individual expression - the build. :(

I always loved the original IDEA of the U.S. Scale Masters - "Best of the Best" at building and flying.
...and the idea that the Masters was a very unique and special Association of "Like Minded Individuals" who appreciate building skills as well as flying skills.

I think the future I see ( from what I read about the "Rebirth" and "new scoring methods ) is one that focuses more on simplicity ( all the same type of model planes ) and less about diversity.

I revell in the diverse models that I see each year at our local Qualifiers and "Dream" about - one day I want to build and fly something as special as that.
So far I'm not optimistic for "Preserving The Dream". :'(

Ken.

Well put Ken,

I don't think dumbing down USSMA will help but blend it into nothing.  I don't agree with allowing novice pilots at the championship event.  There should be something to work for. 

The "rebirth" post by Larry has some good points, but some are already in place and we have not done a good job of expressing the rules and classes...

Fun Scale is what Larry is changing to Pro-am with Pro-am pro being a combination of Open/Advanced with a very dumbed down static scoring. 

We have always stressed "building" as part of USSMA and that is why Open is a 30 point static and based on more than just a picture.  My involvement with USSMA is what caused me to start a build project. 

Yes, Top Gun is a prestigious event, but it is not an event for novice pilots and it's only one event, AMA events are, that is where we are going to get the interested.  Qualifiers can be a combination USSMA and AMA rules... or all USSMA or all AMA.. Participation at the local level it the best way to keep USSMA alive.  As was mentioned, mentoring is the best way to get more participation.

See-ya
Mitch
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: wrench4alivin on Tue, 09/18/12, 10:08 PM
Thank You Mitch on your feedback on what some of the Officers thought of this change.

Jim     
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Skymaster on Wed, 09/19/12, 01:05 PM
Ok it's time to STOP chasing our tails on what it will take to bring back the Scale Masters.

As I read the forum posts I see a lot of good ideas. There is one thing lacking........... A CLEAR understanding of why guys who hae qualified for the finals dont show. I have personally heard some didnt like the East facing site, others didn't get notfied in time, some dont like the fact the Designer class is gone etc. There's also a TON of finger pointing going on.

NOW, the ONLY way to get a true pulse on how the membership feels is................ask? BEFORE there are any more "changes made" do a FROMAL survey of the membership. Specifically the 60-70 odd pilots who qualified and didn't show. Develop a survey form and MAIL it to them with return postage. Give them a deadline to respond, follow up with a phone call to ensure it gets done. THEN sit down as a board and see where we need to go. Until this is done, we're just waisting time posting about it rather than getting out there, and showing the local guys what scale modeling is about.

And for the record MITCH.......Top Gun is a prestigious event AND there are SEVERAL guys in the ProAM classes that have NEVER flown in competition before. AND as a competitor who has been there and done that, the Pro AM class planes are very well built and NONE look like ARF's.The odd thing thing is Frank is willing to give a new guy who has an awesome plane a chance to play on a stage that is well known world wide, and we seem to not want to do that.

John
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: bwboland on Wed, 09/19/12, 04:22 PM
Well now let's talk about the real problem. Having a judge spread from high 80's to high 90's devalue the lower judges.

Every set of judges have the same curve of the highest to the lowest flight in any class, the best flight always get the best scores. All normalization does is make the Santa Claus and Chainsaw judges equal. The scoring maneuver to maneuver stays the same. If that made the difference in Bob and Scott for a change it was fairer. The old method only works if you throw out the high and low flights and then it is still not a real view of how the pilot flew. Nothing more deflating than flying your best flight in front of the hard judges and get an 88.5 knowing if it was in front of the Santa Claus group it would have been a 96. What I can tell you, is the judges all understood the value before the contest and I feel they judged harder for all pilots. Look at the raw scores, the lowest I have ever seen at the champs. Food for thought! 

Bernie Boland
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: rcphotog on Wed, 09/19/12, 08:59 PM
The way I see it,

( Score Normalizing ) is "grading on a curve"

( raw-score-data ) is a more true representation of an....  individual pilot's skills on a particular occassion ( flight-round )

Issue: a judging spread ... the "Santa Claus" effect or  the "Chain Saw" effect

one possible solution: have someone fly a "calibration-flight" before the contest begins. Gather all judges   and have a contest pilot fly either his model or a simple trainer to fly an entire flight-routine of a sampling of maneuvers and each judge ( no talking between them ) write his scores. The C.D. then has a idea of who the "Santa Claus" judges will be and who the "Chain-Saw" ones will be. Maybe then a "pre-contest" judges breifing can be conducted to get all judges more inline.

Just my "food for thought" ;)

Ken.
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: bwboland on Wed, 09/19/12, 09:08 PM
KEn,

All great point's / ideas. More good ideas on how to improve the process.

Bernie
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: j_whitney on Wed, 09/19/12, 09:17 PM
I don't really think that the scoring method is really an issue - I have heard the same gripes for 20+ years.  It is what it is and no matter how you do it - someone will be unhappy.  Ken, there usually is a "calibration flight" - but judges are people and people are falible, you will always have Santas and Texas Chainsaws.

I once tried 4 static judges who were supposed to judge all 3 static categories - the plan was to throw out the high and low.  My mistake was allowing a judge who had an issue and gave everyone full marks - really screwed things up.

As has been said before - the best thing we EACH can do is to find someone who expresses some interest in scale and then get him involved.

John, I think your idea of a poll of the no-shows is an excellent idea.  We just have to figure out who will be in charge!

Jeff
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mitchell Baker on Thu, 09/20/12, 08:02 AM
On the polling idea. Two years ago, I did that.  I sent e-mail out to all qualified pilots who didn't attend.  What I got was fairly interesting.  I got about a 40% response, and of those 75% were finance related.. rest were scattered among lost plane and didn't have another to fly, could not take that much time off.  Very few were actually related to the short notice of two years ago.

I also got a good many replies to the e-mail invite saying thanks but can't attend..  Most were to close to labor day or just can't afford it... 

See-ya
Mitch
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Skymaster on Thu, 09/20/12, 11:58 AM
That's some good information Mitch. How many is a good number for this year?

If money is a significant issue for not attending, given the current economy, that may not be going away anytime soon. So to open up another line of thinking, would doing regional champinonships East/West.

Chow
John
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Cubcrafter on Thu, 09/20/12, 07:13 PM
Quote
If money is a significant issue for not attending, given the current economy, that may not be going away anytime soon. So to open up another line of thinking, would doing regional championships East/West.

John,

Just one of my proposals in the rebirth topic.

Larry
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: wrench4alivin on Thu, 09/20/12, 09:25 PM
  
Well I am not a member of USSMA but was a positive supporter/member for years when Earl Aune was taking over on Harris Lee`s commitment but did start seeing the drop in the east in the mid 2000`s and at my end personal things got in the way(college support) plus economy hurt as in the travel involvement was but looking to come back in. But this thread it should be on normalization scoring change not the Scale Master attendance issue But do Support 100% John and Larry`s comments.

Jim
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mitchell Baker on Fri, 09/21/12, 08:06 AM
Thanks Jim, was about to say the same thing.. Let's get back on the topic of Normalization, if you have another topic to discuss, please open another thread.    I'm going to start one.. keep an eye out..

--Mitch
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mike Barbee on Thu, 10/04/12, 07:40 PM
OK all you computer scoring smart guys. Tell my why the normalizing did not show the real winner? Yes I voted for this change but only because I flew IMAC and it was started and used. Did we apply it somewhat different? I don't think we can normalize the static. So work needs to be done on the program. May be we acted too quick on this, sorry Bob. I don't think the NASA org will addopt this. If we did it would take 3 years to implement because of the rule cycle. Maybe that's why we have that type of check on new rules. As far as TG don't know I will ask Frank when I see him.
Mike Barbee   
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: j_whitney on Thu, 10/04/12, 10:03 PM
I think you have to look at how I understand IMAC applies normalizing and how it was done at the Championships.

In IMAC I understand that all of one class flies a round in front of the same judges, then they all fly in front of another set of judges.  They are not split up over several judges for one round.

If we did that normalizing would work - but you would have lopsided flight lines - the line with the class that had the most entries would always finish last and it would just keep getting worse.

That is how IMAC does it around here anyway.

You can say that they all see the same judges, but they don't all in the same round - there is always a scrooge set of judges and a santa claus set.

I did not see any overwhelming reason to go to normalizing anyway.  The only complaints about the current scoring system that I have ever heard (discounting easy or tough judges) was that 50% of your score was based on static, and nowadys if you don't have about a 98 static you are pretty much out of the money.  But no suggestions on how to fix that.
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: rcphotog on Sat, 10/06/12, 03:54 AM
  The only complaints about the current scoring system that I have ever heard (discounting easy or tough judges) was that 50% of your score was based on static, and nowadys if you don't have about a 98 static you are pretty much out of the money.  But no suggestions on how to fix that.
[/quote]
"But no suggestions on how to fix that" ...

I hate to be the one to "poke the beast in the belly" ...but I think we need to be reminded of the "original idea" of the U.S. Scale Masters. It was to reccognize skills and talents in BUILDING as well as FLYING.

That's why our final score is weighted 50% for building and 50% for flying. If your not receiving static scores in the mid-to-high-nineties then you need to pay more attention to details as you construct the model of YOUR choice. Remember, WE get to select the type of plane that we're going to compete with. ( that's a good thing ) If you feel that the reason for a low static score might be "lack of documentation" available....then select another subject to model. Remember that the first step is to do your research first and find all the documentation first before you start to build.

I'm not a fan of "score-normalizing" for our contest. (see next post ) I'm having problems with this "reply box"
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: rcphotog on Sat, 10/06/12, 04:16 AM
The way I see it,
Score-Normalizing is like "grading on a curve". Anyone who attended public schools during the 1970s will remember when they implemented the dreaded - "Bell Curve" grading system. This was done so that kids would not get their feelings hurt. "everyone will be a winner" and no child is a loser.
If you are a fan of Major Leaque Baseball then you know why there will never be another Babe Ruth. The "bell-curve" is one reason why no one will ever bat 400 again. But I digrees.

When you "normalize" scores, you are using the scores from other contestants to find (for lackof a better term ) a "reference-point".A datum point from which you base "other" scores upon. In other words, your final score does not reflect your individual skills but rather how you compared to the other contestants at a particular event. In Scale Masters, we only compete against ourselves and NOT against others.So your "normalized" value has no meaning outside of a particular contest. Just remember that as you fly YOUR model in front of judges, that your score is refective of how well you flew each maneuver as described during your judges-brief before you took off. That's why it's imparitive that you brief each set of judges as to how YOU will fly YOUR model.

Ken.
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: wrench4alivin on Sat, 10/06/12, 08:34 AM

 ...but I think we need to be reminded of the "original idea" of the U.S. Scale Masters. It was to recognize skills and talents in BUILDING as well as FLYING
.
 Did not Harris Lee want this?   I have to Agree.

" In Scale Masters, we only compete against ourselves and NOT against others.So your "normalized" value has no meaning outside of a particular contest. Just remember that as you fly YOUR model in front of judges, that your score is refective of how well you flew each maneuver as described during your judges-brief before you took off. That's why it's imparitive that you brief each set of judges as to how YOU will fly YOUR model. "

  :)  Yes

Jim

Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mitchell Baker on Sun, 10/07/12, 10:11 AM

I hate to be the one to "poke the beast in the belly" ...but I think we need to be reminded of the "original idea" of the U.S. Scale Masters. It was to reccognize skills and talents in BUILDING as well as FLYING.

That's what I have been saying...    it's suppose to be more difficult than AMA or Top Gun.. Quality not quantity... 

See-ya
Mitch
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Mitchell Baker on Wed, 10/10/12, 04:04 PM
OK all you computer scoring smart guys. Tell my why the normalizing did not show the real winner? Yes I voted for this change but only because I flew IMAC and it was started and used. Did we apply it somewhat different? I don't think we can normalize the static. So work needs to be done on the program. May be we acted too quick on this, sorry Bob. I don't think the NASA org will addopt this. If we did it would take 3 years to implement because of the rule cycle. Maybe that's why we have that type of check on new rules. As far as TG don't know I will ask Frank when I see him.
Mike Barbee   

Good questions Mike.  After you brought this up, I started wondering the same thing.  If normalization is just "creating" a curve for the highs and lows in judging, then normalizing should not change the final outcome.  So I started looking close at the numbers and different combination of the numbers. 

I agree, static should not be normalized, there is no high judge/low judge so there should not be a need for it.  And it was just that which caused the shift in place. 

Now I don't want to take anything away from the winner of the champs...  He had a great plane and did a great job of flying. And under the scoring change described after round 2 and voted on by the pilots, the winner is the winner.

That being said, on to analysis of the scoring.  It would seem that the normalizing of static is what caused the shift in the score.  If we had added raw static score to the top 3 avg'ed normalized flight, the outcome would have been different.  If we had just totaled all 5 normalized flight scores and added either of the type static scores, the outcome would have been different, if we had just totaled the top 3 normalized flight scores and added either type of static score, the outcome would have been different.

So the conclusion I have is that the implementation that was given to use, was flawed and not properly tested before being introduced at the championships.  In fact, after some investigation, it was not used in any other event prior to the championships.

--Mitch
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: wrench4alivin on Wed, 10/10/12, 08:54 PM
I do not wish to sound like a broken record here BUT Mitch does in my view have a Very Good understandable post there for a positive reason why normalizing static points should not be used. Thanks

Jim
Title: Re: Scoring Normalization - questions and answers - to better understand it.
Post by: Skymaster on Mon, 10/22/12, 09:11 AM
Hey Mitch,

You are absolutely correct. What I think happens when you use the raw static score and normalized flight scores, the outcome changes because the static score becomes a smaller percentage of the total score. The raw score is based on 100 total, the flight scores is 1000.
Even if you normalize to 100, and use the raw static score, there is an increase in the overall flight scores, the outcome is different, and that part I understand why that happens.