Dear Experimenter, Here's another set of frequently asked questions (FAQs) about doing design of experiments (DOE), plus alerts to timely information and free software updates. If you missed the previous DOE FAQ Alert, please click on the links at the bottom of this page. If you have a question that needs answering, click the Search tab and enter the key words. This finds not only answers from previous Alerts, but also other documents posted to the Stat-Ease web site. Feel free to forward this newsletter to your colleagues. They can subscribe by going to http://www.statease.com/doealertreg.html. If this newsletter prompts you to ask your own questions about DOE, please address them via mail to:[email protected]. This plain text message may be easier to read if you do not remove the line breaks. If you use Microsoft Outlook, press the bar labeled "Extra line breaks in this message were removed." In newer versions select "Restore line breaks." Happy New Year! Take a second of your time to check out this appetizer aimed at getting this first 2006 Alert off to a good start: http://www.abc.net.au/news/newsitems/200601/s1540234.htm. For the technical details on why our clocks got off, see http://slashdot.org/articles/06/01/01/1434239.shtml?tid=126. Up until recently, I calibrated my watch against the US Naval Observatory time given by telephone at 202.762.1401, but lately I've slacked off by using the less-precise web time at http://www.time.gov/. The famous clock maker Benjamin Harrison must be spinning in his grave over these gyrations in time. After reading Dava Sobel's book "Longitude: The True Story of a Lone Genius Who Solved the Greatest Scientific Problem of His Time," I traveled to London and took a boat ride down the Thames to see the Harrison clocks at the Royal Observatory in Greenwich, England. I highly recommend the book and the museum for anyone with a temporal bent. To see the story made short (and a picture of the time piece on page 3), go to http://www.nmm.ac.uk/server/show/conWebDoc.355/. Here's what I cover in the body text of this DOE FAQ Alert (topics
that delve into statistical detail are designated "Expert"): PS. Quote for the month: "The Modern Design of Experiments in Three Laws" by Dick De Loach of NASA Langley Research Center. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 1. Free books (US/Canada only): Enter drawing for two Montgomery DOE texts plus autographed set of DOE/RSM "Simplified" series (Sorry, due to the high cost of shipping, this offer applies only to residents of the United States and Canada.) Simply reply to this e-mail before February 1st if you'd like a chance at one of two free copies of "Design and Analysis of Experiments" by Douglas Montgomery, 5th Edition (Wiley, 2000). These books, near mint condition, became surplus when Stat-Ease stocked up on Dr. Montgomery's newer 6th edition. A drawing will also be held for free autographed copies of "DOE Simplified: Practical Tools for Effective Experimentation" (http://www.statease.com/doe_simp.html) and "RSM Simplified: Optimizing Processes Using Response Surface Methods for Design of Experiments" (http://www.statease.com/rsm_simplified.html). These two books will be signed by the authors (myself and Stat-Ease consultant Patrick Whitcomb). In your e-mail, feel free to specify which of these three free book(s) you would like. (Reminder: If you reside outside the US or Canada, you are NOT eligible for the drawing because it costs too much to ship the books.) For a complete list of books offered for sale by Stat-Ease, go to its e-commerce site at http://www.statease.com/prodbook.html. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2. Expert-FAQ: New capabilities
for mixture design in just-released Design-Expert® version
7 software (see details and link to free trial at http://www.statease.com/dx7descr.html) a. Mixture in mixture ('Mix-Mix') capability Answer: Stat-Ease Consultant Pat Whitcomb suggests: *("Experiments with Mixtures: Designs, Models, and the Analysis of Mixture Data," 3rd Edition, Wiley, 2002, available at http://www.statease.com/prodbook.html.) b. Ability to invert simplexes or other mixture geometries Answer: It turns out that when you built your mixture design Design-Expert V7 software detected that an upper bounded pseudo coding provided a larger design space. Upper-bounded (U) coding means that instead of 0 being low and 1 being high, 0 is assigned to the high level and 1 is assigned to the low level. Therefore, what goes down on the trace plot actually goes up in reality, which is what you expected for the water component. Also on the triangular plots the vertices (tips) are the low and the opposing base the high for each component, in other words the opposite of what you normally see on mixture graphs. For what it's worth, when you perform numerical optimization it will provide the expected solution, that is, water increases the workability of concrete. (Learn more about inverting mixture design by attending the three-day computer-intensive workshop "Mixture Design for Optimal Formulations." See http://www.statease.com/clas_mix.html for a complete description. Link from this page to the course outline and schedule. Then, if you like, enroll online.) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 3. Reader response: Follow-up to "Struggle for Power vs. Resolution vs. Simplicity in an ASTM Standard" The article titled "Struggle for Power vs. Resolution vs. Simplicity in an ASTM Standard" in the December 2005 Stat-Teaser (posted at http://www.statease.com/news/news0512.pdf) tells how I helped upgrade the strategy of experimentation specified in the E1169 Standard for Ruggedness Testing. It prompted this response. -----Original Comment----- I retired a year ago and now do a bit of consulting. Helping people with planning experiments and analyzing data has always been something I enjoyed, especially experiments with mixtures (apologies to John Cornell). I look forward to acquiring the latest release to Design-Expert. You guys are the best in this field." PS. I am happy to report that my article catalyzed a reader, Arved Harding, to join the E1169 committee. I've been corresponding with Arved about DOE for at least a decade and visited with him and his colleagues at Eastman Chemical in Kingsport, Tennessee. He will not only be a great addition to the group for his statistical ability, but also for being such a good fellow to work with. Arved, who signs off on e-mail as "Your friendly, neighborhood statistician," will provide valuable perspective from the process industry. Way to go Arved! Mark ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 4. Events alert: Design for Six Sigma (DFSS) conference (Second Notice) Stat-Ease will attend and display our software at the Design for
Six Sigma conference, January 16-18, 2006, in Memphis, Tennessee.
Among the speakers are several (probably more that I missed or don't
know of) clients of Stat-Ease software and training resources: Click http://www.statease.com/events.html for a more complete list of planned appearances by Stat Ease professionals. We hope to see you sometime in the near future! ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 5. Workshop alert: See when and where to learn about DOE See http://www.statease.com/clas_pub.html for schedule and site information on all Stat-Ease workshops open to the public. To enroll, click the "register online" link on our web site or call Stat-Ease at 1-612-378-9449. If spots remain available, bring along several colleagues and take advantage of quantity discounts in tuition, or consider bringing in an expert from Stat-Ease to teach a private class at your site. Call us to get a quote. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ I hope you learned something from this issue. Address your general questions and comments to me at: [email protected]. PLEASE DO NOT SEND ME REQUESTS TO SUBSCRIBE OR UNSUBSCRIBE - FOLLOW THE INSTRUCTIONS AT THE END OF THIS MESSAGE. Sincerely, Mark Mark J. Anderson, PE, CQE PS. Quote for the month"The Modern Design of Experiments in Three Laws" by Dick De Loach of NASA Langley Research Center: Dick, a frequent correspondent with Stat-Ease, teaches Modern Design of Experiments (MDOE) for Langley's Wind Tunnel University (WTU). He preaches these three Laws for MDOE: 1. First Law (Key to Quality): "Random variations occur in experimental data about mean values that change systematically with time." You already know this, of course, as it is the basis for the randomization and temporal blocking imperative. But most of the experimental aeronautics community still blithely assumes that randomization and blocking are completely unnecessary (and that replication is not generally the most productive use of limited resources that might be better spent maximizing the number of unique independent variable combinations that are set.) So I describe this as a "law" of experimentation, and firmly believe it to be. 2. Second Law (Key to Productivity): "Each new data point adds value as a monotonically decreasing function of the volume of data already acquired." This flows from defining the "value" of an additional data point in terms of its potential for reducing inference error risk, which decreases monotonically with data volume. But as I often say to students in the short course I teach on experiment design, "a million and one points is always better than a million. But not much better." And since it takes just as much time and effort to acquire another point no matter how many we already have, costs keep going up with data volume even when benefits have for practical purposes flattened. The second law implies a point of diminishing returns for data volume, which suggests we can be more productive (do more experiments per year) if we simply know when we're done with any particular experiment. 3. Third Law (Heuristic): "The results of well-designed experiments are easy to explain but hard to forecast." I have no proof of this, except to say that it is a reliable outcome.
To combat this unfortunate stereotyping of DOE as a low-order tool more suitable for product and process improvement than for hairy-chested aerodynamics, we have used the term "MODERN Design of Experiments" to suggest an emphasis on extensions of conventional DOE that are relevant in aerospace research. The "M" in "MDOE" implies higher-order response functions, alternatives to polynomial forms, inference space truncation methods to generate piecewise continuous response surfaces comprised of multiple relatively simple models, an emphasis on "scaling" (a priori estimates of adequate data volume) and both quality assurance (via not only randomization of set-point order but temporal blocking) and quality assessment (routine estimates of precision intervals). MDOE also entails a focus on quantifying a contribution to the unexplained variance that is not as often relevant in conventional DOE; namely, that component attributable to the time-varying bias errors that are caused by such persisting effects as temperature gradients and instrumentation drift. DOE practitioners seek to eliminate this component from the unexplained variance in order to improve the precision of their hypothesis tests, but MDOE practitioners (who also want to isolate it for the same reason) have a further needto quantify it so as to more accurately reflect the true reproducibility of results acquired in real-world facilities such as wind tunnels. Such complex and highly energetic facilities cannot and do not maintain states of statistical control to within the parts per million of unexplained variance implied by our precision requirements. We must therefore quantify these subtle departures from statistical control when we report our results to avoid overstating our precision as we would do if we accounted only for the relatively small pure error in our uncertainty estimates. Again, this is a nuance that frequently distinguishes high-precision scientific experimentation (particularly in aerospace) from industrial product or process improvement applications. None of the features of designed experiments I have mentioned is strictly outside the scope of conventional DOE. However, the combined effect of these differences in emphasis for aerospace (vs industrial) engineering applications is significant enough that we try to explicitly recognize them through a modest extension of the name. The intent is to unambiguously recognize this art form as "DOE", but to also recognize the potential bias against DOE as "too simple" for our purposes, by signaling that MDOE features the focus required for our special extended needs. Perhaps more than you wanted to hear from a battered veteran of the "culture wars" waged to establish professional experiment design as the default approach to empirical aerospace research, but I thought you might find this background interesting. In any case, if you have no objection to calling it "The Modern Design of Experiments in Three Laws", I certainly have no objection to your passing these along. Thanks! PS. I have attached a slide from the introductory lesson of the short course I teach at aerospace conferences titled "Concepts in the Modern Design of Experiments". (I believe you know that I use Doug Montgomery's textbook for this course, bundled with the student version of Design-Expert software from John Wiley & Sons, and spend some time introducing the students to DX as part of the course.) Four Eras in the History of Designed Experiments (Credit: Douglas
Montgomery) Trademarks: Design-Ease, Design-Expert and Stat-Ease are registered trademarks of Stat-Ease, Inc. Acknowledgements to contributors: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Interested
in previous FAQ DOE Alert e-mail newsletters? Click here to add your name to the FAQ
DOE Alert newsletter list server.
|
|
Stat-Ease, Inc.
2021 E. Hennepin Avenue, Ste 480
Minneapolis, MN 55413-2726
e-mail: info@statease.com
p: 612.378.9449, f: 612.378.2152