Archive for August, 2020
Magic of multifactor testing revealed by fun physics experiment: Part Two—the amazing results
Posted by mark in design of experiments, Uncategorized on August 31, 2020
The 2020 pandemic provided a perfect opportunity to spend time doing my favorite thing: Experimenting!
Read Part One of this three-part blog to learn what inspired me to investigate the impact of the following four factors on the bounciness of elastic spheroids:
A. Ball type: Hollow or Solid
B. Temperature: Room vs Freezer
C. Drop height: 3 vs 6 feet
D. Floor surface: Hardwood vs Rubber
Design-Expert® software (DX) provides the astonishing result: Neither the type of ball (factor A) nor the differing surfaces (factor D) produced significant main effects on first-bounce time (directly related to height per physics). I will now explain.
Let’s begin with the Pareto Chart of effects on bounce time (scaled to t-values).
First observe the main effects of A (ball type) and D (floor surface) falling far below the t-Value Limit: They are insignificant (p>>0.05). Weird!
Next, skipping by the main effect of factor B (temperature) for now (I will get back to that shortly), notice that C—the drop height—towers high above the more conservative Bonferroni Limit: The main effect of drop height is very significant. The orange shading indicates that increasing drop height creates a positive effect—it increases the bounce time. This makes perfect sense based on physics (and common knowledge).
Now look at a multi-view Model Graphs for all four main effects.
The plot at the lower left shows how the bounce time increased with height. The least-significant-difference ‘dumbbells’ at either end do not overlap. Therefore, the increase is significant (p<0.05). The slope quantifies the effect—very useful for engineering purposes.
However, as DX makes clear by its warnings, the other three main effects, A, B and D, must be approached with great caution because they interact with each other. The AB and BD interactions will tell the true story of the complex relationship of ball type (A), their temperature (B) and the floor material (D).
See by the interaction plot how the effect of ball type depends on the temperature. At room temperature (the top red line), going from the hollow to the solid ball produces a significant increase in bounce time. However, after being frozen, the balls behaved completely opposite—hollow beating solid (bottom green line). These opposing effects caused the main effect of ball type (factor A) to cancel!
Incredibly (I’ve never seen anything like this!), the same thing happened with the floor surface: The main effect of floor type got washed out by the opposite effects caused by changing temperature from room (ambient) to that in the freezer (below 0 degrees F).
Changing one factor at a time (OFAT) in this elastic spheroid experiment leads to a complete fail. Only by going to the multifactor testing approach of statistical DOE (design of experiments) can researchers reveal breakthrough interactions. Furthermore, by varying factors in parallel, DOE reveals effects far faster than OFAT.
If you still practice old-fashioned scientific methods, give DOE a try. You will surely come out far ahead of your OFAT competitors.
P.S. Details on elastic-spheroid experiments procedures will be laid out in Part 3 of this series.
Magic of multifactor testing revealed by fun physics experiment: Part One—the setup
Posted by mark in design of experiments, Education on August 23, 2020
The behavior of elastic spheres caught my attention due to a proposed, but not completed, experiment on ball bounciness turned in by a student from the South Dakota School of Mines and Technology.* I decided to see for myself what would happen.
To start, I went shopping for suitable elastic spheres. As pictured, I found two ball-toys with the same diameter—one of them with an eye-catching Spider-Man graphic.
My grandkids all thought that “Spidey” would bounce higher than the other ball—the one in swirly blue and yellow. Little did they know just by looking that “Swirley” was the one with superpowers, it being made from exceptionally elastic, solid synthetic rubber. Sadly, Spidey turned out to be a hollow airhead. This became immediately obvious when I dropped the two balls side by side from shoulder height. Spidey rebounded only to my knee while Swirley shot all the way back to nearly to the original drop level, which really amazed the children.
My next idea for the bouncy experiment came from Frugal Fun for Boys and Girls, a website that provides many great science projects. Their bouncy ball experiment focuses on the effect of temperature as seen here.
However, I could see one big problem straight away: How can you get an accurate measure of bounce height? That led me an amazing cell-phone app called Phyphox (Physics Phone Experiments) which provided an ingenious way to calculate how high a ball bounces by listening to them hit the floor.** Watch this short video to see how. (If you are a physicist, stay on for how the narrator of the demo, Sebastian Staacks, worked out all his calculations for the Phyphox (In)elastic tool.)
The third factor came easy: Height of drop. To make this obvious but manageable, I chose three versus six feet.
The fourth and final factor occurred to me while washing dishes. We recently purchased a thick rubber mat for easy cleanup and comfortable standing in front of our sink. I realized that this would provide a good contrast to our hardwood floors for bounce height, the softer surface being obviously inferior.
To recap, the four factors and their levels I tested were:
A. Ball type: Hollow or Solid
B. Temperature: Room vs Freezer
C. Drop height: 3 vs 6 feet
D. Floor surface: Hardwood vs Rubber
Using Design-Expert® software (DX) I then laid out a two-level, full factorial of 16 runs in random order. To be sure of temperature being stabilized, I did only one run per day, recording the time the first bounce and its height (calculated by the Phypox boffins as detailed in the videos).
When I completed the experiment and analyzed the results using DX, I was astounded to see that neither the type of ball nor the differing surfaces produced significant main effects. That made no sense based on my initial demonstrations on side-by-side bounce for the two balls on the floor versus the rubber mat.
Keeping in mind that my experiment provided a multifactor test of two other variables, perhaps you can guess what happened. I will give you a hint: Factors often interact to produce surprising results, such as time and temperature suddenly coming together to create a fire (or as I would say as a chemical engineer—an “exothermic reaction”).
Stay tuned for Part 2 of this blog on my elastic spheroid experiment to see how the factors interacted in delightful ways that, once laid out, make perfect sense to even for non-physicists.
*For background on my class and an impressive list of home experiments, see “DOE It Yourself” hits the spot for distance-learning projects.
**I credit Rhett Alain of Wired for alerting me to Phyphox via his 8/16/18 post on Three Science Experiments You Can Do With Your Phone. From there he provides a link to a prior, more detailed, post on Modeling a Bouncing Ball.
Butterfly effect debunked (but, even so, best you not step on them)
It’s peak butterfly season—a beautiful time of the year to watch for these wonderfully winged insects, such as the Tiger Swallowtail caught on camera this week by my son-in-law Ryan Bretzel.
Coincidentally, physicists from the Los Alamos National Laboratory just announced* that we need not worry about butterflies in Minnesota setting off hurricanes in Florida, as speculated by chaoticians (such as Dr. Ian Malcolm in the movie Jurassic Park).
“For those interested in the technical details, a number of entangled qubits were run through a set of logic gates before being returned to their initial setup.”
– Mike McRae, Science Alert, 7/31/20, Time Travel Simulation Shows Quantum ‘Butterfly Effect’ Doesn’t Exist
That’s one less thing to worry about for Floridians! They need all the help they can get, being at the peak of pandemic and hurricane season.
* Recovery of Damaged Information and the Out-of-Time-Ordered Correlators, Bin Yan and Nikolai A. Sinitsyn, Physical Review Letters, 125, 040605 – Published 24 July 2020.