SOCR EduMaterials Activities PowerTransformFamily Graphs

From SOCR
Revision as of 22:13, 16 August 2007 by Zj0Ufx (talk | contribs)
Jump to: navigation, search

natchez (nazione) web cam on the word foto jennifer lopez asus p4p800-se programma fax nokia smartphone umts videofrog km 0 corolla el mundo de rastafari punto dynamic il secolo d oro della maiolica ceramica nec dvd rw nd 3540a maria de filippi it lezioni di anatomia polistirolo prato heat street mobili giapponesi accessori tomtom go 300 putney swope mimosa fiore bmw 530 touring lightn the sister erbe lcd sm193p v data 512 annuncio casa vacanza gratuiti venditore tecnico - brindisi (regione puglia - brindisi provincia) giochi totalmente gratuiti clip raggae gateshead scheda video ati 9550 sapphire philips tv 32pw9309 insonnia tenda esterno dv rs mmc 512 un milione di iscritti a xbox live brad pitt butt volume trucchi soluzione giochi pc biglietti europei 2004 new car prices si banderas arredamento d interni picture hongnhung acer cr6530 ati x850xt gossip vari swv testo canzone 2 black waves of luv hbh600 bluetooth sony ericsson fleurs 3 hard disk ps2 amilo pro v7010 fujitsu-siemens conserviera industria - macchine e attrezzature consulenza internet marketing sampei. vol. 05 caricatore cd clarion prezzo motorino frasi della amicizia deh 4700 pioneer a-307r nudo maschio www salernocity com buzz bela fugga simone toscana curriculm vitae lowrider arte s1 is sea it cominicacion annunci rover mini cabriolet xink infami e in rete il primo trailer di metal gear acid ddr pc2700 a 333mhz nuova audi a3 benzina auto nuove enricke km0 fiat panda diesel auto km 0 regolamento gioco bridge n-gage accessori videocamere sony mini dv gruppo amici google nel web accessori fotocamere digitali hp sfondi x pc gratis sota industries jedi festa spettacolo festa nokia 9500 i iz israel kamakawiwo thalia la vida en rosa macchu picchu wave to luv tiziana lodato pampita modelo www las chuches com di castro flinstones nudi www la talpa it babyliss 8310 kyocera mita placebo for you babies so-dimm memoria ram nec lcd 15 52vm trova lavoro offerte foto di carmen di pietro falstaff universita ancona politecnico sesso brasiliano symphony mp3 con hard disk condizionatori fissi 9000 btu kan kun calendari feticisti formula one 2002 kamikaze a colori espositori porte dragon naturallyspeaking preferred 7 legge 392 1978 testo fk it eventi firenze liftiba anche la notte del corvo in italiano fotocamera sony dsc p100 office 2003 master sound reference 845 network attached logitech quickcam communicate lexmark toner x215 pittura a calce foto lcd al1715 nexave ax spinning leva concorso guardia finanza dip it low remix test per il patentino cuffie con microfono usb a7v600 x frameless il piu grande motore del mondo canon custodia lancaster la perla nera toxoplasma igm libertango ensemble jvc kd - avx1 rosmarino ditta light tech yara ingrossi cartoleria giocattoli playstation 2 e blu-ray insieme ikonomi kakogawa pedro canoero tv plasma 50 e 400 cdi the sims 2 all capsule mirtillo lacie 400 brother t-104 epson c900 mne s toboj foto tortuga quiero saber de ti legge n 388 del 2000 i belong to myself immagini di romeo e giulietta sex bestial nokia con radio fm alfa romeo 146 gena lee nolin hard video tutto wind bracciali anello bongi bongi bon oroscopo anno lindsey lohan la ultima cena plextor dvd masterizzatore esterno volvo varese sony dsc p200 black internet spazio web king of convience la rosa di washington fever for the flava hot action cop software decoder encoder gin rummy pioneer vsx-ax5ai-s luana piovanni www theclub it mp3 u2 aldrovandi, ulisse termometro oregon volkswagen diesel km0 kenwood mestre elisa dancing testo osg panasonic cellulare vs3 == SOCR Educational Materials - Activities - SOCR Power Transformation Family Graphing Activity ==

Summary

This is activity demonstrates the usage, effects and properties of the modified power transformation family applied to real or simulated data to reduce variation and enhance Normality. There are 4 exercises each demonstrating the properties of the power transform in different settings for observed or simulated data: X-Y scatter plot, QQ-Normal plot, Histogram plot and Time/Index plot.

Background

The power transformation family is often used for transforming data for the purpose of making it more Normal-like. The power transformation is continuously varying with respect to the power parameter \(\lambda\) and defined, as continuous piece-wise function, for all \(y>0\) by

\(y^{(\lambda)} = \left \{ {(y^{\lambda}-1)} / {\lambda}, if \lambda \neq 0; and \log{y}, if \lambda = 0 \right\} \)

Exercises

Exercise 1: Power Transformation Family in a X-Y scatter Plot Setting

  • This exercise demonstrates the characteristics of the power-transform when applied independently to the two processes in an X-Y scatter plot setting. In this situation, one observed paired (X,Y) observations which are typically plotted X vs. Y in the 2D plane. We are interested in studying the effects of independently applying the power transforms to the X and Y processes. How and why would the corresponding scatter plot change as we vary the power parameters for X and Y?
  • First, point your browser to SOCR Charts and select the PowerTransformXYStatterChart (Line-Charts -> PowerTransformXYStatterChart). Then either use the default data provided for this chart, enter your own data (remember to MAP the data before your UPDATE the chart) or obtain SOCR simulated data from the Data-Generation tab of the SOCR Modeler (an example is shown later in Exercise 4). As shown on the image below, try changing the power parameters for the X and Y power-transforms and observe the graphical behavior of the transformed scatter-plot (blue points connected by a thin line) versus the native (original) data (red color points). We have applied a linear rescaling to the power-transform data to map it in the same space as the original data. This is done purely for visualization purposes, as without this rescaling it will be difficult to see the correspondence of the transformed and original data. Also note the changes of the numerical summaries for the transformed data (bottom text area) as you update the power parameters. What power parameters would you suggest that make the X-Y relation most linear?
SOCR Activities PowerTransformGraphing Dinov 022007 Fig7.jpg


Exercise 2: Power Transformation Family in a QQ-Normal Plot Setting

  • The second exercise demonstrates the effects of the power-transform applied to data in a QQ-Normal plot setting. We are interested in studying the effects of power transforming the native (original) data on the quantiles, relative the Normal quantiles (i.e., QQ-Normal plot effects). How and why do you expect the QQ-Normal plot to change as we vary the power parameter?
  • Again go to SOCR Charts and select the PowerTransformQQNormalPlotChart (Line-Charts -> PowerTransformQQNormalPlotChart). You can use different data for this experiment - either use the default data provided with the QQ-Normal chart, enter your own data (remember to MAP the data before your UPDATE the chart) or obtain SOCR simulated data from the Data-Generation tab of the SOCR Modeler (an example is shown later in Exercise 4). Change the power-transform parameter (using the slider or the by typing int he text area) and observe the graphical behavior of the transformed data in the QQ-Normal plot (green points connected by a thin line) versus the plot of the native data (red color points). What power parameter would you suggest that make the (transformed) data quantiles similar to those of the Normal distribution? Why?
SOCR Activities PowerTransformGraphing Dinov 022007 Fig8.jpg

Exercise 3: Power Transformation Family in a Histogram Plot Setting

  • This exercise demonstrates the effects on the histogram distribution after applying the power-transform to the (observed or simulated) data. In this experiment, we want to see whether we can reduce the variance of a dataset and make its histogram more symmetric, unimodal and bell-shaped.
  • Again go to SOCR Charts and select the PowerTransformHistogramChart (Bar-Charts -> XYPlot -> PowerTransformHistogramChart). We will use SOCR simulated data from the Data-Generation tab of the SOCR Modeler, however you may chose to use the default data for this chart or enter your own data. The image below shows you the Generalized Beta Distribution using SOCR Distributions.
SOCR Activities PowerTransformGraphing Dinov 022007 Fig9.jpg
  • Go to the SOCR Modeler and select 200 observations from the Generalized Beta Distribution (\(\alpha = 1.5; \beta = 3; A=0; B=7\)), as shown on the image below. Copy these 200 values in your mouse buffer (CNT-C) and paste them in the Data tab of the PowerTransformHistogramChart. Then map this column to XYValue (under the MAP tab) and click Update_Chart. This will generate the histogram of the 200 observations. Indeed, this graph should look like a discrete analoge of the Generalized Beta density curve above.
SOCR Activities PowerTransformGraphing Dinov 022007 Fig10.jpg
  • In the Graph tab of the PowerTransformHistogramChart, change the power-transform parameter (using the slider on the top). All SOCR Histogram charts allow you to choose the width of the histogram bins, using the second slider on the top. Observe the graphical behavior of the histogram of the transformed data (blue bins) and compare it to the histogram of the native data (red bins). What power parameter would you suggest that make the histogram of the power-transformed data better? Why?
SOCR Activities PowerTransformGraphing Dinov 022007 Fig11.jpg

Exercise 4: Power Transformation Family in a Time/Index Plot Setting

  • Let’s first get some data: Go to SOCR Modeler and generate 100 Cauchy Distributed variables. Copy these data in your mouse buffer (CNT-C). Of course, you may use your own data throughout. We choose Cauchy data to demonstrate how the Power Transform Family allows us to normalize data that is far from being Normal-like.
SOCR Activities PowerTransformGraphing Dinov 022007 Fig1.jpg
  • Next, paste (CNT-V) these 100 observations in SOCR Charts (Line-Charts -> Power Transform Chart). Click Update Chart to see the index plot of this data in RED!
SOCR Activities PowerTransformGraphing Dinov 022007 Fig2.jpg
  • Now go to the Graph Tab-Pane and choose \(\lambda = 0\) (the power parameter). Why is \(\lambda = 0\) the best choice for this data? Try experimenting with different values of \(\lambda\). Observe the variability in the Graph of the transformed data in Blue (relative to the variability of the native data in Red).
SOCR Activities PowerTransformGraphing Dinov 022007 Fig3.jpg
  • Then go back to the Data Tab-Pane and copy in your mouse buffer the transformed data. We will compare how well does Normal distribution fit the histograms of the raw data ( Cauchy distribution) and the transformed data. One can experiment with other powers of \(\lambda\), as well! In the case of \(\lambda =0\), the power transform reduces to a log transform, which is generally a good way to make the histogram of a data set well approximated by a Normal Distribution. In our case, the histogram of the original data is close to Cauchy distribution, which is heavy tailed and far from Normal (Recall that the T(df) distribution provides a 1-parameter homotopy between Cauchy and Normal).
SOCR Activities PowerTransformGraphing Dinov 022007 Fig4.jpg
  • Now copy in your mouse buffer the transformed data and paste it in the SOCR Modeler. Check the Estimate Parameters check-box on the top-left. This will allow you to fit a Normal curve to the histogram of the (log) Power Family Transformed Data. You see that Normal Distribution is a great fit to the histogram of the transformed Data. Be sure to check the parameters of the Normal Distribution (these are estimated using least squares and reported in the Results Tab-Pane). In this case, these parameters are: Mean = 0.177, Variance = 1.77, however, these will vary, in general.
SOCR Activities PowerTransformGraphing Dinov 022007 Fig5.jpg
  • Let’s try to fit a Normal model to the histogram of the native data (recall that this histogram should be shaped as Cauchy, as we sampled from Cauchy distribution – therefore, we would not expect a Normal Distribution to be a good fit for these data. This fact, by itself, demonstrates the importance of the Power Transformation Family. Basically we were able to Normalize a significantly Non-Normal data set. Go back to the original SOCR Modeler, where you sampled the 100 Cauchy observations. Select NormalFit_Modeler from the drop-down list of models in the top-left and click on the Graphs and Results Tab-Panes to see the graphical results of the histogram of the native (heavy-tailed) data and the parameters of its best Normal Fit. Clearly, as expected, we do not have a got match.
SOCR Activities PowerTransformGraphing Dinov 022007 Fig6.jpg
  • Questions
    • Try experimenting with other (real or simulated) data sets and different Power parameters (λ). What are the general effects of increasing/decreasing λ in any of these domains [-10;0], [0;1] and [1;10]?
    • For each of the exercises (X-Y scatter-plot, QQ-Normal plot, Histogram plot and Time/Index plot) empirically study the effects of the power transform as a tool for normalizing the data. You can take samples of size 100 from Student’s T-distribution (low df) and determine appropriate levels of λ for which the transformed data is (visually) well approximated by a Normal Distribution.

References




Translate this page:

(default)
Uk flag.gif

Deutsch
De flag.gif

Español
Es flag.gif

Français
Fr flag.gif

Italiano
It flag.gif

Português
Pt flag.gif

日本語
Jp flag.gif

България
Bg flag.gif

الامارات العربية المتحدة
Ae flag.gif

Suomi
Fi flag.gif

इस भाषा में
In flag.gif

Norge
No flag.png

한국어
Kr flag.gif

中文
Cn flag.gif

繁体中文
Cn flag.gif

Русский
Ru flag.gif

Nederlands
Nl flag.gif

Ελληνικά
Gr flag.gif

Hrvatska
Hr flag.gif

Česká republika
Cz flag.gif

Danmark
Dk flag.gif

Polska
Pl flag.png

România
Ro flag.png

Sverige
Se flag.gif