Week 6 Blog – Regression

This week, we shifted our focus to regression and prediction, as well as T-tests. We started the lessons with a quick review of all the past procedures we should be familiar with by now, including proc means, proc sort, proc freq, proc rank, proc sgplot, proc fastclus, datastep, etc. We then moved on to proc T test – a test used to compare means of two separate groups e.g. are males taller than females, or does one type of beer contain more alcohol than another. These questions are very prevalent and applicable in the real world, so while this was something I was familiar with from my undergrad days, it was a good refresher. Furthermore it made me realize the simple, but powerful functions of SAS to conduct T tests on data.

The 2nd piece, and really the bulk of our focus this week, was on regression / prediction. We started by reviewing an article by a prediction skeptic, whereby the author talks about the prevalence of bias in everything we do and predict, especially when it comes to data science. he certainly raised some good points that encouraged the class to think critically, but I think more importantly, it informed the class of bias and other inherent flaws when performing data analysis.

When we actually dove into the code, we analyzed wine quality with several contributing variables including sugar, alcohol content, various residuals, density, etc. We then built out a training model in SAS and tested the results using our test set; then, we put the code through a final scoring model and reviewed the results – seeing the analysis come to life and understanding the power of prediction with existing data was probably the most satisfying portion of this week’s assignments.

Leave a Reply

Create your own website, free on WordPress.com.Create your own website.
Start free