-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
”
Yelp has long faced accusations that it manipulates its business-review ratings to sell advertising – five stars for a big ad buy, say, and two stars for a turndown.
The verdict from a federal appeals […]
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Some quick instructions:
You must complete the quiz by the start of class on February 7, 2017. The quiz is based on the readings for the whole week.
When you click on the link, you may […]
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
In class we talked about a few examples of open data. Here are some others:
Business: data.gov’s “Impact” section
Science: The Genomes Unzipped project
Government: New York City parking viola […] -
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Here is the exercise
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Leave your response as a comment on this post by the beginning of class on February 2, 2017. Remember, it only needs to be three or four sentences. For these weekly questions, I’m mainly interested in your o […]
-
fivethirtyeight.com/features/trump-is-doing-what-he-said-hed-do/
I found this article interesting because it talks about how modest trumps victory was. I really enjoy reading articles that do an data driven analysis of election, I was watching the live data on election night. The article listed data about how trump ranked against the past 25 elections and the data showed that the only other president besides Trump to have a negative margin on popular vote was George Bush. -
https://projects.fivethirtyeight.com/clinton-trump-hip-hop-lyrics/
this is an interesting article as it shows the references of all the 2016 president candidates in a database of songs. It turns out that the data set was rife with Trump, whose prominence and longevity as a figure in hip-hop is staggering. He and his brand have been referenced in 266 songs dating back to 1989; in one year alone (2013), there were 33 references. -
From an MIS prospective I found an article that talks about how to truly delete data in today’s technological age. All data is is stored on a physical device so you can erase data that you have control over. in addition data sanitization is also an option to wipe drives through overwriting them enough times. But the major point that I learned is that data is always easier to make then it is to delete.
Source: https://fivethirtyeight.com/features/what-it-takes-to-truly-delete-data/
-
I found an article on where the hot places to go “on holiday” are in 2017. This interests me because I love to travel, and no matter what job I get into I would enjoy traveling to different offices of just flying somewhere with my extra time. I found this website under the “Great Data Sites” tab on the right side of this page. The article just shows the top places and a little bit of information on each one.
https://www.theguardian.com/travel/ng-interactive/2017/jan/07/where-to-go-on-holiday-in-2017-the-hot-list -
http://fivethirtyeight.com/features/how-our-oscars-tracker-works/
I found this article about how “FiveThirtyEight” uses data to predict The Oscars’ winners. I think this is an interesting article because I love watching movies and all the events related to movies. Also, I like the data that they use to make their predictions. For example, they use historical data to find all the winners from up to 25 years ago, and use those winners as a hypothesis of how “representatives of the academy’s thinking.” They also look at other awards, and how many times the person who won that award won the Oscar too.
-
Major: Statistics
This is an interesting (and kind of fun) article about food consumption on the day of the Super Bowl. On Super Bowl Sunday, we eat the second most amount of food in a day (Thanksgiving is first). 1.33 billion chicken wings are consumed and 12.5 million pizzas are ordered on this day. This data may be questionable or unreliable because the amount we consume does not always equal the amount of food we order.
-
This article talks about how police view their jobs from a psychological and emotional perspective in light of recent civil unrest regarding unequal treatment on the basis of race/gender. This was interesting particularly because the research shows that conflicting experiences and emotions mark police culture. Often surveys measure public option and emotions/attitudes of those populations being targeted, but have not assessed the emotions/attitudes of the very people who are protecting/enforcing the law during this revolution and how it has changed their perspective about their job and their communities.
-
https://fivethirtyeight.com/features/russell-westbrook-does-everything-fast-for-better-and-for-worse/
This article takes an interesting look at one of the NBA’s most electrifying superstars and the rapid pace that he plays at. Russell Westbrook of the Oklahoma City Thunder is known for his unbelievable athleticism among basketball fans, and the data used in this article provides concrete support of that belief. Statistics featured in this article include the number of transition plays, score percentage and turnover percentage for the 2016-2017 season. -
https://projects.fivethirtyeight.com/congress-trump-score/
I found this article to be extremely interesting because it is constantly updating its data as members of the senate either agree or disagree with Trump. It shows you how often the senators vote with or against Trump, how likely they are to do so, and Trump’s margin. It does this with the House as well and even tells you specifically how many members of the Senate and House voted for and against certain bills and nominations. -
The City of Seattle and the University of Seattle hosted a workshop called “Big Data and Human Services,” which was sponsored by Amazon, Comcast, and Microsoft. The event was focused on how the use of big data and data analytics can be used to improve the quality of cities in the United States. City governments can use data to drive decision-making in issues related to education, homelessness, and transportation.Last year, the City of Seatle signed a policy regarding open data which makes data about city issues, such as homelessness and local parks, more easily available online.
http://www.geekwire.com/2017/big-data-can-transform-cities-save-lives-uw-seattle-brainstorm-solutions-education-homelessness-transportation/ -
This is an article about how data could start to be the leading front in regulating different companies around the world. Data is starting to show that big companies like Facebook, Google, and Apple could be accused of tax evasion. This new data could lead to having a strong grip on companies and not letting them get away with criminal activities.
-
https://projects.fivethirtyeight.com/pollster-ratings/
I found this interesting because of the importance it carries. Throughout the election and since Trump’s victory, there has been a lot of talk about “Fake News”. A section of “Fake News” are polls regarding high level politicians and general political polls. President Trump has repeatedly attacked CNN, Wash. Post, NY Times, for their coverage of him. On the other hand he has also praised Fox News for their coverage. This graphic shows the rating of each polling institution like CNN/ORC, Quinnipiac, Fox, MSNBC, etc. One of the best things about this info chart is the bias indicator. It could serve as an eye opener for Republicans and Democrats who think their favorite news organization is not biased.
-
https://today.yougov.com/news/2017/01/31/Super-Bowl-TV-advertising-main-event/
With the big game coming up this Sunday I thought finding a article with super bowl data was very fitting. The data in the article has to do with how important the super bowl is in terms of commercials. Commercials during the super bowl consistently enhances the brand of the company being promoted as well as drives people to go out and buy a certain product. The super bowl is one of the most watched events in the world and the amount of eyes that see the game, and the commercials is staggering. -
This report has shown that data analysis is the most important skill out there for marketers, surpassing social media skills. You can download the .pdf that goes more in depth about their study. Marketers don’t want to be immersed into data science. But, if they don’t, a data skill gap will only widen. This will hurt their career, productivity, and efficiency. There’s a fact that says, 27% of marketers still have to hand data analysis over to the IT department”. Data analysis is such an important skill and it is a need that is alarmingly increasing each year.
-
http://www.cnbc.com/2017/01/20/super-bowl-billions-the-big-business-behind-the-big-game.html
This article I found was on the “Super Bowl Billions” it was quite interesting to me because i love football and seeing all the preparation and money that goes into the biggest event of the year. As you read the article you can see the amount of money and profit they make off every superbowl depending on how many tickets are sold, the ticket packages, the after parties, and especially what stadium is hosting the event each year. This year is Houston, Texas and they have funded so many events prior to the actual even to raise money to pay off the cost of the event, but they also make a huge profit. -
https://fivethirtyeight.com/features/russell-westbrook-does-everything-fast-for-better-and-for-worse/
This article talks about Russell Westbrook and his play and it shows that everything he does on the court is fast and that he is one of the fastest players in the league. What people do not realize when it comes to Russell Westbrook however is that this fact hurts his game in some ways and helps it in others. Since he plays at a different speed than everyone else it can appear that everything comes easy to Westbrook but his quickness can also be a downfall of his as well. He has a higher turnover rate than most other people in the NBA and this is because often times he is moving too fast and putting himself in bad situations because he can be out of control. Even with this flaw he is still one of the best players in the league today and he is definitely a one of a kind type of player. -
https://www.usi.edu/recycle/solid-waste-landfill-facts/
This data shows that U.S is the number one trash producing country in the world. “This means that 5% of the world’s population generate 40% of the world’s waste.” I find this information very interesting because on average it costs $30 per ton to recycle trash and $50 to send it to landfill. However we recycle less than 25% of our waste. -
https://www.entrepreneur.com/article/253022
This article is intriguing because it shows you how marketing firms and organizations are using social media data to market to their consumer. The article suggests that you can use social media data to target your audience, which is a great idea because the company doesn’t have to market to everyone but instead to a specific demographic or audience. This article shows that using social media data can be the difference in profits and consumers. -
http://www.benefitnews.com/news/workplace-stress-levels-dropping?tag=00000151-16d0-def7-a1db-97f024b50000
This article is about the levels of stress dropping within the workplace. 36% percent of respondents reported a stress level of 2 on a scale of 1 to 5. Two years prior, 33% of respondents reported a level of 3. -
https://fivethirtyeight.com/features/stocks-fell-are-investors-finally-taking-trump-at-his-word/
I found this article interesting because it has relevance on what is happening now. What it explains is that stocks have fallen for the first time since trump was elected because of the skepticism of investors.They thought Trump most controversial proposals were not going to happen and that he would manage the country as a normal republican.But instead since the immigration policy he has stated and all of the controversy that this brought has mad that investors start taking Trump seriously. -
https://www.shrm.org/hr-today/news/hr-magazine/pages/0216-hr-analysts.aspx
This article discuss hr analysts growing into more professionals roles. As a HR major I find this interesting because it will help me access the number of jobs.
-
Found this article really interesting as of current events that are happening right now and its effects on our country. They discuss the possibility that Trump’s supreme court candidate selection could technically overturn Roe v. Wade without literally overturning it. The article uses a data visual of liberal vs conservative decisions made in different courts based on the selection. Most interesting part of the article was that in the conclusion they quote that if Trump could select more than one person for the court then the whole legal system would tilt.
-
https://www.bloomberg.com/view/articles/2016-12-08/no-big-data-didn-t-win-the-u-s-election
This article is interesting because it discusses a company Cambridge Analytica which creates a profile for individuals based on their interactions with social media and any other database it can, “get its hands on” and assigns a number value to individuals. This is particularly interesting because this number value is based on a variety of characteristics, “OCEAN criteria: Openness, Conscientiousness, Extraversion, Agreeableness and Neuroticism,” and as you can imagine is incredibly valuable. This was the metric by which the political parties vying for presidential election determined who would be the easiest voters to sway. Trump’s campaign integrated this metric into their canvassing application and went so far to tell the canvassers which doors to knock and which potential voters to call.
-
I found an article that contains a simulation of how you will die at what age depending on age, race, and sex. It uses data from the Centers for Disease Control and Prevention which categorizes 113 subcategories into an umbrella of 20 categories of disease and external causes of death. The dots of each year of your life fill up with the most probable category that you may die from. Real interesting and kind of depressing. -
https://projects.fivethirtyeight.com/soccer-predictions/?ex_cid=rrpromo
Cool link with lots a data about the Premiere League Soccer in Britain. The three categories on the chart aren’t raw data but analyzed data that included a power index and two types of season predictions.kinda unrelated
Go Man City! -My British roomate -
This article shows the difference between public opinion about Obamacare when the law was introduced in 2009-2010 and how the approval of the law was increased now that Trump has become the President and took over the office. It has a lack of success in bringing down the healthcare cost. It is interesting because some of the demographic groups are taking the advantage of it because it is anti-trump.
-
https://www.census.gov/newsroom/facts-for-features/2016/cb16-ff10.html
This article shows data on hurricanes and is a resource for emergency managers. This is relevant for me because I’m getting ready to enter a career in emergency management and it’s important to have access to recent data about any and all potential threats that might cause the population served to need to react in a dramatic way, such as through an evacuation. -
https://fivethirtyeight.com/features/as-u-s-life-expectancies-climb-people-in-a-few-places-are-dying-younger/
This article shows the your life expectancy can vary by as much as 20 years depending on which county in the U.S. you live in. This new study adds to a growing body of research showing that race, education, wealth and where you live can help determine how long you will live.
-
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Here is the exercise.
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Some quick instructions:
You must complete the quiz by the start of class on January 31, 2017. The quiz is based on the readings for the whole week.
When you click on the link, you may see […]
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Here are the instructions in word (and as a PDF). Make sure you read them carefully!
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Here is the exercise.
And here is the spreadsheet you’ll need [In-Class Exercise 2.1 – 2015 Car Fuel Econ [Start]]
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Leave your response as a comment on this post by the beginning of class on January 26, 2017. Remember, it only needs to be three or four sentences. For these weekly questions, I’m mainly interested in your o […]
-
Individuals with DUI on there driving record shouldn’t be driving after midnight. This can be tested by collecting data from the fiscal year and determining who ended up with a DUI for the second time on their record and seeing at what time did the DUI occur.
-
One conventional wisdom is that attractive or good looking employees tend to get higher salary than the less attractive ones. This can be tested by gathering the data from worker’s salary, employers’ opinions, abilities of both groups of people and online survey.
-
A good example of conventional wisdom that I think of would be that SAT scores determine how smart you are. I never understood how one test you take determines so much of your future. There are so many other factors that could have happened that day or days leading up the test that could alter that students test score.
-
Everyone has heard the old adage, “money can’t by happiness”. In fact, many have found that the opposite is true. While money can’t literally buy happiness, spending it on the right things has been shown to increase mood and life satisfaction. For example, investing in a comfortable bed will give you better rest at night and more energy in the day. Similarly, moving closer to your job and reducing your commute will directly improve your happiness levels by decreasing stress. This example could be tested simply by surveying a population of individuals about whether investments have directly elevated life satisfaction.
-
A good example of conventional wisdom is that talking to teenagers about pregnancy prevention leads to a higher rate of sexual activity. I feel that people assume if you talk to teenagers about ways to prevent pregnancy it means that you are giving them permission to partake in sexual activity. A way this could be tested would be to collect data from teenagers by asking whether they are or are not sexually active and whether or not they have received information on preventing pregnancy from someone older, and seeing if there is a correlation between the two.
-
An example of conventional wisdom is that you loose memory as your age increases. To test it you would need data on an experiment that tests memory. For example if you were to make a group look through a set of pictures then recall which ones they were after they went away. You’d test their accuracy then compare by age. Ultimately the analysis of the data would lead to a conclusion.
-
An example of conventional wisdom that comes to mind is the saying “Money can’t be happiness.” While the overall takeaway is commonly accepted for obvious reasons, this is a statement that is never tested and may be found to be untrue. The data I would collect to possibly debunk this statement would be the general happiness of citizens living in poverty compared to citizens in the upper economic class. I would collect this data by providing a survey that will ultimately quantify the happiness of individuals.
-
A example of conventional wisdom would be “Men are better drivers than women”. There are many ways of testing this conventional wisdom, one for exam would be taking data of car crash records and comparing men versus women. There is a problem with this testing because if the data shows that a woman got in a crash you could assume that men are better driver, but really you would have to look at who’s fault it was for the accident because it might not be the woman’s fault. Than you would be able to tell which gender are better drivers.
-
An example of Conventional Wisdom would be the idea that 90% of people don’t remember their dreams when they wake up. This can be tested by an observational study of how many people can remember their dreams word for word when they wake up. This is definitely something that is said, but not fully true because as soon as I wake up I have a story about my dream; without having to remember.
-
An example of conventional wisdom is “Money can buy you happiness”. This never made sense to me, you can buy things that can contribute to your happiness but it could never be the root cause. Happiness cannot be sustained by money alone there must be other contributing factors. Money can buy you things like a comfortable bed, good food, or a ticket home to see loved ones so it can contribute to happiness but is not the sole cause.
-
One example of conventional wisdom that I can think of is that people believe that if they have bad grades, their GPA will go up if they take extra classes with a tutor. This can be tested by gathering data about people’s grades before and after the tutoring and surveying the students and the tutors.
-
One conventional wisdom is that Latinos in general are more dishonest and more tending to corruption than Europeans or North Americans. This conventional wisdom can be tested by collecting data on behavioral surveys with daily situation that demand small or large amount of honesty to set comparison parameters between them. Another way to evaluate this is using the number of criminal records related to corruption and compare them.
-
A good example of conventional wisdom is that students with higher college GPA’s tend to have higher incomes post-college (I don’t have an opinion on this statement, so I don’t know if it’s false or true). Although I don’t know much about the translation of these statistics, I believe it would be interesting to take an entire graduating class’s individual GPA’s and record their average salary over the next 10 years. I would assume that the higher GPA students would tend to have slightly higher salaries than the lower GPA students, but I’m unsure.
-
A good example of conventional wisdom that standardized tests accurately judge and place students in the correct course based of their “intelligence.” Students are all different in their interests and in the way they process/learn information. Testing all students on the same scale may be “fair” in the sense that everyone has the same problems to answer but it does not account for the different styles kids have. Making judgments about kids intelligence based solely on a single test is not the proper way to evaluate students, it should be based off the body of work by the student as well as extra curricular activities and community service.
-
An example of conventional wisdom is eating cholesterol will increase the chance of having a heart attack. However, there is no relationship between the dietary cholesterol and serum cholesterol level. Furthermore, sugar and simple carbs contribute more to an increase in cholesterol in the bloodstream.
-
An example of conventional wisdom is that the more years of experience a driver has, the better a driver they are. This can be tested by looking at car crash reports to see which age group has more accidents. This can also be tested by putting a test group of drivers, of various ages, through a driving obstacle course to things like, reaction time, field of vision, and maneuverability.
-
An example of conventional wisdom is, you cannot have a prosperous career without a college degree. Many would agree blindly without any evidence. This could be tested by comparing the amount of successful people in the work industry with college degree versus ones that are without.
-
Wait half an hour after eating before swimming. There’s no evidence of people being impeded while swimming upon eating. It can be tested by finding records of people who have drowned as a result of swimming immediately upon eating.
-
An example of conventional wisdom that I have heard a lot in my life is the idea that money plays a big part in people’s happiness. Basically stating that the more money you have the happier that you are and the less money that you have the more depressed or more sad you are in life. I do not think that this is a true statement but it has not really been tested but I feel like there is more to happiness than the amount of money that you have because you can have a huge amount of money but still be miserable and depressed and you can have no money at all and still be a very happy person but this is an example of conventional wisdom that I have heard a lot in my life. A way to test this is to talk to people on both sides of the spectrum and see if this is the case or not.
-
When professors allow cheat sheets for Exams or Finals, conventional wisdom tells you to write down as much as information, notes, formulas, and examples as possible. However, this is not the most efficient approach. While it makes sense as to why you should write down as much as possible because of the complexity of the exam, it is always important to keep things simple. The best way to make a cheat sheet work is to use it as a supplement to your knowledge instead of relying on it completely. That means writing down key formulas, key examples, and key notes of topics that are of interest to the professor, you, and the review sheet. The best way to test this is to compare the exam scores of individuals with packed information on their sheets with individuals who only wrote down key pieces of information.
-
An example of conventional wisdom is that people who enjoy reading and read for leisure are better students and have higher grades. To test this hypothesis I would collect data on the scores of students who read a lot and students who dislike reading and compare these to see if the readers really have better scores.
-
One example of conventional wisdom you commonly hear is the concept that “you get what you deserve” while in many circumstances this may be a valid statement, there are plenty of examples that this statement can be proved as conventional wisdom, for example if a man and woman in the acting industry work the same roles but the woman get paid less, that’s not something that has a valid supporting stance for this statement. In order to see if this in fact is conventional wisdom, I would collect data on the average salaries of women and men with the same background in the same roles and compare the yearly salaries to see if there is a trend of equal pay or not. In the case, that there isn’t, I could conclude that clearly “you get what you deserve” isn’t appropriate if these people are working equally hard but one earns more than the other merely because of the gender.
-
An example of conventional wisdom is that people who spend more hours practicing a sport are better at it than those who spend less time practicing it.This could be tested by observing the overall performance of athletes and looking at the amount of time they put on practicing that sport.Also you can test this by comparing different athletes looking at the amount of time they practice for their respective sport.
-
An example of conventional wisdom is that marijuana is a gateway drug to other illegal drugs. However, there is no evidence that marijuana is a gateway drug to other hard illegal drugs. Matter in fact, studies suggest that the most common “gateway” drug for people is alcohol, which later leads to doing other form of illegal drugs.
-
A piece of conventional wisdom is that “A apple a day keeps the keeps the doctor away.” This could be tested by tracking people Apple consumption along with number non routine doctor visits.
-
An example of conventional wisdom is attractive and good looking employees get more salary than the people who are not attractive and good looking. We can gather the data from employer’s and take an online survey for that concern to see if the data is true or false.
-
An example for conventional wisdom is that you must have a business plan for a successful business: Well then what do I do with that brilliant idea that I come up with tomorrow that wasn’t part of the plan but that is now gonna change everything for the better?
-
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 5 months ago
Here is the exercise
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 6 months ago
Some quick instructions:
You must complete the quiz by the start of class on January 24, 2017.
When you click on the link, you may see a Google sign in screen. Use your AccessNet ID and […]
-
Mark Sabat wrote a new post on the site MIS 0855: Data Science Spring 2017 7 years, 6 months ago
Here is the exercise