Category: assignments

Though several large tech companies like Google and Facebook have released numbers on gender and racial diversity in its workforce, there is comparatively little data about the workforces of smaller, fast growing companies, such as AirBnb and Github. To remedy this, last October, Pinterest engineer Tracy Chou surveyed employees at these companies directly, asking them to self-submit their data. Chou collected and aggregated the information into a public spreadsheet.

Chou’s data forms the basis of this visualization, titled “We can do better,” created by Ri Lu. Each company is represented by two circles, whose size is proportional to the number of men and women in its engineering workforce. The circles, colored pink (women) and blue (men), are placed on a horizontal axis, where a 100% female workforce is on the leftmost end, and a 100% male workforce on the rightmost end.

Based on the title, “We can do better” and the use of the term “gender disparity,” it’s clear that the goal of this visualization is not only to highlight the gender imbalance in engineering teams at these tech companies, but also to suggest the companies do something about it.

The visualization is effective at achieving the first goal. There is a noticeable difference in sizes of the two circles and most of them are closer to the right side of the axis, showing a clear skew in the number and percentage of men.

However, I think this visualization lacks context around why this gender imbalance occurs and what people can do to help. In the absence of clear, persuasive advocacy, perhaps with supplementary text, people may walk away with the idea that this imbalance is not a real problem, or that there is no solution.

Additionally, because the data was self reported, it may not be 100% accurate, but this fact is mitigated by the clear trend that manifests. The visualization also acknowledges the limitation that gender is not binary, though it only displays a M/F breakdown at this time. Finally, gender is only one aspect of diversity of a company. A more complete visualization, or set of visualizations could include information about race, class, etc.

I originally was trying to locate a more “data-y” xkcd comic I’d seen recently, but ran into this one first and was struck by the timeline visualization and its context.

http://xkcd.com/1477/

 

 

 

I believe the audience of this comic is broader now than when it first launch, but I would suspect it is more science/math oriented, younger, and male that the general population.  I think the intended audience for this particular strip is probably people in their 20s-30s, with the assumption that they follow basic pop culture science fiction.

I think the bigger message of the comic is that we often misread/misestimate the passing of time and the timeline is a visual reinforcement of that message.  The use of present day benchmarks is very effective in conveying this. I suspect most people reading his comic have seen both of this movies (in “real time” or not) and these were fairly memorable benchmarks in their lives.  Additionally, people probably have a notion when these points in their life occurred and the timescales between them, providing perhaps a “shocking” comparison.

I think the combination of text and simple visuals is very effective here.  The inclusion of (basic) people and emotion words make it stronger as well I think.  The timeline was the first thing I saw and read in the comic, which let me “process” the reality of the time gap, before getting hit with the text about it.  I think this let the text have more emotional impact, since I already believed it, and didn’t have to mentally “check the facts.”

Wind is a source of energy that is readily available worldwide. When harnessed properly, it can provide continuous energy to households irrespective of the time of day (as is the case with solar power.) The limiting factor to the utility of wind power is wind availability at certain geographic locations. In some locations wind is abundant, while in other locations, it is not. Moreover, the velocity of the wind at a given location greatly affects the operating speed at which wind turbines are functional, as high wind speeds can damage the generators in the rotors of these machines. The figure below shows a visualization of the location and speed of surface winds in the US, in real-time. The surface wind data is from the National Digital Forecast Database (NDFD.) The authors specifically state that the data is not to be used to fly planes, sail boats or fight wildfires!

This information is crucial in the planning, siting, and sizing of wind farms. Wind farms are useless if they are located in areas with intermittent or variable wind patterns. This data visualization can also play an important role in city planning. For example, city planners could utilize such data in determining where to, locate a new high-rise development or park, as wind speeds can be detrimental to development.

This visualization communicates the overall picture in a meaningful way; however, a better picture can be depicted. For instance, the addition of color scale could immediately communicate where best suited sites for wind farms based on location.

 

Source: http://hint.fm/wind/

Mike Bostock’s algorithm visualizations were not my first thought in response to the phrase “data presentation.” He also does a lot of standard data presentations, too, that I could have chosen to talk about. But his algorithm visualizations are among my favorite things to look at, and arguably highlight (as well as leave out) aspects of data presentation that might merit some meta-inspection, so I thought they’d be worth examining anyway.

Algorithms are often used to process data, but also to generate it. There are quite a few algorithms featured in the essay, but my favorites are the three described for generating a uniform-looking random sampling of points throughout a space. So, it’s definitely geared towards computer science enthusiasts in its content, but still attractive enough to engage the less geeky among us. It’s able to paint a less technical macro picture as well as a more detailed micro picture.

The motivating illustrative examples are the three versions of Starry Night, produced by using each algorithm to sample points, and then coloring the area closest to each point the same color as the point- a kind of compression of the image. This division of the space into cells defined by the point they are closest to is called a Voronoi diagram. But even without knowing precisely what that means, from the pictures it is easy to get an intuitive sense both for what the sampling does to the image, and why we would want to do it. The point of the article and the images is not to teach the reader what a Voronoi diagram is, especially when they are likely to already know or look it up if they care, but to give insight into the algorithms, and perhaps more importantly, to describe by example how visualizations can be used to teach and learn about algorithms.

What thrills me more than the Starry Nights though, as an engineer interested in ways to make important details obvious, is the set of blue-green Voronoi diagrams below that compare the performance of the three algorithms. The cells in these diagrams are a lighter color when smaller and darker when larger, to accentuate the non-uniformities in size between cells- details already in the image, but that would otherwise have been much harder to see. It shortens the search our eyes have to make for those much larger or smaller cells. It immediately makes clear which of the algorithms creates the most uniform sampling.

…

Of the animations in the essay, the Poisson disc is my favorite- not just because it is the best-performing algorithm, but because of its mesmerizing beauty. I stared at it for a long while before beginning to understand what it did, and the color cues were the most helpful at the start. I noticed that there were nodes that started out red and turned black, or “off,” and the process of discovering the algorithm amounted to answering the question “under what conditions does that happen?” It stimulated all the right questions, and then answered them. I also liked that the animation had processes noticeable at different time scales; I felt that the animation was a bit fast for me at first (without reading the accompanying text), and perhaps I latched onto the color change because it was occurring at a speed that allowed me to think in between changes. Being familiar with the algorithm now, all of the processes appear to be happening at a nice pace- but only because I know what to look for.

 

Finally, another note on relevance: the data that these algorithms generate are clean; there is little noise in the typical sense and relatively few confounding factors involved. However, the visuals help us realize the flaws and patterns that are there. The visibly inferior demonstrations of the completely random algorithm highlight the important fact that a “uniformly random” probability distribution does not lead to a uniform result, but also suggests the powerful role of the random number generator in creating any patterns that do appear in the set of generated points. Bostock later describes the role and idiosyncrasies of various random number generators, in the context of sorting algorithms, but I feel he could have done this earlier; or maybe the long foreshadowing was an intentional device to create more of an aha moment at the end for the learner.

As I started to gather some tips for my trip to France, blogs and guidebooks bombarded me with the pictures of elegant French dishes and long lists of the “Must-Try” restaurants.  Similarly, when I prepared for my trip to China, every resource talked about food–the diverse style of cooking in China, what to try on the Markets, what spices are used, what I must try and what I must not, etc.  It seems like traveling cannot be talked about without talking about food, and I believe that goes pretty much the same with life..!  As an enthusiastic eater and “eye-eater” on food blogs, I recently found this poster that alerts travelers about their food safety.

 

 

This poster categorizes common foods any traveler encounters during their trips into ‘safe’ and ‘not safe’.  It displays actual pictures of the food and successfully grabs its audience’s attention (and appetite).  It must have been hard to skip over this page, if it were on magazines such as ‘Budget Travel’ and ‘Travel & Leisure’.  The poster informs the international travelers that fresh food such as salad, raw fish/sushi and fruits are more dangerous than dry food such as canned tuna and cooked meals such as boiled eggs and grilled vegetables.  It also suggests that while bottled water is reliably safe, tapped water should be avoided or drank with caution, depending on the countries they are travelling.

This poster successful grabs the readers attention by using actual pictures of the food, instead of simply listing the safe and unsafe items.  It also does a good job of pairing the counterparts (for example, bottled water vs. tapped water, cooked steak vs raw meat, boiled egg vs. not-fully cooked scrambled eggs).

One of the biggest problems facing our generation and those to come is climate change. This topic has sparked political debates, religious debates, industry changes, and is something that I’m particularly interested in because I spent IAP in a city where the pollution causes the visibility on sunny and foggy days to be equivalent.

The data being shown in this video is nothing new, it’s something that our teachers, parents, and peers talk about: the ice caps are melting, the carbon in the air is increasing. What I think the video does well is it provides a visual to this that elicits an emotional response from the watcher. The video shows a time lapse of earth over the next hundred years, where we can actually see what it will look like when our planet is no longer capped with white and when Florida is no longer a dry piece of land.

The video tries hard not to offend watchers and place blame, but at the same time it tries to scare watchers into action. Did you know that the acidity of the ocean has increased 26% since the industrial revolution? Did you know that if nothing changes, the earth will be 4 degrees warmer in 80 years? The video ends with earth being depicted as a ticking time bomb.

The visualization of the data allows even the least technical person to understand. The technique of showing change over time is similar to what Rosling does in his Ted Talk; however, instead of showing past measured data, the video shows projected data if nothing about humanity’s current carbon footprint changes. I think that the presentation is very effective, and that the audience is just your average Joe.

Data from the Census Bureau show where the poor live.

Mapping Poverty in America is an interactive recently published by the New York Times that visualizes data about poverty from the Census Bureau. It does so by presenting it on an interactive map that colors regions based on the percent of people that live below poverty thresholds, which is quantified for people that don’t know what the poverty threshold is.

Upon loading, the site asks for your location, and (if given) displays the data for your general location, as well as previews of other major cities in the US. Hovering over a colored region will display an info-box with that region’s poverty rate and the amount of poor people in that region. The interactive also has two different views, which visualize either regions colored by poverty rate or circles representing the amount of poor people in a region.

This interactive aims to visualize data that would otherwise not be seen by the general public, especially since the NYT has such a large readership. Though the interactive makes no politically charged statements, you can’t help but think that this was made with the intention of sparking conversation about poverty in the US. This interactive shows that poverty is indeed still a problem that is faced by many regions of the US, and by making this information available, easy to understand/visualize, and localized to each individual reader, hopefully this problem will no longer be ignored.

When people think of OkCupid, big data isn’t often the first thing that comes to mind. As a free online dating website, it’s certainly easy to dismiss OkCupid as a reputable source of information – yet, the data that comes from the millions of interactions can actually lead to interesting insights on the way certain people interact with certain people.

OkCupid publishes a blog called OkTrends, which seeks to find trends in the way people interact with each other, to both bring out interesting correlations for amusement and to gain insight on how to better connect people romantically. What with the wealth of information that users provide on their own personality and demographics, OkTrends combines humor and data science to produce amusing results, produced in a fairly digestible format for almost all audiences. For example, OkCupid found that “Among all our casual topics, whether someone likes the taste of beer is the single best predictor of if he or she has sex on the first date.” [1].

However, the data that OkCupid also possesses has also been used to open a discussion for a more socially impactful topics – like race and how it affects our perceptions of others. In Race and Attraction, OkCupid revisits one of their first analysis of race and attraction from 2009, to see how racial preferences have changed in the last 5 years.

From the graphs below, they found that racial preferences from 2009 through 2014 have actually stayed about the same, and in some cases, “racial bias has intensified a bit.”

source: http://blog.okcupid.com/index.php/race-attraction-2009-2014/

source: http://blog.okcupid.com/index.php/race-attraction-2009-2014/

These preferences are also checked against the data from another dating website, DateHookup, with “a distinct user base, a distinct user acquisition model, a distinct interface, yet their data reflects the same basic biases.” These racial preferences seem to stay similar, with the common trend of asian men and black people taking the greatest hits in preference.

Curiously enough, while the behavior of people have not changed much, when asked explicitly about certain racial attitudes, users have answered their match questions to as less biased overall.

source: http://blog.okcupid.com/index.php/race-attraction-2009-2014/

While the data presented is of course coming from the dating world, it does still have significance in the way we understand the way we perceive others based on race. This article suggests that in the past five years, we have been telling ourselves that our racial attitudes are less biased, but our behavior has remained unchanged. Of course, the data isn’t definitive in any way. However, it does present a launching point for a discussion on racial awareness, to deeper understand the differences between what we believe and how we actually act.

This Vlogbrothers video was published in September 2013 and is one in which Hank Green provides counterarguments to common ideas that people who don’t believe in climate change use to defend their standpoint. He begins the video by describing what climate change is and why it’s a problem that we, as humans currently living on this earth, should care about. And then he contextualizes his arguments with data and figures from peer-reviewed scientific papers. All of these papers are linked in the video description, so viewers can read about The Myth of the 70s Cooling Consensus or A Reconciled Estimate of Ice-Sheet Mass Balance, showing that the land ice mass (as opposed to the sea ice mass) of Antarctica is decreasing with time.

The audience is primarily the Nerdfighter community (those who regularly watch Vlogbrothers videos), which vary from teenagers to adults in their 40s who accept Hank Green as a reliable host and generally are open to listening to his opinions. As with all YouTube videos, though, his ideal target audience is anyone on the website. This video is accessible and well-made enough for many types of people to find it at least somewhat engaging, from those who are familiar with vlogs and many formats of online video, to those looking solely for entertainment, to those who use YouTube for educational videos, etc.

Overall, I think the video is effective for an audience that either 1) agrees with climate change 2) slightly disagrees with climate change for no really strong reasons or 3) a casual audience who has very little knowledge about the subject. The fact that he uses figures from scientific papers to back up his verbal claims and summarizes the rest of the literature in his argument works for this medium, a <4 minute YouTube video for people (especially younger audiences) who just want to get more informed.

However, this video will probably fail to persuade firm believers in “global cooling” that climate change exists. I’m assuming that these types of people are less likely to do further reading in the suggested papers and might not even listen to the entire video before starting discussions, productive or otherwise, in the comments. At best, this video might persuade them to doubt one or two of the misconceptions they have about climate change, which might count as having successful impact.

In this TED talk, Dave Troy presents some social maps of cities that he created by analyzing users’ Twitter data and locations. He analyzed the primary interests of each user, color coded it, and mapped it to their location, drawing lines between any connection between two users. What he found was that, in each city, primary interests of users tended to clump geographically; in a way, the primary interests of users created interest boroughs, of sorts.

Given that his map of Baltimore specifically designated the “Geek” area as also the “TEDx” area of the city, it seems that his intended audience for the TED talk is comprised of other data geeks and TED enthusiasts. In addition, I think that the maps could be useful for urban sociologists and those who study the connections between online social behavior and offline location, culture, and behavior.

Troy’s research and presentation aim to examine the social separation within cities, which he views as a social construct which we could choose not to do. While I feel that the data visualizations, taken without comment, provide useful information, I do not agree with his conclusion. Though he mentions gentrification in his talk, he does not seem to acknowledge that many of the people in the cities he examines (specifically, those being pushed out due to gentrification) literally cannot afford to move into other areas of the city because it is too expensive. His presentation is not effective in explaining for this.

I do, however, feel that the data visualizations themselves do effectively show the separations of and connections between different interest bubbles in the cities. It would be interesting if he could somehow incorporate income distribution into the visualizations, as I feel there may be significant correlation and may help show some of the economic underpinnings of these bubbles.