Categories
Code

Processing Many Small Files with Apache Spark

Apache Spark is straight-forward to use when there are large files that need to be chunked up and read, but what about when you have many small files? In this post we’ll look at a way to address many small files and some parameter tuning to speed that up. The sample data we’ll be looking […]

Categories
Code

Optimal Catan

Settlers of Catan (SoC) is a German board game from the mid 90’s that found mainstream success in America in the late–00’s. To summarize the game: the board consists of 19 hexagonal resources tiles and these tiles get numbered markers (2–12). There are five resources, lumber, sheep, ore, brick, and wheat. These are used to […]

Categories
Culture

The Office, Parks and Recreation, and the National Pathos

In January 2009, I gathered with my classmates in high-school to watch the inauguration of Barack Obama. There was a collective anticipation in the air that things are about to seriously change. One of the principles that Obama ran on was that change through political action was possible, the government wasn’t some immobile beast only […]

Categories
Culture Technology

Towards Emotional Machines

While the vast community of AI is focused on getting machines to recognize everyday objects there is a small faction figuring out how to get machines to meaningfully communicate with us. The following are three ethical points that should be considered in the endeavor of emotional machines. Deception We need to look no further than […]