Spectrify: Leveraging Redshift Spectrum for Fun and Profit
Redshift has lowered the barrier to entry for big data analytics to near zero. Its pay-per-node pricing provides a predictable level of performance and palatable prices for small-to-medium businesses, especially those just starting their Big Data journey. However, many businesses fail to account for the effects of time on their redshift cluster. As time-indexed data accumulates and “cools off,” businesses are forced to buy extra nodes to store old data they aren’t querying. Spectrify is an open-source project that solves the historical data problem with a few simple shell commands. It is backed by Redshift Spectrum, a pay-per-query “exascale compute service.” Long term, the goal is to make Spectrify the only tool you need to manage data across these complimentary services.