<story><title>Reducing logging cost by two orders of magnitude using CLP</title><url>https://www.uber.com/blog/reducing-logging-cost-by-two-orders-of-magnitude-using-clp/</url></story><parent_chain><item><author>hobs</author><text>This just in, Uber rediscovers what all us database people already knew, structured data is usually way easier to compress and store and index and query than unstructured blobs of text, which is why we kept telling you to stop storing json in your databases.</text></item></parent_chain><comment><author>dewey</author><text>There&amp;#x27;s nothing wrong with storing json in your database if the tradeoffs are clear and it&amp;#x27;s used in a sensible way.&lt;p&gt;Having structured data and an additional json&amp;#x2F;jsonb column where it makes sense can be very powerful. There&amp;#x27;s a reason every new release of Postgres improves on the performance and features available for the json data type. (&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.postgresql.org&amp;#x2F;docs&amp;#x2F;9.5&amp;#x2F;functions-json.html&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.postgresql.org&amp;#x2F;docs&amp;#x2F;9.5&amp;#x2F;functions-json.html&lt;/a&gt;)</text></comment>
<story><title>Reducing logging cost by two orders of magnitude using CLP</title><url>https://www.uber.com/blog/reducing-logging-cost-by-two-orders-of-magnitude-using-clp/</url></story><parent_chain><item><author>hobs</author><text>This just in, Uber rediscovers what all us database people already knew, structured data is usually way easier to compress and store and index and query than unstructured blobs of text, which is why we kept telling you to stop storing json in your databases.</text></item></parent_chain><comment><author>stingraycharles</author><text>Yeah it’s silly, even when Spark is writing unstructured logs, that doesn’t mean that you can‘t parse them after-the-fact and store them in a structured way. Even if it doesn’t work for 100% of the cases, it’s very easy to achieve for 99% of them, in which case you’ll still keep a “raw_message” column which you can query as text.&lt;p&gt;Next up: Uber discovers column oriented databases are more efficient for data warehouses.</text></comment>