<story><title>Fsspec: Filesystem Interfaces for Python</title><url>https://filesystem-spec.readthedocs.io/en/latest/index.html</url></story><parent_chain></parent_chain><comment><author>remram</author><text>See also smart_open: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;RaRe-Technologies&amp;#x2F;smart_open&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;RaRe-Technologies&amp;#x2F;smart_open&lt;/a&gt; which might be more user-friendly? Never used it myself but it was on HN before. Discussion on their bugtracker: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;RaRe-Technologies&amp;#x2F;smart_open&amp;#x2F;issues&amp;#x2F;579&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;RaRe-Technologies&amp;#x2F;smart_open&amp;#x2F;issues&amp;#x2F;579&lt;/a&gt;&lt;p&gt;Personally I wasn&amp;#x27;t too impressed with fsspec, though I am using it. I had to wrap files with Python&amp;#x27;s io wrappers to get acceptable performance, and found that different fsspec implementations still have significant differences that you can&amp;#x27;t ignore. They don&amp;#x27;t seem interested in supporting or documenting use cases outside of Pandas and Dask.</text></comment>
<story><title>Fsspec: Filesystem Interfaces for Python</title><url>https://filesystem-spec.readthedocs.io/en/latest/index.html</url></story><parent_chain></parent_chain><comment><author>MrPowers</author><text>fsspec is used in dask (&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;dask&amp;#x2F;dask&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;dask&amp;#x2F;dask&lt;/a&gt;) if you want to see it in action.&lt;p&gt;The author of fsspec also created fastparquet (&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;dask&amp;#x2F;fastparquet&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;dask&amp;#x2F;fastparquet&lt;/a&gt;), a native Python implementation of the Parquet file format.&lt;p&gt;I&amp;#x27;m really appreciative for Martin&amp;#x27;s extensive contributions to the PyData ecosystem.</text></comment>