<story><title>Grocy: web-based, self-hosted grocery and household management</title><url>https://grocy.info/</url></story><parent_chain><item><author>six2seven</author><text>This is exactly what I needed and was thinking about building a similar app. But to be really useful and automated, there&amp;#x27;s a bit long way I&amp;#x27;m afraid. The biggest deal breaker is the time spend for the data entry and updates, leaving a pen-and-paper &amp;#x2F; notes solution still the most easy to use and just visiting local groceries and shops. I was collecting receipts and playing a bit with scanning of these, but the amount of noise in the data and inconsistencies between shops were a bit pushing away (unless you want to dedicate time cleaning the data and training own tailored information extraction models).&lt;p&gt;One of the options to solve the data entry could be:
- good quality automatic scanning of receipts (not only individual barcodes) from shops using OCR possibly supported with image recognition for double-checking (can happen that products will be mis-labelled or without quantities, etc)
- when ordering on-line, the receipt should be available, so should be also much easier
Yet, not always one will have a meaningful receipt available...&lt;p&gt;Solved the data entry and being able to predict own&amp;#x27;s supply needs would be also great to have a up-to date management of the inventory. Here are even more challenges on the tracking of the available goods at home, where these are and how many items (and in what state, expiration date, etc) would require most probably implementing different solutions from IoT (connected cameras, sensors, etc.).&lt;p&gt;Then, having a connected home with own groceries supplies under control, one can then automate further the shopping process with feeding-back the information about own&amp;#x27;s demand to on-line groceries one is subscribed to. This can enable customer subscription plans, and for retailer keeping a possible continuous flow of goods. This could be really really useful especially for upcoming months, when it seems like we are expected to spend a bit more time at home rather than usual, hopefully not fighting in the local shops for the last rolls of the new white paper gold.</text></item></parent_chain><comment><author>chipperyman573</author><text>If you shop at walmart, there is an option to add a receipt to your account by scanning the barcode in the app (or it shows up by itself when you use walmart pay). These can be retrieved online from anywhere (not just the app) and is how I do it, way easier than you think. It basically comes down to&lt;p&gt;$(&amp;quot;.icon-button-children&amp;quot;).each((index, item) =&amp;gt; ($(item).click())) &amp;#x2F;&amp;#x2F; expand all items&lt;p&gt;$(&amp;quot;.LinesEllipsis  &amp;quot;).each((index, item) =&amp;gt; console.log(item.innerText)) &amp;#x2F;&amp;#x2F; record the stuff&lt;p&gt;on &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.walmart.com&amp;#x2F;account&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.walmart.com&amp;#x2F;account&lt;/a&gt;</text></comment>
<story><title>Grocy: web-based, self-hosted grocery and household management</title><url>https://grocy.info/</url></story><parent_chain><item><author>six2seven</author><text>This is exactly what I needed and was thinking about building a similar app. But to be really useful and automated, there&amp;#x27;s a bit long way I&amp;#x27;m afraid. The biggest deal breaker is the time spend for the data entry and updates, leaving a pen-and-paper &amp;#x2F; notes solution still the most easy to use and just visiting local groceries and shops. I was collecting receipts and playing a bit with scanning of these, but the amount of noise in the data and inconsistencies between shops were a bit pushing away (unless you want to dedicate time cleaning the data and training own tailored information extraction models).&lt;p&gt;One of the options to solve the data entry could be:
- good quality automatic scanning of receipts (not only individual barcodes) from shops using OCR possibly supported with image recognition for double-checking (can happen that products will be mis-labelled or without quantities, etc)
- when ordering on-line, the receipt should be available, so should be also much easier
Yet, not always one will have a meaningful receipt available...&lt;p&gt;Solved the data entry and being able to predict own&amp;#x27;s supply needs would be also great to have a up-to date management of the inventory. Here are even more challenges on the tracking of the available goods at home, where these are and how many items (and in what state, expiration date, etc) would require most probably implementing different solutions from IoT (connected cameras, sensors, etc.).&lt;p&gt;Then, having a connected home with own groceries supplies under control, one can then automate further the shopping process with feeding-back the information about own&amp;#x27;s demand to on-line groceries one is subscribed to. This can enable customer subscription plans, and for retailer keeping a possible continuous flow of goods. This could be really really useful especially for upcoming months, when it seems like we are expected to spend a bit more time at home rather than usual, hopefully not fighting in the local shops for the last rolls of the new white paper gold.</text></item></parent_chain><comment><author>bauerd</author><text>Re data entry: was thinking this through a lot recently.
Basically what I&amp;#x27;d like to build requires either (1) product recognition vision like Google Lens offers, or (2) a barcode scanner &lt;i&gt;and&lt;/i&gt; an extensive barcode product database. Both can be combined of course.&lt;p&gt;My solution would be to read frames from a smartphone&amp;#x27;s camera until a barcode is detected. This can be achieved with eg Firebase ML, on-device. If a barcode database lookup gives a product, put it on the in&amp;#x2F;out list. If not, send the frame to a product recognition vision service. This could be Google Cloud Vision AI, but they don&amp;#x27;t give you access to their product set that backs Google Lens.&lt;p&gt;Finally, provide controls to adjust the number of items on the in&amp;#x2F;out list&lt;p&gt;I thought about OCRing supermarket receipts too but these differ so greatly in layout etc. per country I figured it&amp;#x27;s not the way to go&lt;p&gt;Edit: Problem you run into as not all of this can be done on-device is privacy concerns of coursem just my thoughts on what interface I&amp;#x27;d like to have</text></comment>