<story><title>How I Made Google&apos;s &quot;Web&quot; View My Default Search</title><url>https://tedium.co/2024/05/17/google-web-search-make-default/</url></story><parent_chain><item><author>lelanthran</author><text>I want to make my own search engine, one day, with my own crawler.&lt;p&gt;There is an SEO-proof way to determine what the ranking of a site &lt;i&gt;should be&lt;/i&gt; - penalise it for each advertisement, penalise further for delivering different content to the crawler[1], allow logged-in users to down-rank a site, etc.&lt;p&gt;Basically, a site starts off with a perfect score, then gets penalised for each violation, for each dark-pattern, for each anti-user decision they took.&lt;p&gt;This sort of ranking cannot be gamed by SEO spammers, because ... why get their site to the top of the rankings if they can&amp;#x27;t put any advertisements on it?&lt;p&gt;Even if they do manage it, their time in the sun will be brief.&lt;p&gt;[1] Random spot-checks with different user agents with different fingerprints should work.</text></item></parent_chain><comment><author>flir</author><text>It&amp;#x27;s your ranking system, so it&amp;#x27;s correct by definition (for you), but I&amp;#x27;ve got to point out you&amp;#x27;re not considering the quality of the text. In your model, an empty page is perfect.&lt;p&gt;Cynically, maybe you&amp;#x27;re on to something...</text></comment>
<story><title>How I Made Google&apos;s &quot;Web&quot; View My Default Search</title><url>https://tedium.co/2024/05/17/google-web-search-make-default/</url></story><parent_chain><item><author>lelanthran</author><text>I want to make my own search engine, one day, with my own crawler.&lt;p&gt;There is an SEO-proof way to determine what the ranking of a site &lt;i&gt;should be&lt;/i&gt; - penalise it for each advertisement, penalise further for delivering different content to the crawler[1], allow logged-in users to down-rank a site, etc.&lt;p&gt;Basically, a site starts off with a perfect score, then gets penalised for each violation, for each dark-pattern, for each anti-user decision they took.&lt;p&gt;This sort of ranking cannot be gamed by SEO spammers, because ... why get their site to the top of the rankings if they can&amp;#x27;t put any advertisements on it?&lt;p&gt;Even if they do manage it, their time in the sun will be brief.&lt;p&gt;[1] Random spot-checks with different user agents with different fingerprints should work.</text></item></parent_chain><comment><author>nicce</author><text>&amp;gt; allow logged-in users to down-rank a site, etc.&lt;p&gt;And then you need a huge anti-bot mechanism if the search engine will get any popularity. There is money-based motivation to affect the rankings.</text></comment>