Using HTTPArchive and Chrome UX report to get Lighthouse score for top visited sites in India.

As I mentioned in my previous post, I am starting to plan more Developer Relations work in India and I want to get a better understanding of how users in India experience the web. In that post I had a very simple heuristic for determine a site in India, is it a ‘.in’ domain. I knew that this wasn’t the best way to look at it, but it felt like a good first go.


This content originally appeared on Modern Web Development with Chrome and was authored by Paul Kinlan

<p>As I mentioned in my <a href="https://paul.kinlan.me/lighthouse-scores-for-in-domains/">previous post</a>, I am starting to plan more Developer Relations work in India and I want to get a better understanding of how users in India experience the web. In that post I had a very simple heuristic for determine a site in India, is it a '.in' domain. I knew that this wasn't the best way to look at it, but it felt like a good first go.</p> <p>What I really wanted was a way to understand the sites that users in India visit and then get their scores ranked by popularity of the site.</p> <p>Luckily the <a href="https://developers.google.com/web/tools/chrome-user-experience-report/">Chrome UX report</a> has some of that data. The Chrome UX Report has a series of tables in BigQuery that contain a list of many of the top origins that users in India visit (the table is <code>chrome-ux-report.country_in.20180</code> — note the '_in' which denotes the country). The Chrome UX Report has a lot more data for each origin such as the aggregated speed of the site for actual users, but I really only needed the URLs.</p> <p>Using the data from Chrome UX report, and combining it with the Alexa ranking table in HTTP Archive along with the previously mentioned HTTPArchive lighthouse scores we can get a better picture of what users in India actually see.</p> <div class="highlight"><pre style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4"><code class="language-sql" data-lang="sql"><span style="color:#66d9ef">SELECT</span> url, rank, JSON_EXTRACT(report, <span style="color:#e6db74">'$.categories.seo.score'</span>) <span style="color:#66d9ef">AS</span> seo_score, JSON_EXTRACT(report, <span style="color:#e6db74">'$.categories.pwa.score'</span>) <span style="color:#66d9ef">AS</span> pwa_score, JSON_EXTRACT(report, <span style="color:#e6db74">'$.categories.performance.score'</span>) <span style="color:#66d9ef">AS</span> speed_score, JSON_EXTRACT(report, <span style="color:#e6db74">'$.categories.accessibility.score'</span>) <span style="color:#66d9ef">AS</span> accessibility_score <span style="color:#66d9ef">FROM</span> <span style="color:#f92672">`</span>httparchive.lighthouse.<span style="color:#ae81ff">2018</span>_08_01_mobile<span style="color:#f92672">`</span> <span style="color:#66d9ef">JOIN</span> ( <span style="color:#66d9ef">SELECT</span> <span style="color:#66d9ef">DISTINCT</span> origin, Alexa_rank <span style="color:#66d9ef">AS</span> rank <span style="color:#66d9ef">FROM</span> <span style="color:#f92672">`</span>httparchive.urls.<span style="color:#ae81ff">20170315</span><span style="color:#f92672">`</span> <span style="color:#66d9ef">JOIN</span> <span style="color:#f92672">`</span>chrome<span style="color:#f92672">-</span>ux<span style="color:#f92672">-</span>report.country_in.<span style="color:#ae81ff">201807</span><span style="color:#f92672">`</span> <span style="color:#66d9ef">ON</span> NET.REG_DOMAIN(origin) <span style="color:#f92672">=</span> Alexa_domain) <span style="color:#66d9ef">AS</span> crux <span style="color:#66d9ef">ON</span> url <span style="color:#f92672">=</span> CONCAT(origin, <span style="color:#e6db74">'/'</span>) <span style="color:#66d9ef">ORDER</span> <span style="color:#66d9ef">BY</span> rank <span style="color:#66d9ef">ASC</span>, url <span style="color:#66d9ef">ASC</span> </code></pre></div><p>Running the above query returns a lot of data, too much for Google Sheets, so I only analysed roughly the top 16,000 sites (up to about 7k in the Alexa Rankings). Below is the data aggregated without comment.</p> <h4 id="top-7k">Top 7k</h4> <table> <thead> <th>Score Range</th> <th>SEO Score</th> <th>PWA Score</th> <th>Speed Score</th> <th>A11Y Score</th> </thead> <tbody> <tr> <td>0</td> <td>0</td> <td>25</td> <td>149</td> <td>10</td> </tr> <tr> <td>0.5</td> <td>45</td> <td>12253</td> <td>7841</td> <td>3925</td> </tr> <tr> <td>0.7</td> <td>1907</td> <td>3609</td> <td>2725</td> <td>6498</td> </tr> <tr> <td>0.8</td> <td>1713</td> <td>54</td> <td>1188</td> <td>2610</td> </tr> <tr> <td>0.9</td> <td>3016</td> <td>30</td> <td>1180</td> <td>1788</td> </tr> <tr> <td>1</td> <td>9278</td> <td>21</td> <td>2283</td> <td>1157</td> </tr> <tr> <td></td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> </tr> </tbody> </table> <h4 id="alexa-top-100">Alexa Top 100</h4> <table> <thead> <th>Score Range</th> <th>SEO Score</th> <th>PWA Score</th> <th>Speed Score</th> <th>A11Y Score</th> </thead> <tbody> <tr> <td>0</td> <td>0</td> <td>0</td> <td>3</td> <td>2</td> </tr> <tr> <td>0.5</td> <td>0</td> <td>2279</td> <td>1231</td> <td>519</td> </tr> <tr> <td>0.7</td> <td>87</td> <td>703</td> <td>484</td> <td>1348</td> </tr> <tr> <td>0.8</td> <td>199</td> <td>0</td> <td>198</td> <td>587</td> </tr> <tr> <td>0.9</td> <td>375</td> <td>0</td> <td>261</td> <td>302</td> </tr> <tr> <td>1</td> <td>2316</td> <td>0</td> <td>694</td> <td>219</td> </tr> <tr> <td></td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> </tr> </tbody> </table> <h4 id="alexa-top-1000">Alexa Top 1000</h4> <table> <thead> <th>Score Range</th> <th>SEO Score</th> <th>PWA Score</th> <th>Speed Score</th> <th>A11Y Score</th> </thead> <tbody> <tr> <td>0</td> <td>0</td> <td>1</td> <td>19</td> <td>2</td> </tr> <tr> <td>0.5</td> <td>16</td> <td>5471</td> <td>3517</td> <td>1942</td> </tr> <tr> <td>0.7</td> <td>546</td> <td>1867</td> <td>1272</td> <td>2941</td> </tr> <tr> <td>0.8</td> <td>757</td> <td>9</td> <td>507</td> <td>1212</td> </tr> <tr> <td>0.9</td> <td>1077</td> <td>16</td> <td>567</td> <td>719</td> </tr> <tr> <td>1</td> <td>4962</td> <td>6</td> <td>1241</td> <td>550</td> </tr> <tr> <td></td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> </tr> </tbody> </table> <p>I think the tools developers and businesses now have in their hands can make a huge difference to our ability to make reasoned and principled decisions on how users actually feel the experience of the web globally. For me, this data gives me base line that I can look at to see if our strategies for our devrel work influence the ecosystem in the long-term.</p>


This content originally appeared on Modern Web Development with Chrome and was authored by Paul Kinlan


Print Share Comment Cite Upload Translate Updates
APA

Paul Kinlan | Sciencx (2018-08-24T08:19:10+00:00) Using HTTPArchive and Chrome UX report to get Lighthouse score for top visited sites in India.. Retrieved from https://www.scien.cx/2018/08/24/using-httparchive-and-chrome-ux-report-to-get-lighthouse-score-for-top-visited-sites-in-india/

MLA
" » Using HTTPArchive and Chrome UX report to get Lighthouse score for top visited sites in India.." Paul Kinlan | Sciencx - Friday August 24, 2018, https://www.scien.cx/2018/08/24/using-httparchive-and-chrome-ux-report-to-get-lighthouse-score-for-top-visited-sites-in-india/
HARVARD
Paul Kinlan | Sciencx Friday August 24, 2018 » Using HTTPArchive and Chrome UX report to get Lighthouse score for top visited sites in India.., viewed ,<https://www.scien.cx/2018/08/24/using-httparchive-and-chrome-ux-report-to-get-lighthouse-score-for-top-visited-sites-in-india/>
VANCOUVER
Paul Kinlan | Sciencx - » Using HTTPArchive and Chrome UX report to get Lighthouse score for top visited sites in India.. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2018/08/24/using-httparchive-and-chrome-ux-report-to-get-lighthouse-score-for-top-visited-sites-in-india/
CHICAGO
" » Using HTTPArchive and Chrome UX report to get Lighthouse score for top visited sites in India.." Paul Kinlan | Sciencx - Accessed . https://www.scien.cx/2018/08/24/using-httparchive-and-chrome-ux-report-to-get-lighthouse-score-for-top-visited-sites-in-india/
IEEE
" » Using HTTPArchive and Chrome UX report to get Lighthouse score for top visited sites in India.." Paul Kinlan | Sciencx [Online]. Available: https://www.scien.cx/2018/08/24/using-httparchive-and-chrome-ux-report-to-get-lighthouse-score-for-top-visited-sites-in-india/. [Accessed: ]
rf:citation
» Using HTTPArchive and Chrome UX report to get Lighthouse score for top visited sites in India. | Paul Kinlan | Sciencx | https://www.scien.cx/2018/08/24/using-httparchive-and-chrome-ux-report-to-get-lighthouse-score-for-top-visited-sites-in-india/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.