We’ll be the first to admit it, most of us at Kinsta are data junkies. We love looking at large data sets to see if we can spot a new trend, or gain any additional insights into changes that might impact the WordPress hosting industry or our business. Hosting thousands of WordPress sites allows us to have an almost unlimited source of data to continuously track and pull queries from.

Our sysadmin and development teams regularly dig into log files to see if we can improve certain aspects of our MyKinsta tools and services for clients. For example, one way we use this data is to implement better filters against bad bot traffic and crawlers. What we learn goes directly into our MyKinsta Analytics tool. Therefore, this data can actually help save you money on your hosting plan as we improve the quality and accuracy of our filtering and visits measurements.

We analyzed 13 billion (that’s right billion) log entries, and this time around we’ve decided to share all of our findings with you! We split the stats into three different sections: access logs, cache performance, and PHP engine.

The data below is compiled from thousands of WordPress sites hosted on Kinsta servers. Most of the percentages in the charts are rounded to the nearest point. None of the data shared is PII.

Access Log Stats

Out of the total 13 billion entries (rows in a log file), we analyzed 8 billion access logs.

The log entries contain what we call “requests.” This is different than visits, as our raw access logs are tracking the IP addresses that request resources from a website. For example, Google Analytics automatically filters out a lot of bad traffic, trying to show you the best estimation of real human visits to your website. Log stats include every type of request that directly hit the server, from browsers requests to bad bots and search engine crawlers.

Desktop vs Mobile vs Everything Else

We first analyzed all of the requests from desktop browsers, mobile browsers, and everything else. To do this, we looked at the HTTP header known as the user-agent. A user-agent is basically a string of text that identifies the browser and or operating system when it connects to the web server.

It will typically look something like this: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.109 Safari/537.36. You can see the user-agent in the response header in a tool like Pingdom or Chrome DevTools.

user-agent

user-agent

The one downfall in regards to the user-agent in log files is that it can easily be spoofed. This is one reason why you might see “Other” in some of the stats below.

Just like with Google Analytics, where you probably aren’t seeing all of your data due to ad blockers and GDPR cookies (some have reported not being able to see upwards of 60%!), you simply have to use the data you can see and make strategic decisions based off of it.

In our logs, we saw the following number of requests:

Desktop vs Mobile vs Everything Else

Desktop vs Mobile vs Everything Else (click to view larger)

It’s interesting to see that desktop is still number one in terms of the most requests to sites hosted at Kinsta. While mobile is growing fast, it still definitely varies based on the industry you’re in.

For example, over 80% of visits to our Kinsta site is from desktops. Our site is fully responsive and fast on mobile, but when it comes to looking for WordPress hosting, people don’t want to do it on their phones. Hosting is one of those commitments most people prefer to still sit at their desktops.

So by all means, you can hop on the mobile bandwagon, but don’t forget to consider how your customers actually purchase your product.

Desktop 🖥️

Next, we looked at the 3.3+ billion requests from the user-agent based on the type of desktop browser.

You can see that Chrome was leading the pack at 53% of all requests. This wasn’t a big surprise as other sources, such as statcounter and NetMarketshare both show Chrome having over 60% of the market share.

Firefox, of course, came in second. But the one that really surprised us was Microsoft Edge at 5%. At least among sites hosted at Kinsta, Microsoft Edge seems to be slowly gaining more market share. Microsoft also announced in December 2018 that it’s rebuilding its Edge browser on Chrome and bringing it to Mac.

User-agent desktop

User-agent desktop (click to view larger)

Mobile 📱

We then looked at the 3.1+ billion requests from the user-agent based on the type of mobile browser.

This one actually surprised us. For WordPress sites hosted at Kinsta, the mobile version of Safari is used the most with over 1 billion requests. While Chrome is a close second, it’s still not very often that you see Safari dominating the pack. This simply means a lot of people are browsing Kinsta hosted sites on their iPhones.

User-agent mobile

User-agent mobile (click to view larger)

Operating System

Next up, we analyzed all of the requests from different operating systems: desktops vs mobile.

Desktop 🖥️

We looked at the 3.3+ billion requests from the user-agent based on the type of desktop operating system.

Windows is the most used operating system amongst visitors browsing sites hosted at Kinsta (with over 2 billion requests). And not surprising, Mac OS X came in second.

Desktop Operating System

Desktop Operating System (click to view larger)

The odd one is that we are still seeing some requests from Windows 98. 😳 Remember though, you have to take the user-agent data with a grain of salt as it can be spoofed. But it’s also an important reminder that many developing countries and corporations are still running on older operating systems. Not everyone has a brand spanking new MacBook Pro.

Mobile 📱

Next, we looked at the 3.1+ billion requests from the user-agent based on the type of mobile operating system.

While Windows is winning the desktop OS war, iOS is the most used mobile OS hitting Kinsta hosted sites. With Android coming in at a close second. People do love their iPhones. 😉

Mobile Operating System

Mobile Operating System (click to view larger)

HTTP vs HTTPS 🔒

We then looked to see how many websites were serving requests over HTTP vs HTTPS.

As you can see, 87% of all requests from sites hosted at Kinsta are running over HTTPS. According to W3Techs, only 48.2% of all websites are using the HTTPS protocol. We are glad to see that the ratio at Kinsta is much higher than the average! 👏 This, of course, is partially thanks to Let’s Encrypt, as SSL certificates are now free. Kinsta clients can install SSL certificates with a few simple clicks (here’s how to install an SSL certificate on WooCommerce)!

HTTP vs HTTPS

HTTP vs HTTPS (click to view larger)

Over 87% of all requests from sites hosted at Kinsta are running over HTTPS. Here's to a more secure web! 🔒Click to Tweet

www vs non-www

We were curious to see how many sites were running www vs non-www, so we looked at the data.

As you can see, 57% of sites at Kinsta are running non-www.

Using www as part of your domain used to be the standard back in the day. But that is not necessarily true anymore. Even we don’t use www here at Kinsta. One reason you still might see www being used a lot is simply that changing it after using it for years can be complex and cause issues. So a lot of older brands simply continue to use it.

www vs non-www

www vs non-www (click to view larger)

Another reason large companies with a lot of traffic might want to use www is due to DNS. Naked domains (non-www) technically can’t have a CNAME record used in order to redirect traffic for failover. However, there are workarounds to this issue.

So when it comes down to www vs non-www it is more a matter of personal preference. Perhaps you prefer shorter URLs in which case you could go with the non-www. Remember, no matter which version you choose you can set up redirects so that each is accessible. For example, if you visit www.kinsta.com, it simply redirects to kinsta.com.

Social Media Traffic

We then looked to see which social media networks were sending the most traffic. Note: This is only the top 7.

As you can see, Facebook pretty much dominated the social media game with it sending 79.5% of the requests. Pinterest came in second with 13.7%. If you haven’t tried Pinterest yet and have a business that might work well on there, it’s something to definitely check out.

Social media traffic

Social media traffic (click to view larger)

Response Codes

HTTP status codes, also known as response codes, are like a short note from the web server that gets tacked onto the top of a web page. It’s not actually part of the web page. Instead, it’s a message from the server letting you know how things went when the request to view the page was received by the server.

If you’re a Kinsta client, you can view all sorts of charts and data in MyKinsta Analytics pertaining to response codes for your WordPress sites.

Response codes in MyKinsta Analytics

Response codes in MyKinsta Analytics

We were curious to see which response codes were returning the most of, so we looked at the data.

200 Response Codes

2xx success codes are returned when browser request was successfully received, understood, and processed by the server. Out of the 5.6+ billion 2xx response codes, here was the distribution.

You can see that a 200 response code was returned the most. This means that “Everything is OK.” It’s the code that is delivered when a web page or resource acts exactly the way it’s expected to.

2xx HTTP response status codes

2xx HTTP response status codes (click to view larger)

300 Response Codes

3xx redirection codes are returned when a new resource has been substituted for the requested resource. Out of the 3.6+ billion 3xx response codes, here was the distribution.

You can see that a 301 response code was returned the most. This means that “The requested resource has been moved permanently.” This code is delivered when a web page or resource has been permanently replaced with a different resource.

3xx HTTP response status codes

3xx HTTP response status codes (click to view larger)

It’s not surprising that out of the 3xx response codes, a 301 is the most widely seen one, as it’s used for permanent URL redirection for SEO purposes.

If you’re a Kinsta client, you can use the Redirect Tool in MyKinsta to easily add as many redirects as you need. It supports regex and is better for performance, as the redirects are added at the server level, and you no longer need a WordPress redirect plugin.

WordPress redirect tool

WordPress redirect tool

400 Response Codes

4xx response codes are client error codes indicating that there was a problem with the request. Out of the 4.8+ billion 4xx response codes, here was the distribution.

You can see that a 404 response code was returned the most. This means that “The requested resource was not found.” The most common error message of them all. This code means that the requested resource does not exist and that the server does not know if it ever existed.

4xx HTTP response status codes

4xx HTTP response status codes (click to view larger)

Seeing a 404 response code as the highest was not surprising to us. This is simply due to the fact that so many WordPress sites have broken links on them. A lot of times WordPress site owners simply can’t keep up with the changes or don’t know how to properly check for and fix these. Check out our in-depth tutorial on how to fix 404 errors.

Kinsta 404 page

Kinsta 404 page

Besides usability, another reason these errors are bad is that many 404 pages are very resource-intensive, which impacts performance. For large sites, you’ll want to avoid a heavy 404 page. Create a simple 404 template that avoids querying the database any further if possible.

500 Response Code

A 500 server error code indicates that the request was accepted, but that an error on the server prevented the fulfillment of the request. Out of the 8 billion requests, here was the distribution.

This means that “There was an error on the server and the request could not be completed.” A generic code that simply means “internal server error”. Something went wrong on the server and the requested resource was not delivered.

This code is typically generated by third-party plugins, faulty PHP, or even the connection to the database breaking. Check out our tutorials on how to fix the error establishing a database connection and other ways to resolve a 500 internal server error.

500 HTTP response status codes

500 HTTP response status codes (click to view larger)

One thing we love about WordPress is that there are thousands of amazing plugins to choose from. However, they are also usually one of the things that cause the most 500 errors.

Search Engine Crawlers

Remember the “1.5+ billion requests from everything else” we looked at in the beginning of this post? We then looked at the distribution of search engine crawlers within that.

As you can see, Google is the number one search engine crawler of sites hosted at Kinsta. This really isn’t surprising as Google is by far the biggest search engine on the web (even though it’s not the only one). According to statcounter, Bing only maintains 2.4% of the search engine market share.

The fact that 36% and or 200+ million requests are coming from Bing, means that they are still indexing a lot of data and perhaps even crawling at a more frequent pace. In other words, just because Bing isn’t as popular, doesn’t mean it isn’t indexing and crawling a large amount of data!

Search Engine Crawlers

Search Engine Crawlers (click to view larger)

Static Files

We were curious to see which file types were being requested the most by Kinsta hosted WordPress sites. Here were there results.

Struggling with downtime and WordPress problems? Kinsta is the hosting solution designed to save you time! Check out our features

JavaScript files (.js) are the number one requested file type by Kinsta hosted sites. While most of these results weren’t too surprising, it was interesting to see over 2 million requests for .webp files (Google’s new smaller image format) and how .jpg topped .jpeg with over 1 billion requests while the second going north of 21 million only (read why here: jpg vs jpeg). Kinsta supports WebP and we’ll have some more information coming out soon about this! 😉

Static files

Static files (click to view larger)

SEO Tools (Crawlers and Bots)

Next, we wanted to take a look at the requests from the 2.4+ billion SEO crawlers and bots. These tools are continuously hitting WordPress sites as they gather backlink data for their databases, as well as running SEO audit tools.

SEMrush had the most requests against Kinsta hosted sites with a whopping 98+ million. Ahrefs came in a close second with 86+ million requests. The statistic that surprised us the most here was how low Moz was. We would have assumed there would have been a lot more. However, remember this doesn’t pertain to their index size. It could be they are simply crawling more efficiently.

Many don’t realize just how much these types of SEO tools are hitting their WordPress sites. The answer is, a lot! Remember, if you’re a Kinsta client, we don’t count these against your billable visits.

SEO tools

SEO tools (click to view larger)

Ahrefs is one of our favorite SEO tools! Check out how we cleaned up a negative SEO attack with it.

GeoIP Stats

Next, we were curious where the most requests were coming from geographically, so we pulled the data.

Probably not to anyone’s surprise, the most requests from Kinsta hosted sites came from the United States, with over 3 billion!

While we have clients all over the world, we were actually surprised by just how evenly spread the requests of the top 19 were.

GeoIP top 20

GeoIP top 20 (click to view larger)

Cache Performance Log Stats

Out of the total 13 billion log entries, we analyzed 5 billion cache performance logs. These stats give insights into how WordPress sites are actually performing in terms of whether a site is serving from cache or not. Remember, in general, you want your WordPress site to serve as much of its content from cache as possible. This is what will ensure you receive lightning-fast load times!

Membership and eCommerce sites are known for a lot of uncacheable content, and this is exactly why you can’t treat these types of sites the same way you do say a blog with a lot of static content. Check out our in-depth post on the do’s and don’ts for hosting WordPress membership sites.

Cache Stats

Whenever a site at Kinsta is delivered to a browser, it contains a x-kinsta-cache response header to display the status of how the cache was delivered. You can see this with a tool like Pingdom or Chrome DevTools. A “HIT” means the request is being served from WordPress cache. This is typically what you want to see.

Cache HIT response header

Cache HIT response header

So we pulled all the data to see the status of how cache was being delivered across the board.

The results were exactly what we wanted them to be and what they should be. The highest number of requests by a mile were all serving from cache (HIT response), with over 1.7 billion. This is great! The second highest was BYPASS. These requests usually include a WordPress login page, a check out page on an Ecommerce site, etc. There are certain areas of WordPress sites that aren’t cached on purpose to ensure functionality.

Cache stats

Cache stats (click to view larger)

A MISS means that the cache simply isn’t there yet. For example, when you clear your cache on your WordPress site, the cache has to rebuild. This happens when a visitor hits the page or post again for the first time. The subsequent visits after that are then served from cache, registering a HIT.

The mobile version pretty much followed the exact same pattern across the board.

Cookie Categories

Have you ever wondered how a WordPress host determines which areas of a site shouldn’t be cached? The answer in a lot of cases is cookies. 🍪

For example, on WooCommerce and Easy Digital Download sites, cookies such as woocommerce_items_in_cart cookie and edd_items_in_cart are placed in a user’s browser when they add an item to their cart. When these cookies are detected on the Kinsta platform, the cache is automatically bypassed to ensure a smooth and in-sync checkout process. There are different kinds of cookies that are used to bypass cache, below are a couple we queried.

The number one type of request, with over 3.9 billion, were those from a misc cookie. What does this mean? Usually, this is a third-party plugin that contains their own named cookie to bypass cache.

One thing that is interesting is that there are more EDD/WC cart cookies than actual logged in cookies. This is most likely due to the fact that a lot of the WordPress sites we host at Kinsta are eCommerce in nature. Also, most of you probably don’t login into your WordPress site that often (you are probably already logged in for most of the day). But there are always customers shopping!

Cookie categories

Cookie categories (click to view larger)

PHP Engine

According to the official WordPress Stats page, over 57% of WordPress users are still on PHP 5.6 or lower. This is scary! Not only is it bad from a security perspective, but also because there is still a large portion of WordPress sites that aren’t taking advantage of the additional performance enhancements with PHP 7.

We thought it would also be interesting to see the distribution of PHP versions that are being used at Kinsta. Here’s what we found.

If we look at the sites running at Kinsta, over 75% of WordPress sites are using PHP 7.2 or higher. These are the stats we love seeing. 👏

PHP engine

PHP engine (click to view larger)

From our findings (see our PHP benchmarks), PHP 7.3 is on average 9% faster than PHP 7.2. And if you compare PHP 7.3 to PHP 5.6, it can handle almost 3x as many requests (transactions) per second!

If you’re a Kinsta client, you can easily change PHP versions from within the MyKinsta dashboard, under Tools, with a single click.

Change to PHP 7.3

Change to PHP 7.3

Over 75% of WordPress sites at Kinsta are using PHP 7.2 or higher. Come join the fast crowd! 🚀Click to Tweet

Summary

From the above data we can conclude a few interesting things about sites hosted at Kinsta:

We hope you enjoyed all these stats! We sure did. If you’re curious, we used good ole’ Microsoft Excel to generate all of the charts above.

Are there any stats you would like to see that we perhaps didn’t include? If so, let us know below in the comments and we’ll see what we can do.


If you enjoyed this article, then you’ll love Kinsta’s WordPress hosting platform. Turbocharge your website and get 24/7 support from our veteran WordPress team. Our Google Cloud powered infrastructure focuses on auto-scaling, performance, and security. Let us show you the Kinsta difference! Check out our plans