Right away, one of the things you'll discover with Raygun is that it isn't just a "error monitor" service, but it also does a really good job of giving you feedback on your performance as well. Website performance is becoming more and more important lately, especially with the advent of PWAs. There are multiple different tools out there to help you diagnose and track performance issues, so having something tied in with your error handling is pretty compelling. I'll show examples of both of these with Raygun so you can get an idea of how it works. On top of error tracking and performance, they also do pretty cool user monitoring and tracking (including real time reports) and have features that tie into your deployments. Why? To help figure out if something got better or worse based on a new release of your site.
So before we go into some screen shots (all based on reports from this blog), you will want to take a look at their pricing information.
That is a bit high for a one person blog like raymondcamden.com, but also note that it covers the entire platform of features. If you just want the error reporting (crash reporting), the low end price is a really reasonable - 19 dollars at the time I wrote this.
This is the main dashboard. It's clean and direct and really highlights the important data points. On the top bar two things stick out right away. First, my performance is poor (which was surprising!) and that for the most part, my site is error free. Seeing that 99% of people are not getting errors is great.
As a quick aside, the entire site renders really freaking well on mobile too, which is great if you need to look at an error report from your mobile device.
Let's look at the bug reporting:
You've got a chart showing you reports over time as well as multiple ways to filter your errors down to find particular items. Individual reports are very nicely designed too:
I love the comment feature at the bottom. Even in a one person team, I could see using that to add notes about a bug. Like - maybe I don't have time to dig into it now, but I've got some ideas as to what the issue could be. I could use the comments as a way to jot down some notes until I get a chance to return to it.
In this particular report (and I realize it is probably too hard to read in the screen shot above), the error is coming from a Chrome extension, so while it's on my site, it isn't necessarily my issue. Raygun supports blocking errors from being reported again. There is also an "Inbound Filters" feature where I could add a block on any message containing
chrome-extension:// if I wanted.
There's a nice report system for designing custom reports and the ability to export your errors into a zip file for your own processing. Speaking of processing, there are also a crap ton of integration features too:
Finally, I'll share a screen shot of a typical email report. While this is a standard feature of such services, I just share yet another example of how much attention was given to design. Make note of the quick actions links on the bottom.
Real Time Monitoring
Now let's look at the real time reporting. There is a wide array of data here covering performance, browser and platforms, and location. Here's an example of it reporting on browser usage.
But the important report is the performance tab:
Frankly, this is disappointing. I honestly thought my site was performing well. I went into one of the pages to get some details. In one report, I saw a breakdown like so:
- DNS: 3%
- Latency: 6%
- SSL: 0%
- Server: 7%
- Transfer: 1%
- Render: 22%
- Children: 60%
Children? I wasn't sure what that was but it concerned me. I checked the performance docs and it defined children as "Time for asynchronous assets to process - this refers to all requests loaded by the page up until onLoad (includes scripts, stylesheets, images and XHR requests)". I spent some time digging here and found some stuff right away that I had not noticed.
First - I was loading my avatar picture twice. Why? The responsive design layout had it twice in the DOM. That wouldn't be a problem if I was using the same URL, but I had updated the avatar URL and missed the other location. Sigh.
I also noticed that all of my Amazon S3 images were taking a good second each to load. That seems high. I'm using Cloudfront in front of S3 but why isn't it faster? Is that expected? I don't know but I need to dig.
Finally, I also saw a lot of XHR requests. I only do one intentionally, but all of my external services, included Raygun, are also doing them too. Disqus seems to be a particular abuser. I can't really drop Disqus though as I do like the comment platform.
All in all, this is a really good service. Keep in mind I only covered a portion of it and there is quite a bit more. It does seem to bit pricey, but honestly, it feels appropriately priced for what is provided, and the design by itself makes it a pleasure to use. As always, I'd like to hear from my readers if they have any experience with Raygun, good or bad. Just leave me a comment below. Now I'm off to fix that double avatar issue!
Header Photo by Mitchel Boot on Unsplash
I realize this is Enterprise level stuff -- but it really peeves me when something like this doesn't have a "free" or "hobbyist" pricing tier.
What places like this don't realize is that most developers are happy to try something out on their own -- and then take it to the paper-pushers when they think it's awesome and something worth spending $$$ on.
Contentful (for example) is a great example of this thinking. The hobbyist tier is free and generous, and I've started to build side projects with Contentful now (connecting to Gatsby, for example) that have made me realize -- yeah, this is a useful, fantatistic thing. As a result, I'm pushing this as a production level thing that we should budget for.
Raygun seems cool -- and I've love to try it -- but there's no way to do this (at least none that I can tell from their bottom of the page pricing list). Frustrating -- and (IMHO) a bit backwards these days.
Great article, though. :)
I'd check the tier just for crash reporting. As I said, it is 19 bucks a month which is absolutely within the hobbyist level imo.