Clicky API v4 released

In addition to the new wordpress plugin, today we're also releasing version 4 of our analytics API. We've got some really great new features outlined below. Full documentation is here.

  • Segmentation data!
    Example: Summary data + top countries and web browsers for visitors from over the last 7 days

  • Data for individual items (e.g. a specific country or search term). Note, this is different than the existing "filter" parameter, which is a wildcard (i.e., slow) match. This is an exact match string and hence very quick.
    Example: Daily hits from

  • Hourly data for supported data types (visitors and actions)
    Example: hourly data for both visitors and actions over the last 7 days

  • Option to specify only the fields you want returned for type=visitors-list. This is a big one because we have a number of users who export their entire visitors-list every day. They may only want a few fields, but had to get all of them no matter what. If this applies to you, this new option will vastly speed up the response time for visitors-list queries.
    Example: Only return IP, session ID, landing page, location, and browser

  • Proper error responses. It's hard to believe that up until now, a bad request would just return completely empty. How helpful of us! Now, if there are any problems with your request, an error will be output.
    Example: Forgetting the required "type" parameter. XML PHP JSON

  • The XML parent element has been changed from "items" to the more standard "response". This parent element also has a new attribute, "status", whose value will either be "ok" or "fail". If it is "fail", there is an error with your request. The XML document will then have just one element, "error", whose value will be the error message. For PHP and JSON, which both return arrays, the array will only have one item, whose key will be "error" and whose value will be the error message.

  • We've added a ton of inline examples throughout the documentation, so instead of perhaps being confused about what a certain feature does, you can just click a link and instantly see an example.

The two big features for us are segmentation, and being able to specify a individual items. With these, and everything else, we feel the API is much stronger than v3.

We like APIs. They're neat.

We're going to be adding some more APIs in the near future that let you get information about your account, as well as the ability to write data to Clicky, instead of just reading from it. For example, registering new sites, updating site preferences, creating goals, etc.

We're releasing one today as a sneak peak. This is something that those of you with lots of sites may find quite useful. It's called "sites". (We're really creative). Pass it your username and password, and it will return to you all of the sites in your account, including their domain name, nickname, site_id, sitekey, sitekey_admin, and database server.

For example, here's a pretend account I just registered.

And with PHP output:

Happy Halloween weekend!

Don't drink too much! We'll see you in November.
0 comments |   Oct 30 2009 3:18am

New Clicky Wordpress plugin released!

Well that was fast! Thanks to Yoast for his efforts, he completed this in less than 12 hours from the time he started working on it. He's pretty good. In addition to the existing features (outputting tracking code, tagging your visitors, and ignoring admin visits), our new WP plugin boasts the following awesome new features:

  • View stats from within your WP dashboard
  • URL shortener integration
  • Option to automatically post new stories to your Twitter account with a short URL when new stories are published
  • Goal integration (bonus!)

This requires WP 2.8 or higher. It has been thoroughly tested by myself and Yoast, but, there may be random issues we didn't encounter, or compatibility problems with other plugins. If you have any problems at all, please post them here so we can try to fix them as fast as possible.

If you have the old plugin installed, delete it before installing this one!

Download the new Clicky Wordpress plugin here

43 comments |   Oct 30 2009 2:44am

$1,000 for a new Clicky WordPress plugin

Update: Thanks to all of the people who applied for this. We have selected our developer, and development is already in progress. Thanks for all of your interest.

Our WordPress plugin seems to have serious compatibility issues with 2.7 and beyond. It's also lacking a couple of features we wish that it had. We find the WP API very difficult to work with and wish to never lay eyes on it again. Therefore, we are offering $1,000 to a qualified WP plugin developer to make the plugin of our dreams.

You need to be very experienced with the WP API, and must have developed at least one major (semi-popular) plugin, or several more minor ones. You also must be the type of person who believes code is a beautiful piece of art, because if there's one thing that gets my goat, it's messy code.

The current plugin just outputs the tracking code in the footer, and has a couple of options - automatically tag visitors who have previously left a comment (by grabbing a cookie that WP sets for commenters), and ignore visits from admins of the site. The new plugin, that you will be rewriting from scratch, needs to have that same functionality, as well as the following new features:

  • A page to view stats within the WP admin page, via an iframe that points to our site. We will be creating a special page that this iframe will be pointing to, so we (Clicky) are in control of how this page looks and are able to update it as necessary.

  • API integration. Whenever a new story is posted, we want the author to have the option to automatically create a short URL with our API and post it to Twitter via their API. This means the user will need to have a space to enter their Twitter username and password, and if they have done so, we want this option (a checkbox at the bottom of the story creation page) enabled by default.

We also need you to support it up through and including WP 3.0, so we can ensure it works perfectly for at least the next 6-12 months. By support, we are not talking about supporting our users. We mean you will be willing to update it, for free, if any updates to the plugin API break compatibility up through and including WP 3.0.

If you are interested, and qualified, please send an email to Sean, titled "wordpress plugin", with your credentials/experience. Don't be offended if you don't get a response. We will be looking over all submissions but will only be contacting the top few candidates to narrow it down to the best one and then start the process.

We prefer to pay via Paypal if possible, and if you are outside of the US, this is the only payment method we can provide. If you have a US address, then we can also pay by check, if you prefer.
18 comments |   Oct 26 2009 1:10pm

Infrastructure upgrades nearly complete

Like we said, nothing exciting for a while. We've been working behind the scenes massively improving our infrastructure and updating some problem servers for greater reliability, and some old servers so they're much, much faster. We're not quite done, but here's the story so far:

Tracking servers

In each of our tracking servers, we doubled the RAM and added much faster drives to store the incoming traffic data. Initially there were a few problems but they were resolved.

As an update to that story, the problems we mentioned were related to the file system we were using, Ext3. The upgrades we initially made did help with performance, but load on the servers was still much higher than we thought it would be. After many hours of research, we discovered that this file system, which is the default for almost any Linux installation, isn't well suited to storing, updating, and deleting thousands of tiny files 24/7. It turns out the file system of our dreams is called ReiserFS. Article after article said check it, this file system is amazing for dealing with thousands of tiny files - use it if that's what you're doing. So we did.

We reformatted the drives that store our incoming traffic data to ReiserFS and the results were stunning. Load plummeted to levels we haven't seen for well over a year. So this was actually the biggest bottleneck of our existing setup, but that isn't to say our RAM and hard drive upgrades were fruitless. Before we discovered ReiserFS, the hardware upgrades still made a significant difference - just not as big as we thought they would, which is why we kept researching. Once we added ReiserFS into the equation, the results were what we were hoping for.

We also made a couple of very major efficiency improvements to the code that logs incoming traffic. The tracking servers are currently in a state of bliss and thanking us kindly for helping them work more efficiently.

Software to Hardware RAID migration

In the last 6 or so servers we built, we were using Linux's built in software RAID to mirror a pair of drives. Software RAID has served me well in the past but it doesn't seem to be quite as reliable for extremely heavy read/write drives. About once a month, we had a RAID failure which would almost always lead to one of our biggest database tables on that server having corruption. So we'd have to take that server offline and repair the 1 or more tables with corruption, which is a slow process to say the least.

A Redundant Array of Independent Disks is supposed to prevent this type of thing. A drive popping offline should be no problem - you either replace it or re-add it to the array and it rebuilds and nothing noticeable happens from the end user's perspective. But this wasn't the case with our Linux software RAID servers.

The main reason we went with software RAID was for cost savings. Not that hardware RAID is that expensive, but it adds about 15% to the cost of each server we build. So, no more software RAID. All servers that had this setup have been migrated to hardware RAID. All of our older servers use hardware RAID and they've never had a single problem.

Upgrades to old servers

As I just mentioned, none of our older servers have ever had any problems. On the other hand, they're all a bit slow, as they're not using drives meant for high performance. The database servers affected most by this were 2, 3, 5, 6, and 7.

We've migrated 2, 3, and 5 to much faster drives. If any of your sites are on these servers, you should notice very significant speed improvements when viewing your stats. We haven't yet migrated 6 or 7. We currently only have 1 spare server ready to host the data from another one. db7 seems to be slightly slower than db6 so that is the one that will be getting the upgrade first, this coming weekend most likely.

Next week, I will be at our data center again building some new servers, hopefully for the last time for a while! At this point, db6 will be moved to new hardware. db12 will also be moving, as it's also on slower drives. db12 is much newer than these others ones so it has less data, which means the speed is still acceptable - but that's only for now. Over time its performance will slowly degrade as well, so we're just going to move it now.

Once that is completed... we'll be done!!!

Well that was fun!

Actually, not really. This is the type of work that is opposite of fun. I've built so many new servers and installed Debian Linux so many times the last month, it's probably some kind of world record. But, that's ok - all of this needed to be done, Clicky is much better because of it, and we hope you have noticed the improvements.

Now, we can get back to working on the software, which is what we really live for. Look for some great new features soon!
8 comments |   Oct 21 2009 11:39am

Clicky crushes it!

Gary Vaynerchuk is one of our first customers. I don't know how he ever found out about Clicky so early in its life - he registered way back in Feb 2007, when we were absolute nobodies - but we've always been psyched to have him as a customer, because we're big fans of everything he does.

He's on tour right now for his new book Crush it, and tonight the tour hit Portland, Oregon, where we are based. We stopped by to watch him speak and take questions from the audience for about 90 minutes. And of course, we grabbed a couple copies of the book. It was awesome to meet him and his signature on my book made my day. To have the absolute king of social media be so passionate about our product means a lot.

Thanks Gary! Good luck with your book, although we know you won't need it.

8 comments |   Oct 19 2009 11:17pm

Next Page »

Copyright © 2018, Roxr Software Ltd     Blog home   |   Clicky home   |   RSS