The Go Test It Blog

Google Chrome support, and a bug in Apple's website exposed

It has been an exciting start to the new year at Go Test It. We are currently making contact with many people who have used Go Test It or who are interested in it, and speaking to them on the phone or visiting them in person. Our goal is to learn how people in a range of different organisations work and what problems they face, and the things we are learning are determining our roadmap for 2010.

This means that at the moment our focus is on learning, not on building new features. Sorry if you have asked us to do something but it hasn’t happened yet: I’m sure you’ll understand that we don’t want to clutter Go Test It with complicated features which hardly anyone would use, hence our research into what people really need.

However, one of the things which we found we did need to support is Google Chrome, and I’m pleased to announce that Google Chrome on Windows is now available on Go Test It. Any tests you already have should work fine on Chrome – just tick the box and run them!

Selecting Google Chrome in Go Test It

Of course, the tests will only work fine if your website actually works correctly on Chrome. And although Google have done a great job of making a standards-compliant browser and compatibility problems are rare, you can never be sure without testing it.

One example of a website which does not work at all in Chrome is Apple’s iPhone reservation site. It works fine on Firefox, Safari and Internet Explorer – but on Chrome, you can’t get past the first page.

The Apple iPhone reservation site in Google Chrome

No matter what you choose from the two drop-down menus (store and plan type), the “choose your phone” section always stays dimmed. If you try to continue to the next page, you get an error, and you still can’t choose which type of phone you want to reserve. You are completely stuck, and the only way out is to go and find the same page in a different browser. You can’t even copy and paste the URL into a different browser.

(Incidentally, the error message is also wrong: it says “Please select a store” if I don’t select a phone.)

How many customers is Apple losing because of this problem? Who knows. Don’t let this happen to you. Go test your website now.

This post was written by Martin Kleppmann, founder of Go Test It.

Red Gate acquires Go Test It

Red Gate logo

For over two months now I’ve had to keep biting my lip in conversations, because of a very powerful development happening behind the scenes in the world of Go Test It. I could barely contain my excitement… And now, at last, the news is out: Red Gate Software have agreed to acquire Ept Computing, the company behind Go Test It!

We decided to tie the knot for several reasons. Red Gate make a range of tools for developers, DBAs and sysadmins, with a focus on simple use and powerful results – much the same philosophy as we carry for Go Test It. Whilst testing tools are not currently part of the palette, we expect that our product will complement Red Gate’s product range very well, and potentially pave the way for expansion into new market segments.

For customers and suppliers of Go Test It, all stays the same for now: our team is continuing to work in the same way, and I personally will definitely continue working on the product full-time for another 10 months at least (during which we will gradually hand over to people in Red Gate who are without doubt better than me). Over the next months you will also see a lot of progress: as a part of Red Gate we have access to many excellent people and resources, and together we will work towards being the undisputed leaders of cross-browser testing. Watch us make Go Test It so great that you’d be crazy not to use it!

As it happens, Red Gate is not new to web application testing: a few years ago, they had a load testing tool called ANTS Load, but it was discontinued for a variety of reasons. With the acquisition of Go Test It, Red Gate is re-entering this market with a fresh perspective and renewed inspiration.

We’ve also known each other for a while – in fact, some of the Go Test It developers, along with other startups, have been borrowing desks from Red Gate for more than 8 months already. Our unique arrangement is so cool that even Joel Spolsky wrote about it. Through the Springboard incubator, Red Gate were able to track Go Test It’s progress month by month, and were thus in a uniquely informed position when the possibility of an acquisition was considered.

Right now, Red Gate focusses on companies working on Microsoft platforms; maybe we will give a similar focus to Go Test It, maybe not. Where the market will lead us we do not know, but we are definitely listening. Tell us in the comments: what do you want from Go Test It? Or drop me an email – I look forward to hearing from you.

This post was written by Martin Kleppmann, founder of Go Test It.

Ending Browser Pain on the Startup Success Podcast

The Startup Success Podcast

I was lucky to get a chance to be interviewed by the great Bob Walsh, founder of StartupToDo, and author of the Web Startup Success Guide (review by Joel Spolsky, review by Neil Davidson).

The interview is for the Startup Success Podcast, a series of shows providing a wealth of useful information and inspiration for startups. In this episode, Patrick Foley talks about his visit to the Microsoft Professional Developers Conference (PDC), and I talk about Go Test It – what it is, how it works, why we built it, where it is going in future. There’s even a special discount in there! :)

Head over now to the Startup Success Podcast and listen to the episode! (The interview with me starts at about 15 minutes in.)

This post was written by Martin Kleppmann, founder of Go Test It.

Testing web applications behind firewalls

Go Test It is a hosted service: we provide all the test machines and web browsers through our test infrastructure. That’s incredibly convenient because you don’t need to waste precious hours of your life debugging test machine issues and installing system updates – we do that for you.

However, you still have to host the application you want to test yourself. If you’re testing a public-facing production website, that’s no problem – our test servers can access the site like any regular user. But chances are that you want to test development, staging and pre-production versions of your application, and you’ll typically be running them on a server inside your organisation’s network.

The good news is that this is normally not a problem. With the following 3 steps you can give us access to a specific testing server:

  1. Identify the name of the test server on your internal network, and the port number on which the test version of your application is running. Then ask your IT department to forward a port on your organisation’s public IP address to this internal server and port. This is a standard feature supported by most routers, and should take your IT guys only a couple of seconds to set up. Note the public IP address and external port number which are set up.

  2. Make it secure by locking down the source IP addresses which may access this service. That way only our test servers can see the test version of your site, but nobody else on the internet can. Ask your IT department to only allow access from the following IP addresses:

    93.93.131.122
    79.125.54.3

    (More addresses may be added in future as we grow our infrastructure.) Restricting access by IP address is a standard feature of firewalls and should also take no more than a few seconds to set up.

  3. In your Go Test It account, click “run test now” and choose the scripts and the browsers you want to use. At the bottom of the page, there is a box where you can enter your target server. For example, if your organisation’s public IP address is 12.34.56.78 and the external port set up by your IT department is 9999, you would enter http://12.34.56.78:9999 in this box.

    Screenshot of target server form

    You only need to enter these numbers once – the next time you want to run a test, you’ll see your internal test server as one of the choices.

And that’s it! From now on you can take advantage of the Go Test It infrastructure, even if your server is behind your corporate firewall.

This post was written by Martin Kleppmann, founder of Go Test It.

Introducing Go Test It – Our new screencast

Go Test It is really easy to get started with. However, saying that is one thing; showing it in action is another matter!

When we launched at Future of Web Apps in London two weeks ago, we had prepared a screencast showing off how quickly you can record, edit and play back a cross-browser test script in Go Test It. We used the screencast at our exhibition stand and for the demo on stage.

Several of you have asked us for the screencast. So I have now made a new version which is expanded (it includes a demo of our Ruby scripting feature) and narrated with an explanation. It’s just over two minutes, a whirlwind tour of our features. Watch it now:

If you can’t see the video, please view it on Vzaar or on YouTube.

Here’s a transcription in case you’re not able to hear the audio.

Hello, this is Martin Kleppmann. I’d like to show you how you can use Go Test It to make sure that your website works correctly in various different browsers.

With Go Test It you can record a script of a user interacting with your site. In this example we’ll use Wikipedia, but you would type the address of your site, or your testing server.

We want to check that when you type in the Wikipedia search box, the drop-down suggestions work correctly. So we’ll open up the front page, type something in the box, click on the first suggestion. The test recorder picks up all those things. Then we can check whether a certain text appears in the page, to make sure the right one was loaded.

And there’s your first test script!

Now test whether the drop-down suggestions work in other browsers. Fortunately, Go Test It has a range of browsers already set up, so it doesn’t matter what’s installed on your own computers. Just click “run now”; we’ll fire up the browsers and point them at your server.

This takes a few minutes, and when it’s done, we send you an email with the results. The email includes a summary of what succeeded and what failed, and even includes screenshots. You can click through to the details for each test run, where you can see step-by-step what happened. We automatically take full-size screenshots along the way so that you can also check that everything looks correct.

Let’s have a look at another example.

In this one, I have pre-recorded a longer script. When you edit it in the test recorder, you can see how we identify the parts of the page to interact with. You can use IDs, CSS selectors, XPath and more, so it doesn’t matter if your page layout changes.

You can also convert a recorded script to Ruby or Python with one click, and run it directly on Go Test It. To prove it, let’s just insert “Hello world” at the top of this script. You can use whatever language features you need. Choose your browsers and run the script as usual.

You can follow its progress on the dashboard, or wait for the test results to come in by email. The script’s output is included. If a test fails, you have all the information to find and fix the problem in no time.

I hope that gives you a good idea of how Go Test It can make your life easier.

Please sign up now for a free trial and find out how much time you can save and how much better you can make your application by running automated tests on Go Test It. And thanks for listening!

This post was written by Martin Kleppmann, founder of Go Test It.