Skip to content

Agile Testing with Lisa Crispin
Syndicate content
Providing Practical Agile Testing Guidance
Updated: 6 hours 58 min ago

Intro to Test Automation Design, in The Testing Planet (& more)

Mon, 07/26/2010 - 20:32

The Testing Planet from  the Software Testing Club has indeed landed! It is chock full of excellent articles about testing, both technical and cultural. Just a sample of the titles: “Yes, It’s Personal”, “Context-driven Jumping”, “Testing & Creativity”, “Weekend Testing Fun”. I am extremely proud that my article, an introduction to test automation design, is on the front page!

Though The Testing Planet is available digitally, I urge you to subscribe to the print version. 1) it is way more fun and convenient (at least for us folks who prefer an actual newspaper with our morning tea), 2) it supports the magazine, and we need to support it and keep it going! The Software Testing Club rocks, it’s a great way to meet and exchange ideas with testers all over the planet. Give a little back to your testing community by supporting The Testing Planet.

Methods and Tools

I wrote a tool review of FitNesse for the Summer issue of Methods and Tools magazine. Please let me know if you have any questions about it.

Categories: Blogs

Tool Review: FitNesse, in Methods and Tools Magazine

Wed, 07/21/2010 - 21:49

The summer issue of Methods and Tools has my tool review of FitNesse. Please check it out, and if you have more questions about it I’m happy to help.

Categories: Blogs

Meet Ernest

Tue, 07/06/2010 - 22:15

My Agile Testing Days tutorial is almost full, so my motivation here is not to advertise it, but to invite you to meet one of my donkeys, Ernest. I tried to make the video with both Ernest and Chester, but it was very windy outdoors that day and Chester was fidgety, we couldn’t get a good video. My friend Anna suggested taking Ernest indoors to do the video, so we went in the living room and it worked just fine. It’s short, please enjoy!

Categories: Blogs

Podcasts

Wed, 06/30/2010 - 22:01

Podcasts are a nice way to learn about new topics, pick up new ideas and hear the experiences of other testers and agile practitioners. I highly recommend the Testing Podcast site for informative interviews with a wide range of testing practitioners.

This interview with Michael Kircher of Software Engineering Radio was posted in June 2010 and can be found on testingpodcast.com as well, along with some other podcasts I’ve done in the past. Michael and I cover several topics ranging from the role of the tester in agile teams, over test automation strategy and regression testing, to continuous integration. I really enjoyed it because we got to talk for over an hour (though the podcast is not that long.)

Categories: Blogs

Published on InfoQ: A Tester’s Learning Journey

Fri, 06/25/2010 - 21:24

InfoQ just published an article I wrote to try to inspire more testers to grow their skills. It begins:

The software industry is changing fast. More and more teams put testing up front and center; they use tests to drive development. New and improved automated test frameworks and drivers burst onto the scene every month. Teams with more automated regression suites need testers with sharp exploratory testing skills. But most people do not learn the needed skills in university: where will these testers come from? Read more

Categories: Blogs

In the Fishbowl

Wed, 06/23/2010 - 13:45

Recently I tweeted about a fishbowl we conducted at the Business Analysis Workshop of the Better Software conference. Some tweeps weren’t familiar with the fishbowl format, so I thought I’d explain how I like to do fishbowls.

Fishbowl Discussion at BA Workshop, Better Software conference

Fishbowls are a good format for a panel discussion where you want to involve the whole audience, as well as a panel of pre-selected experts.

Put some chairs in the center of the room. They can face each other or, if the room isn’t set up for everyone to sit in a circle, face the audience. The number of chairs depends on the size of your audience. An average for a group of 20 people is five chairs. You’ll start with only four of the chairs occupied. Arrange the rest of the chairs in the room in a circle or semi-circle around the fishbowl.

If you have pre-selected panelists, have them sit down in the chairs leaving one chair empty. The rules are simple: anyone in the room can come sit in the empty chair. When that happens, someone else on the panel has to get up and return to the audience. Panelists may come and go by sitting in the empty chair whenever they want to join the debate.

The audience doesn’t participate actively in the discussion. You have to sit in the empty chair to start contributing to the discussion. The beauty of the fishbowl is that the audience gets to hear a variety of viewpoints, and anyone in the audience can choose to participate.

I’ve used fishbowls for panel discussions of controversial topics. Jean Tabaka recently facilitated a “Kanban vs. Scrum” fishbowl debate at Better Software, and allowed people to contribute via Twitter, as well. I’ve also used them for workshops where the participants are trying to come up with new ideas about a topic. For example, I might use a fishbowl format for a workshop where we try to think of better ways for development teams to elicit requirements from their customers. For my starting panel, I might choose people such as Elisabeth Hendrickson, Antony Marcano, Gojko Adzic and Jennitta Andrea, who are recognized experts in using customer-facing tests to drive development. They’re bound to have some good experiences to relate. But there’d also be a roomful of practitioners who have their own ideas and experiences, and with a fishbowl format, we get to hear from everyone.

Try a fishbowl at your next local user group meeting. It’s a great way for everyone to contribute, and it produces lots of valuable ideas from a variety of viewpoints.


Categories: Blogs

Making Lemonade

Wed, 06/09/2010 - 00:56

If you’re at Better Software/ Agile Development Practices West this week, make sure you read the issue of Better Software that came in your conference bag. I’m especially pleased to have an article in this awesome issue with extraordinary fellow testers such as Jennitta Andrea, Markus Gaertner, Pradeep Soundararajan and Parimala Shankaraiah.

Categories: Blogs

What Gender Diversity Means to Me

Tue, 06/08/2010 - 00:18

I’m a volunteer on the Diversity in Agile project founded by Mike Sutton and supported by the Agile Alliance.

For reasons I don’t understand, some people have misunderstood the first phase of the project, which seeks to recognize and celebrate the contributions of women in agile development, as an awards program for women. Some people even thought it was only for women in testing.

Jon Bach asked me a good question. A couple of weeks ago, our Writing About Testing group held a conference in Durango, CO. The group was nicely balanced with as many women as men. Jon asked me what advantages I felt this gave the conference. He found my reply helpful and encouraged me to share it here. I’ve done so, with edits to make it more understandable to people who weren’t there. I hope others will find it helpful.

(Some others are finding this still makes them uncomfortable. I guess this is just such a delicate issue, it’s hard to express my feelings without offending someone. But as we are losing women from our industry at an alarming rate, I feel like I have to take the risk of pissing a few people off. Please take this in the spirit that I have the best intentions at heart. And think about this – would you want to work on a homogeneous team? Yes, gender is only one part of diversity. It happens to be the first area that the Diversity in Agile project is recognizing.)

* * *
I’m sure the advantages of having a lot of women at WAT were different for each participant. And while I thought “wow, this is rare, I’m in a room with lots of women”, it wasn’t on my mind all the time.

For me, some advantages that may have been due to the gender balance were:

  • I felt much more comfortable with a lot of women in the group. This wasn’t so much conscious, as just a feeling of ease and belonging that I don’t always feel on my almost-all-male dev team.
  • I find women are in general more active at collaborating and communicating, especially in a new setting. I think we had a lot of good energy and jumping into the exercises and great conversations because we were a diverse group.
  • Seeing other women contribute built my own confidence that I could contribute. I’m not saying that men in general try to reduce my confidence level. But I think most of us feel better with peers around. (Not to say men aren’t my peers – but they aren’t as much alike to me as other women are).
  • This is a note I wrote down when Marlena Compton was talking, I’m not sure if she said it or if it’s just a thought she generated in me:
    • “It’s easy to not feel safe if you aren’t sure about your thoughts. You need a space safe enough to get thoughts out. “
  • I feel more personal safety when there are more women in the room. I think it might be because other women are also thinking about safety, so they make an effort  to provide it. (Again, I am not saying that men do not care about personal safety or do not make an effort to provide it. I just don’t get the same feeling in a room full of only men.) Also in my notes is:

    • If you’ve got something to say, try to say it in a safe place. Don’t invest all your weight into your initial foray – get some feedback from a trusted peer group.
    • I’m not sure if Marlena said that but I’m pretty sure it was one of the women. So, generally I felt I was getting more support and information about personal safety and confidence from the women in the room.
  • This is a gross generalization of course – but some men in the room talked about using anger as motivation for writing (which I do understand, it’s not a bad thing) while I felt women were coming more from a point of view of joy. For example, Elisabeth Hendrickson’s stunt hamsters and pandas added an element of fun.
  • I feel that because there were so many diverse viewpoints in the room, I got a lot more ideas than from a group of only men. I can’t prove this, of course. But I’m thinking of Elisabeth’s slides with her panda and hamster people, Chris McMahon’s software development-as-artistic talk, the haiku exercise, donkey energy, the “P”s of motivation, we had a huge variety of ideas that I don’t think we’d have had with a less diverse group. (sorry, for those of you who weren’t there, I don’t have room to explain all those things, they will be blogged about later!)

I love the guys I work with, but I find I often have a point of view that’s different from theirs. Of course, it’s hard for me to know how much of my different viewpoint is just because I’m a tester. We’ve worked together so long, this has changed over the years, as we’ve all influenced each other.

But I remember at first, when there was only one other woman on the team, I was a bit shocked at the way they joked around – insults that were playful, but to an outsider it was a bit shocking, I couldn’t always tell if they were kidding. I don’t think they’d have had this aspect of their culture with more women around, though I could be wrong.

When all the guys play Quake every afternoon, and scream and cuss and pound the desk, they’re having a great time; the other woman on the team and I can enjoy that they are having fun, but we don’t feel like joining in. On a previous all-male team I worked with, I felt left out when they celebrated success by playing Foosball (which I’m no good at – though I do know women who love to play) or went to a movie I really didn’t want to go see (but I went anyway, which expanded my horizons – I learned to love X-Men!)  I really enjoyed having more women on my team back in the day when there were more female programmers.
* * *

I would appreciate any suggestions to make the Women in Agile site communicate our mission more clearly.

* * *

There are some other posts on this issue at CowboyTesting and Lanette Creamer’s blog,

Categories: Blogs

We’re All In the Same Boat

Mon, 05/31/2010 - 23:01

Please see my StickyMinds Blog for a new post inspired by Jeff Patton’s recent presentation to our Agile Denver user group. The Whole Team Approach isn’t just for developing the software! We need to really think Whole Company. Comments welcome!

Categories: Blogs

Norwegian Developers Conference

Wed, 05/26/2010 - 02:48

I’ll be speaking at the Norwegian Developer Conference June 16 – 18 in Oslo. The conference puts out a free magazine which includNorwegian Developers Conferencees my article about Learning for Testers, along with lots of great articles from other speakers such as Jurgen Appelo, Roy Osherove and Chris Sells. The speaker lineup includes lots more exciting practitioners and experts: Mike Cohn, Brett Schuchert, Uncle Bob Martin to just name a few. If you plan to attend, please let me know, I’d love to see old friends and meet new people there!

Categories: Blogs

SQuAD Workshop: Learning for Testers

Mon, 05/17/2010 - 05:28

The Software Quality Association of Denver held a workshop May 7 to share ideas about why testers need to learn, what they need to learn, and how they can learn all of that. I facilitated an enthusiastic crowd of about 80 people. The room wasn’t set up in a suitable way, but participants found creative ways to work. And creative they were. I’d like to summarize some of the outcomes.

Why We Learn

We started by dividing into small groups to brainstorm the reasons why testers need to learn. Beyond the obvious “stay employed” and “do your job better”, some fascinating reasons came out: “To stay interested and sharp”, “self-esteem”, “curiousity”, “freedom” – I’ve always thought that job security is in your mind. If you believe you have valuable skills, you’ll know you can get a job no matter what happens. Now, that’s freedom!

Groups Brainstorming

Group Brainstorming Activity

Other reasons that I might not have thought of included: Help others learn,  keep up with changing environments and be more flexible and adaptable, spawn new ideas. “Challenge yourself”, “Be a better contributor” – this is the attitude I want in my peers! There were several comments on the theme, “avoid reinventing the wheel” – find out what works and what doesn’t, build on previous learning and trials, make work easier and more efficient.

Another theme was “prevent stagnation”: keep your brain young, become more well-rounded, balance working hard with getting help when needed, be ready for the next opportunity, job satisfaction, and one of my favorites: “It’s fun to learn”. Well, yeah!

What We Need to Learn

Our second group activity was to think of all the things we need to learn. I was gratified to see a lot of what some people call “soft skills”, what Diana Larson and Jim Shore call “essential skills”: negotiation skills, listening skills, stress management, leadership skills, management skills, team mentality, how to motivate people, conflict resolution, creative problem solving, how to work with developers, communicate without jargon, simplify concepts, how to think like a customer, politics, team dynamics. An especially intriguing item was “Who tells the truth?” It’s critical to know that, right?

Creative Use of Body and Chair for Brainstorming Surface

Creative Use of Body and Chair for Brainstorming Surface

Flexibility and versatility were a theme here. Design patterns, programming/scripting languages, platforms, levels of abstraction, being able to speak the developers’ language were important outcomes. “Keep your brain in good learning shape” is something essential that hadn’t occurred to me before. One group noted the importance of learning estimating and planning skills. Long lists of test tools, processes, methodologies and other technical skills were also popular items on the “What to learn” lists.

How We Can Learn

This all sounds wonderful, but how do we learn all those diverse skills? Where do we find time to gain that experience? In our third group activity, the SQuAD groups came up with lots of innovative ways to learn.

One theme was trial and error. Learn from mistakes – what worked, what didn’t. Retrospectives are one way to do this. Experiment, do pilot projects, and importantly, build slack into the system so you have time to do this. A learning culture where mistakes are tolerated is a prerequisite for innovation and creativity.

Mentoring was another common theme, but a twist on this was not only to get a mentor, but to be a mentor. Mentor the tester next to you! Learn by teaching.

Collaborating within and across teams is another learning method that several groups came up with, but again with different ideas. Creating a shared space and being able to sit with people that have different skills is a great way to learn. Using wikis for collaboration is another. Pairing with other testers and with developers was suggested. Getting feedback from coworkers is another simple but effective idea. Our peers are a great resource.

If the sticky notes won't stick, just use the floor!

If the sticky notes won't stick, brainstorm on the floor!

Participants had a lot of interest in learning about their business, learning the domain. To do this, they suggested brown bag lunches with Subject Matter Experts, using the product like a customer would, talk to experts, observe. One of my favorite ideas was “Write a manual!”

Some outcomes built on our existing skills that already help us be good testers. We’re good at asking questions, so ask! Ask followup questions. Learn about the product with exploratory testing. Do compoarison testing. Evaluate tools to learn more about them.

There are obvious online sources of information, such as webinars, podcasts, blogs and white papers. I was surprised how many groups listed “Google” and online searching as a way to learn (though it shouldn’t be surprising – we all do that all the time!) Social networking also came up a lot as a good way to get information and benefit from others’ experiences. In addition to mailing lists, we have many online communities at our disposal, such as Software Testing Club and Weekend Testing.

One group suggested applying principles from non-related areas. Our reading and learning shouldn’t be limited to testing or even software development. Inspire yourself by attending (in person or virtually) conferences such as TED: Ideas Worth Spreading.

I was gratified to see several groups suggest that we learn by doing. “Practice!” The best way to learn is just go ahead and try something.

Outcomes on Door

Outcomes on Door

More Photos

You can see the groups at work, and their ideas, on my Picasa site. Please take a look and think about what you will do today to learn something new.

Categories: Blogs

StarEast 2010 – Self-Organized CWAC

Tue, 05/04/2010 - 04:11

I have LOTS to write about StarEast, but I’d like to start with the conference-within-a-conference that a group of us planned on our own. Well, I didn’t do much planning, but Matt Heusser took the lead and lots of other folks including Justin Hunter planned a couple of fun and enlightening events.

We were self-titled the “Rebel Alliance”. I don’t think we were rebelling against anything, there are just a lot of Star Wars fans in the group. (Though there was a good lightning talk suggesting good things we do rebel against). I was going to be a Bantha until someone reminded me of a gruesome scene involving one.

But I digress. We had dinner one evening, at which we even got t-shirts with a star fighter on it. So much fun to get to know people such as Yvette Francino, Shmuel Gershon, Lanette Creamer, Selena Delisie to name just a few (and how great to have lots of women!) I’ve known Adam Goucher awhile and met him at Agile 2009 (if not before), but it was great to see him and his fellow editor of Beautiful Testing, Tim Riley (who did a great keynote at the conference).

Shmuel Gershon's lightning talk

The next evening our group had our own lightning talks, which were as intriguing and creative (maybe more) than anything at the conference. Adam talked about pirates, and Lanette talked about herding cats. This photo of Shmuel presenting a new session testing tool he wrote shows how much energy the speakers had.

Jon Bach had surprising and thought-provoking exercises, as always. These are just a few examples.

At the Rebel Alliance Lightning Talks

Selena and Dan took lots of videos, I hope those will show up someplace. David Gilbert provided his own tasty home brew – what a treat! He did a good talk too, on what we’re rebelling against, and for – learning vs. pass/fail, programmer’s best pal vs. quality police.

Conferences always get my brain buzzing, just being around such smart and creative testing professionals. But being a part of this terrific group was amazing. From old friends like Janet Gregory to more recent friends such as Sean Stolberg and Dawn Cannan, to people I only knew on Twitter up to now, such as Alex Kell, to people I didn’t know at all before, like Mark Vasco -  it was almost overwhelming! I wanted to talk to everyone at once!

After this experience, I suggest you consider this at your next conference: get a group of like-minded people together and plan an evening ahead of time. You’ll look forward to the conference that much more, and take exponentially more ideas home with you. And you’ll be part of a small community that hopefully will live on past the conference.

Categories: Blogs

#ashtag adventures

Tue, 04/20/2010 - 02:48

I boarded BA flight 218 to LHR last Wednesday evening, eager to attend and present a tutorial at ACCU 2010. I had heard about the volcano in Iceland weeks ago, but never knew it had potential to disrupt flight until we were about to board the plane. About midnight, after dinner and well into a movie, the pilot announced we were turning back due to the volcanic ash cloud. Wow, I was glad to be safe, but extremely bummed about ACCU. Even if the plane took off the next night, I couldn’t make it in time for my session, so I had to call the whole thing off.

Silver Lining

As we all know now, tens of thousands (millions?) of people have now been inconvenienced or worse by the ash cloud. I was grateful not to be stranded in an airport away from home, and there was plenty to do back at work! But this cloud has a silver lining, at least for some of us.

Friday evening I checked Twitter as I worked. I noticed a tweet from @Dr_Black about visiting the Tattered Cover. That’s in Denver! Where is she? I didn’t know Sue Black personally, but I follow her on Twitter and know about her work for Bletchley Park, thanks to Antony Marcano. As a supporter of Bletchley Park, I also follow Kelsey Griffin. She and Sue were in Denver for a conference on museums and the web, presenting a session “Can Twitter Save Bletchley Park?”

We arranged to meet for breakfast on Sunday. I was so thrilled to meet them both – what a great opportunity! A few minutes into breakfast, Kelsey turned to me and said, “Are you the Denver speaker who couldn’t make it to ACCU?” She had heard all about it from a friend at ACCU. Such a funny coincidence, thanks to the ash cloud!

New Friends & Colleagues

As their flight had been cancelled, they decided to go to D.C. the next day, but Sue and Kelsey had Sunday to kill. I asked if they’d like to come out to a ranch, and see a bit of Colorado outside of Denver. We had such a fun day together, driving in the foothills, and playing at my friend Anna Blake’s Infinity Farm. Sue and Kelsey each had a ride in the donkey cart, pulled by Chester – Kelsey even drove! Sue had a long ride on the lovely Max, with coaching from Anna. Edgar Rice Burro, the large pinto donkey, fell in love with Kelsey, and followed her around resting his chin on her. A great time was had by all.

Then we visited Garden of the Gods, a park in Colorado Springs with stunning rock formations at the foot of Pikes Peak. I was surprised that Sue and Kelsey had energy left over for dinner with me and my husband Bob!

I’m so grateful for the opportunity to spend time with these inspiring women, learn about Bletchley Park, pick their brains about how to organize volunteers for our Women in Agile project, discuss agile development, and just enjoy new friends. If not for the volcano, I’d have been having lunch in Cirencester with Dave Evans, Marta Ferraro and Mike Scott. Instead I spent the day with two Londoners in Colorado!

#ashtag Connections Around the Planet

Lots of people stranded by the cloud are making lemonade. Some ACCU speakers are holding Open Space London – Volcano Version on April 20. Enrique Comba tweeted that he’s in Chicago visiting Obtiva, Corey Haines and other developers. My co-author Janet Gregory was stuck in Oslo after teaching our Agile Testing course there last week, with our ProgramUtvikling friends offering to help her out, but she managed to get out today (Monday) and back to North America. As I follow the #ashtag tweets, I’m surprised how many people I know that are stranded in various parts of the globe, and I hope they all get home soon. If you’re stuck somewhere, I hope you’re able to make new connections and learn more about the part of the world where you are!

Safe travels!

Categories: Blogs