Skip to main content

Virtual Conference Attendance Worked: I was Amazed at How Much I Learned!

I suddenly found myself able to attend the American Evaluation Association (AEA) annual conference virtually because I had a relatively open schedule during the conference days of Oct. 31-November 3, 2018 (Wednesday afternoon-Saturday afternoon). I didn’t know until close to the conference time that AEA would have virtual access – and not just to the Opening Plenary.

Thanks, AEA, for the free and excellent streaming access to Presidential Strand sessions!

So I began attending the virtual sessions. And I was deliberate and diligent in engaging with the conference Twitter hashtag #Eval18 (and other variations).

By the 2nd day afternoon, I realized what a full picture I was getting of the conference even though I wasn’t there. Attending tweeters were keeping us updated on all aspects of the conference. And I found myself reading threads and going back to the program abstracts to learn more about sessions that weren’t streamed but whose content impressed an attendee enough to write a tweet.

And I also began to aggregate in my mind (an “asset” of being an evaluator) the learning I was getting from the conference. So, I went back to my decade-plus as a training and performance evaluator to formalize this learning and evaluate it. The intended audience for this retrospective research was a sample of 1 virtual attendee [me]. I used the Kirkpatrick Four-Level Training Evaluation Model to judge my “learning” and subsequent application from the conference.

Data Sources

·        AEA Presidential Strand (Virtual) Sessions

I was able to attend 5 of the 7 virtual sessions streamed and 3 of the 4 Presidential Strand sessions during the evaluation focus period.

·        Twitter

I also engaged on Twitter tweeting my observations and learning and following #Eval18.

For the Twitter analysis, I used all Tweets with #Eval18 from Wed Oct 31, 2018, 00:02:16 GMT (4 hours ahead of Cleveland) to November 1, 2018, 21:51PM. [I decided to start collecting data on Friday to document my learning. I restricted the data collection to the first 2 conference days (Wednesday and Thursday) so I wouldn't alter and bias my Twitter and AEA virtual-attendance behavior once I decided to collect the data.  ๐Ÿ˜Š]

I found a free program (easy to use quickly and get data out of in a Google Sheet format from TAGS V.6.1.9 ( to extract the 1944 tweets.

I excluded nice-to-have tweets.

This left 413 tweets that I categorized and did content analysis on in Excel. 


Exemplar tweets for all the categories are woven into the results along with observations from virtual attendees (primarily me).
  • Great reminders
 I labelled these as Indigenous tweets and they came from Nicole Bowman and others, setting the stage for those arriving in Cleveland to keep in mind the long history we evaluators need to bring to our work – and very relevant to the conference theme of “Speaking Truth to Power.”

  • Getting To and Waiting for Sessions to Start
Virtual attendees were always greeted by lovely (not loud) music and these informative and changing slides between presentations. IRL attendees (In Real Life, IRLs going forward) for streamed sessions had the same slides. (No one tweet-commented on whether music was being played with the slides the IRL attendees were watching.)

  • Healthful Practices During the Conference
Virtual attendees (or at least me) got no exercise during the conference, but I did have my choice of seats and healthy snacks and meals. IRLs got lots of steps in and/or used the workout and other healthful areas. And IRLs had Food Trucks – and added even more steps to reach them.

  • Virtual attendees had as good or better views of both presenters and slides – at least in plenaries.
Virtual attendee views of the presenters and slides were excellent – and didn’t depend on the room size or the number of chairs.

  • Virtual attendees could ask questions “equally” with IRLs
Each virtual session had an active chat window that helped us see who else was attending as well as for commenting, networking, or asking a question. Presenters would answer the virtual questions equally with attendee questions. The AEA virtual moderator asked about people's locations outside the US. And some virtual attendees tweeted about their engagement like the evaluator from Tokyo. 

  • Most of the Tweets were to share value-added content.
77% of the tweets were specifically session content – value-added information that couldn’t be gleaned from the session titles. More than half of the tweets (218) were specific content shared and an additional 100 were observations/comments or tips and tools.

a.      Tweeters shared a range of content from many sessions I may never have considered attending if I’d been an IRL attendee. Specific content such as pictures of slides being presented were very useful as presentation handouts are much less available (according to 1 tweeter) and are less timely since they aren’t usually available til after the conference. I was really amazed at how many new ways to approach evaluation are being used and how adaptations are working out in different situations.

b.      Tweets on tools and tips were very helpful although they rarely came with links to find more information for following up.

c.      Additionally, tweets with comments and questions were helpful perspectives to remind us of taking our learning forward.

  • Other Kinds of Information and Commentary
a.      Both IRLs and other tweeters shared information useful to evaluators that amplified or supported the conference theme.

b.      There were fun tweets – and not just around the Oct. 31rst conference day. And an instant classic from Chris Lysy whose ability to translate evaluation into a comic is unbelievable.

c.      I was impressed that 2 “I’m-a-first-timer” tweets included content as well.

d.  Tweeters pointedly gave feedback for AEA and TIGs.

e.      And a tweet about Michael Scriven’s absence was acknowledged through his good wishes to all of us for a good conference was shared (and RTed repeatedly).


Twitter was the critical link to expand my virtual conference attendance into more of a full conference experience. There were dedicated live tweeters like Zach Tilton (recognized below in a tweet from Sara Vaca a couple days ago as he has continued to share threads of his live-tweeting), Allison Titcomb, Jara Dean-Coffey, and Tom Archibald. So many tweeters provided insights into and pictures on session content that gave me learning from and insights into evaluation topics I didn’t know about.

But the variety of tweets I reviewed showed a range of conference aspects. These all gave me real feelings of being IRL with the 3000 IRLs in Cleveland since I could see activities beyond sessions and posters, learn about and marvel at the range of health and wellness facilities and the Food Trucks, see groups’ meet-ups and fun times (especially those making a “work” connection to their fun times), and enjoy pics of people meeting IRL after being connected electronically (including “I finally met my hero ___”).

I also did much more engaged networking, primarily through the live-tweeting I did. This resulted in many more Twitter followers by the end of the conference which has greatly increased my Evaluators PhD and Related Twitter list, one of the first lists I peruse when I am on Twitter.

And I better solidified my learning by doing this reflection and review. To ensure that I applied the learning into action in the short term rather than leaving the conference with so much information and not being intentional about using it, I committed to develop it into this blogpost. When I tweeted about this as #Eval18Results, several others also contributed their commitments.

(DM me on Twitter or email via SueMentors on gmail if you would like access to the data.)


  1. The information you've provided is quite useful. It's incredibly instructional because it provides some of the most useful information Hybrid Event Platform. Thank you for sharing that.


Post a Comment

Popular posts from this blog

Mentor: Barbara Rawlins, Monitoring and Evaluation Team Leader, Maternal and Child Survival Program

Another feature of this blog is bringing you advice and perspectives from people who mentor, by answering 3 questions. Here are  Barbara Rawlins ’  responses: What are mentees looking for? ·  Career guidance ·  Technical advice ·  Moral support ·  Advice on how to negotiate politically-sensitive or controversial situation What 1 piece of advice do you give every mentee you work with? Figure out what they want to do (in the long term) and what steps they can take to get there Why are you interested in mentoring? To support younger colleagues, especially women, to help attain their career goals

A mentor is like a mirror: Even a senior (expert) needs - and wants - mentoring #mentor (

I haven’t been posting for the past 3 months because of an extremely busy time. But I have been mentoring – and in ways that were surprising to me. In July-September, we at Social & Scientific Systems (SSS) were unexpectedly were facing the sooner-than-expected project close-out, and it meant that several staff needed to be looking for new jobs. I wasn’t surprised that some of the staff – mostly those still early in their careers – were asking for my help in updating their resumes. I was more surprised to have two very senior and experienced professionals ask for my help. When they gave me their resumes to review before we met, I realized that both were examples of why a mentor can be useful, no matter how far along you are in your career. One had an illustrious and varied career and many qualifications prior to coming to SSS two years ago. But her resume read like someone who had just finished graduate school. She was very detailed in listing all the things she did (both in her SS

A Decade of SueMentors Mentoring!

The just-finishing 2019 marks a decade of my “formal” SueMentors mentoring. As I reflected on the decade over the last months of 2019, I realized I have learned so much – but haven’t always let mentees and other supporters know that. So I went back to my program-evaluation career and put together an infographic to summarize the 10 years. This shows you what I’ve learned from mentees, the ways mentees have shaped  my delivery of short- and longer-term mentoring, and how I’ve been able to expand from 1-to-1 mentoring to more 1-to-many methods that meet people where they are. Many thanks to the decade of mentees I’ve worked with directly: Mentees who connected through a mentoring program or a “self-referral” or a referral to me from someone else S everal of you who “discovered” me from an online source S ome who I’ve met in person at conferences or by happenstance (like waiting for ride-shares) T hose who have re-contacted me And a special thanks to Kristina Davis,