DevCSI Stakeholder Survey 2013

Evidence Base at Birmingham City University has been commissioned to undertake a survey of stakeholders on behalf of DevCSI, the Developer Community Supporting Innovation project. DevCSI aims to build a community of developers working / studying in UK Education and investigate the value and impact it can make to technical innovation in the wider educational community and at an organisational level. DevCSI is managed by the Innovation Support Centre, UKOLN at the University of Bath and funded by JISC. The broad topics of this survey include: benchmarking developers across the sector; examining stakeholders’ views of software development; discovering examples of local innovation; and gathering suggestions about the on going future development of a developer community.

The survey is currently available for developers, managers of developers, senior managers, funders, vendors/suppliers and users (academics/researchers/librarians) at:


https://www.surveymonkey.com/s/devcsi2013

Each respondent will be able to enter a prize draw to win a £200 Amazon voucher or one of four £50 vouchers. If you would like to enter for your chance to win, please follow instructions at the end of the survey.

The survey should take approximately 10-15 minutes of your time. Please be assured that all data will be anonymised during analysis. We would welcome your responses by 28th June 2013.

In addition to the survey responses the DevCSI team are looking for people who would be willing to provide further in depth case study data to support the project. There will be an option towards the end of the survey to supply your contact details if you are interested in finding out more about this. Please note this is not a compulsory element of the survey.

If you have any queries about this survey, please contact Evidence Base: ebase@bcu.ac.uk

Thanks for your help – we really value your feedback.

Report on m-library activity

As part of the JISC-funded mobile library community support project, we ran two fact finding surveys; one at the beginning of the project and one at the end. We have now published the final report for the end of project survey (data collected July-August 2012) as well as a series of summary blog posts.

The full report is available online as a PDF, or you can view it below:

Mobile technologies in library – community support project outputs

Mobile technologies in libraries

Mobile technologies in libraries (photo from Kennedy Library on Flickr)

The JISC-funded mobile library community support project we’ve been working on is drawing to a close, with just the final survey report still to be published. I thought it would be useful to provide a summary of the outputs with relevant links.

Social media resources

We’ve been using a number of social media services to collate resources and support discussions:

Case studies

We collected a number of case studies throughout the project:

Pathways to Best Practice

We brought together the resources we had collated as well as information from conversations with practitioners to put together ten pathways to best practice guides. Each includes an explanation of the area, the benefit to the library, current state of maturity, examples of initiatives in libraries, lessons learned and useful contacts. You can view each online or download a PDF version.

Fact finding surveys

We ran two surveys during the project; one at the beginning of the project (Nov-Dec 2011) and one at the end (Jul-Aug 2012). The surveys gave an idea of where libraries were in terms of implementing initiatives with mobile technologies as well as examining barriers to implementation and considering potential solutions. The report for the first survey is available from Slideshare (you can download a copy). The report for the second will be available shortly from the documents section of our Slideshare account.

Continuing the discussion

I’m sure we will continue to keep abreast of developments in the area and will continue to share resources we find (using the tag of mlibs). We’ll also be blogging still, though the blog is in the process of being moved to a new home over on the JISC blogging platform. We’ve also set up a JISCMail M-LIBRARIES-GROUP discussion list, so please feel free to subscribe and share any news or ask questions via the mailing list.

Mobile technologies in libraries – end of project survey

The m-libraries support project (managed by Evidence Base and Owen Stephens Consulting) is part of JISC’s Mobile Infrastructure for Libraries programme running from November 2011 until September 2012.

The project aims to build a collection of useful resources and case studies based on current developments using mobile technologies in libraries, and to foster a community for those working in the m-library area or interested in learning more.

At the beginning of the project we ran a survey to gather information, to discover what was needed to help libraries decide on a way forward, and to begin to understand what an m-libraries community could offer to help (full report available). It’s now time to revisit these areas to see how things have changed.

Please answer the following few questions – they should only take 5-10 minutes and all questions are optional.

This is an open survey – please pass the survey link on to anyone else you think might be interested via email or social media: 
http://svy.mk/mlibs2

LIS DREaM closing conference #lis_dream5

On Monday I attended the LIS DREaM closing conference at the British Library. Having found the previous LIS DREaM opening conference incredibly interesting (see blog post) and enjoyed participating in the LIS DREaM cadre workshops (see blog posts on workshop 1, workshop 2 and workshop 3) I had hoped to attend and was delighted to be invited to participate in the panel discussion in the afternoon.

The conference acted as a final summary of the LIS DREaM project (the funding comes to an end soon) and Hazel Hall opened the day with an overview of the project, its aims and outcomes. The evidence collected so far certainly proves that the project has been a success; it has built research capacity and capability, raised quality and standards (specifically in research training, practice, output, value, impact and influence) and secured a foundation for future research collaborations, particularly for those of us involved in the cadre and also for many who have followed the workshops from the excellent resources and options for virtual followers. The concluding conference (open to all) built on that with the keynotes and discussions during the day.

The morning keynote session was from Professor Carol Tenopir from the University of Tennessee. I have come across much of Carol’s work in the area of value and impact of library and information services, but hadn’t heard her speak before. Carol gave an excellent overview of why measuring the value and impact of library and information services is so important, what methods we might use, and how to communicate the information to different stakeholders (and even adapt the methods used depending on stakeholders and what appeals to them most). For example, Carol mentioned that for her institution, the senior managers are far more interested in the human side of things so they appeal to this by presenting quantitative and qualitative data as a portrait of success i.e. “here’s what the successful people do and how they use our library resources and services to support them”. For other organisations it might be that the headline figures are what matters in which case it will be important to collect relevant data to enable calculation of things such as purchase value. Carol also gave some information about the LIBvalue project which I will definitely be keeping an eye on. See the slides or video of her keynote for more information.

We then had 20 minutes of madness in the form of one minute madness presentations. I really like this approach to finding out about a lot of projects in a short space of time. Some of the people presenting had timed it perfectly too, very impressive! A particular highlight for me this time was finding out about how University of Northampton support their staff and encourage research across the library at all levels – Miggie Pickton spoke about some of the ways they encourage this, and Charlotte Heppell spoke about research active, the library and learning services conference which aimed to highlight research from the library to internal and external colleagues.

After lunch we had an invited speaker, Dr Louise Cooke from Loughborough University, who presented her findings from the social network analysis she did with the LIS DREaM cadre. We completed a survey for Louise at the first workshop, and again at the third workshop and she was able to demonstrate how the network had strengthened (fortunately for the LIS DREaM project!). It was interesting to see the clusters of connections, particularly when linked to job roles. Take a look at the slides or video to see the network before and after.

One of the few screenshots from the panel discussion I could get without my hands flailing around (which I seem to do a lot when talking)

Following Louise’s presentation, it was time for the panel discussion which I was involved in. It also included Professor Carol Tenopir and Dr Louise Cooke, as well as John Dolan, Chair of CILIP Council. I was there to represent the LIS DREaM cadre and discuss ways to sustain the network that the project has begun to build. Although I don’t have any answers yet, I found the discussion worthwhile. As well as sharing my views and those of others who had completed my short survey, it also questioned some of the ideas and thoughts I have had and I think it helped us to begin to move to the stage where ideas can start to become actions; as the LIS Research Coalition’s involvement decreases due to funding, it’s up to us as a community to continue the progress. (Related to this, the LIS RiLIES event the following day built on this in terms of sharing research outputs and having followed the tweets from this I’m looking forward to seeing what the outcomes of that will be). If you’re interested in watching to the panel discussion you can view the video.

Ben Goldacre at LIS DREaM conference

Following a presentation of the LIS Research Practitioner award to the North West Clinical Librarian Systematic Review and Evaluation Group, we then had the afternoon keynote given by Ben Goldacre. I’ve followed Ben on Twitter for a while now and was looking forward to hearing him speak. He was a very engaging speaker and I found it fascinating (and eye opening!) hearing about some of the ways drug companies manipulate what data gets published, as well as the ways the publishing mechanisms are skewed towards publishing positive results. In the medical world it’s obviously particularly important to ensure the information available to doctors (and patients) is the full picture, but at present the evidence base is skewed. Though it’s unlikely anyone will die if this is the case in LIS research, it’s obviously beneficial for everyone if there is wider reporting of both successes and failures. I know some of the most popular conference sessions are when people are brave enough to share the things that went wrong for their projects and how others might be able to avoid them. Ben didn’t use his slides but you may want to watch the video of his talk once it is available.

The day closed with some networking drinks and a prize draw. Sadly I wasn’t fortunate enough to win a book but I did get to see my name in print as I wrote a case study for Bethan Ruddock’s New Professional’s Toolkit (which she signed for those who won copies).

I found the day useful for reflection purposes, and particularly in terms of dissemination; I know it’s a weakness of mine in my research. I often present at conferences and events but rarely publish my research in practitioner or research publications (largely due to time constraints). I’m going to make a real effort to make time in future though as it’s so important for those wanting to continue research further or inform their practice. I’m also hoping I (and my colleagues at Evidence Base) can help sustain the network of LIS research by supporting publications, events and networking. Let’s keep the DREaM going!

I’m planning to collect more data on what people think about LIS research in the future and hope to write it up as a guest blog post for the LIS Research Coalition. I’ve reopened the survey and would really appreciate your response. It’s just five questions (posed by Charles Oppenheim) and should only take a few minutes to respond. All questions are optional so if some aren’t as relevant to you leave them blank. Please also feel free to pass the link to others. Thanks for your help.

DevCSI stakeholder analysis survey 2011-12

Evidence Base at Birmingham City University has been commissioned to undertake a survey of stakeholders on behalf of DevCSI, the Developer Community Supporting Innovation project (
http://devcsi.ukoln.ac.uk
). DevCSI aims to build a community of developers working / studying in UK Education and investigate the value and impact it can make to technical innovation in the wider educational community and at an organisational level. DevCSI is managed by the Innovation Support Centre, UKOLN at the University of Bath and funded by JISC. The broad topics of this survey include: benchmarking developers across the sector; examining stakeholders’ views of software development; discovering examples of local innovation; and gathering suggestions about the on going future development of a developer community.

The survey is currently available for developers, managers of developers, senior managers, funders, vendors/suppliers and users (academics/researchers/librarians) at: 
http://www.surveymonkey.com/s/devcsi2011-12

Each respondent will be able to enter a prize draw to win a £200 Amazon voucher or one of four £50 vouchers. If you would like to enter for your chance to win, please follow instructions at the end of the survey.

The survey should take approximately 10-15 minutes of your time. Questions marked * are compulsory. Please be assured that all data will be anonymised during analysis.

In addition to the survey responses the DevCSI team are looking for people who would be willing to provide further in depth case study data to support the project. There will be an option towards the end of the survey to supply your contact details if you are interested in finding out more about this. Please note this is not a compulsory element of the survey.

If you have any queries about this survey, please contact Evidence Base: ebase@bcu.ac.uk

Thanks for your help – we really value your feedback.

LIS DREaM workshop #lis_dream4

Yesterday I attended the final of the series of LIS DREaM project workshops (I blogged previously about workshop one and workshop two). The final workshop included sessions on the following:

  • Horizon scanning
  • Repertory grids
  • Data mining

This was probably my most anticipated of the three workshops in terms of content, and it didn’t disappoint.

Horizon scanning is the most relevant to my field of work as much of it is in innovation. Knowledge of some of the techniques in this area may have been beneficial for me in a previous project where we were involved in evaluation of a programme of work and looked to identify the landscape in specific areas at the start of a programme and at the end. Horizon scanning may have been particularly useful at the start, where we could have examined where technologies may take us by the end of the programme. Dr Harry Woodroof’s presentation is embedded below:

The sessions on both repertory grids and data mining were some of the highlights of the whole series of events for me. They’re both areas I knew very little about but found fascinating, and the speakers were very engaging.

Repertory grids is a method used in psychology so it was bound to appeal to me; I have very fond memories of my A level in Psychology and my undergraduate dissertation in Sports Psychology. Aside from that though the methodology I found really fascinating. It’s probably easier for you to follow the presentation (embedded below), but I’ll try to explain a brief overview. It’s an exploratory method used to explore an individual’s personal construct theory and is co-created with both the interviewee and the interviewer contributing to confirm the end result. It’s often used to set variables for further research. The interview will have a broad area of concern, and the process then follows these stages (using the fruit example as the speaker did):

  1. Come up with at least 8 elements to fit the concept – e.g. apple, banana, pineapple, strawberry, peach, lemon…
  2. Choose three of them, and consider which two are most similar and what makes the third different (this is called triadic construct elicitation) – e.g. strawberry and peach are sweet, but lemon is sour
  3. Repeat the triadic construct elicitation until you have around 8 variables (i.e. bipolar scale of opposite characteristics)
  4. Use these variables to create a grid with a sliding scale (often scale of 5 used but could be more)
  5. Record each element in the appropriate position on each scale

You can of course repeat the interview process with a number of people and consolidate the findings resulting in a set of variables emerging as the key characteristics, then use those constructs to test a larger population’s reactions to different elements. I can’t think of anything I could currently apply this too but it was really interesting method and I’d like to learn more. Dr Phil Turner’s presentation is embedded below:

The final formal session, on data mining, was again of real interest to me. I find it intriguing (and frustrating!) that libraries hold a lot of data about their users but do not tend to utilise this in any way, when they could use it both for assisting users (e.g. recommendations) and for more traditional business intelligence purposes (e.g. occupancy statistics used to predict patterns of use, borrowing data used to assist in collection development). The presentation was really interesting and highlighted the importance of the planning and testing stages involved in data mining, as well as the essential data cleaning.

I’ve been following the innovative work of Dave Pattern (@daveyp) for a long time now and this presentation gave me just a tiny insight into how complex it must be to utilise data in the ways Dave has been doing (check out his blog posts on library usage data).

I definitely think data mining is something we should be doing more of in libraries but due to the complexity I don’t think it’s something the profession can currently achieve – not many libraries have a @daveyp! I really do believe strongly that this area needs to develop though as it supports important strategic decisions, and we should be either utilising experts in this area to help us, or employing people with the skills to do so. If you’re interested in learning more, check out Kevin Swingler’s presentation embedded below:

To close the event we had a group discussion exercise based around the idea of improving LIS research and practitioners and researchers working together more closely. This gave me a lot of food for thought as it’s something Evidence Base is particularly keen to support.

All in all it was a great final workshop and I’ve really appreciated having the opportunity to learn more about research methods and techniques and meet others interested in the same. I hope we can continue to keep the DREaM alive!

Take part in the LIS RiLIES2 project poll

From the LIS RiLIES2 project:

LIS RiLIES logo

LIS RiLIES logo

Which freely available online resources do you consult to find relevant library and information science (LIS) research to help with your job?

Where would you go if you wanted to access advice online on how to set up a new research project of your own?

The RiLIES2 project research team is currently working on the production of some new research resources and training materials. These are intended to support librarians and information scientists in the use of published LIS research in their work. Additionally they will serve as reference tools for librarians and information scientists interested in conducting research projects of their own.

We are keen to ensure that we do not replicate existing provision of resources, and to identify the best format and “home” for the resources that we produce. To this end we invite you to complete a short poll. Its purpose is to find out which of the existing resources that support librarians and information scientists use and/or conduct research are (a) well used and/or (b) respected.

The poll is aimed at LIS professionals who are based in the UK, but if you live in another country, we would still be interested in your answers.

Please follow this link to take part:
http://www.surveygizmo.com/s3/878039/RiLIES-2-Initial-Poll
. The poll will remain open until the end of April.

RiLIES2 project is a follow-on project from RiLIES1. RiLIES1 explored the extent to which funded librarianship research projects influence library practice in the UK. Download the RiLIES1 project report Enhancing the impact of LIS research projects.

LIS DREaM workshop #lis_dream3

Earlier this week I attended the second in the series of three LIS DREaM (Developing Research Excellence and Methods) workshops for LIS researchers and practitioners. I blogged previously about the first workshop in Edinburgh last year, where I gave a brief overview of our m-library community support project. I’m not going to give an overview of the whole event as that has been done very well by others – I just wanted to share my highlights and the parts I might be able to put into practice.

Each of the workshops follow a similar structure, including sessions on a broad research approach, a specific quantitative research technique, a specific qualitative research technique, and a research ‘practicality’. This workshop included:

  • User involvement in research
  • Techniques from history
  • Webometrics
  • Information policy

I have to be totally honest and say I wasn’t looking forward to this workshop as much as the last – they’re aspects of research that aren’t as directly applicable or interesting to me, though I appreciate that there are others in the group who for whom this workshop was more relevant than the last. The two sessions that I was looking forward to were the user involvement in research and the webometrics.

User involvement in research

The presentation on user involvement in research I’m afraid didn’t have any supporting materials so I can’t share the presentation though there is a video and overview on the LIS DREaM website. It was interesting to be a participant to a traditional style lecture of someone just talking with no materials to support it. I have to admit I found it more difficult as it is a different way of learning. I’m definitely more of a visual learner and like to read things to learn (particularly short bullet points) so presentations often suit me well. I’m far less of an auditory learner so although I do listen to presenters, it’s usually to back up what I’m getting from the images and text of their presentation. It made me realise how difficult it could be for other types of learners in a presentation setting though! Anyway, back to the content of the session.

I did take from the presentation was how important it is for certain projects to involve users throughout all stages of research. I actually think this is something we’re pretty good at in libraries, though there are definitely times where I know projects have minimal user involvement until it’s probably too late really. Peter also discussed different mixes of researcher-user involvement which was interesting. Users might be involved in commissioning research, or they may be heavily involved throughout in designing and contributing to the project. We’re involving users in our m-library project, though more as a regular check to make sure we are delivering something of value to the community (they’re not involved in the project team). I can see that involving users would be very useful for some library projects, particularly delivering new services, though as Michael points out, involving users isn’t likely to be easy:

Introduction to webometrics

The other session I was interested in was Mike Thelwall‘s presentation on webometrics (metrics available from the web, particularly the social web, rather than web usage metrics like hits/visits). Mike is the webometrics guru, so it was good to hear him speak. I really liked his approach – he introduced the theory to us first, and then showed us some cool examples from his research to explain it. I’ve realised through these workshops that it really helps to cement an idea in my mind if I can see a practical example, and that might explain why I often find myself asking questions about something that is new to me until I can see a practical application for it and then it will stick.

Mike discussed some research he has done on analysing networks based on YouTube comments (where male and female commenters are identified and positive and negative comments, as well as the strength of links based on number of replies). Another really interesting piece of research he discussed was using Twitter to gauge public reaction to a number of popular events. They used sentiment analysis to analyse the content of tweets around periods of large scale events such as earthquakes and the Oscars. Great idea – and lots of potential applications of analysing the sentiment of tweets at certain periods of time or in certain locations. You can see Mike’s full presentation below:

Unconference half hour

I also really enjoyed the unconference half hour where attendees get to share their research or their research interests. This is a really good way of helping us get to know each other and make useful connections. This has actually already been of use – the following day at a different event I sat next to someone doing research in a very similar area to someone from the LIS DREaM group so I passed on their details.

More information

If you are interested in more details on each of the sessions in the workshop, check out the resources linked from the programme or the other attendees’ blog posts.

LIS DREaM workshop #lis_dream2

I’m just on my way back from the first LIS DREaM (Developing Research Excellence and Methods) workshop held in Edinburgh. It was a fantastic day and I’m still taking a lot of it in, there’s plenty to follow up on.

Each workshop will cover a research approach, two research methods (one quantitative and one qualitative), and a research concern. Today we covered:

  • Ethnography
  • Social network analysis
  • Discourse analysis
  • Research ethics and legal issues

Most of these were relative unknowns to me, so it was really useful to learn about. I took something away from every single session and now have books and articles to read, and methods and analysis software to research and consider for possible future use (I was particularly interested in the social network analysis as it might be a potential way of examining existing communities and demonstrating how they have grown/strengthened).

There was also an unconference half hour which I volunteered to join in with – I briefly spoke about our ‘Supporting the mobile library‘ project which we’ll be starting soon. I was even complimented on my poster design:

It was really interesting to learn more about other attendees and about their current research or future research ideas. I’m looking forward to getting to know more about the group with future workshops.

As with previous LIS Research events, the support for people following remotely was great, and the resources are already online. Videos will be added to the website soon so you’ll even be able to watch the presentations from the comfort of your own home!

The next workshop will be in London in January – I’m very much looking forward to learning about other research methodologies and approaches, as well as being part of a group of people who are really hoping to embed research into practice and build stronger links within the community amongst researchers and practitioners. There was a real buzz of enthusiasm today and I’m sure that will continue throughout the workshops.