Academics Supporting Academics

How can we support each other in science?

If you hang out in the academic circles of Twitter or the blogosphere[1] you’ll find many frightening stories about the cutthroat and ruthless nature of the world’s self-appointed thinkers. Bullying in academia has its own Wiki page (don’t be too shocked, academia is also an industry that hosts regular edit-a-thons of Wikipedia), and is frequently the topic of thinkpieces in your favourite left-leaning media (again, don’t be too surprised, we’re also an industry that writes for a living).

Bullying in academia is a problem, and early career researchers are frequently left unsupported. But this is not the only story. I’ve heard tales from my own university that make my skin crawl, but I think it’s equally important to highlight when things work well. I have always been incredibly lucky to work in supportive teams, and I’d like to think I help to support my colleagues, so if you want to change the culture of your academic workplace, here are the things that work for me:

1. Ask for help

SRUC recently hosted Temple Grandin for a series of talks, and I was invited to talk about my research as part of an early career day. I’m not the kind of person who gets nervous about talking, but presenting your research, that you’ve just written a book on, to one of science’s biggest characters is not a normal kind of talk.

I asked for help.

My colleague, Jess Martin, pictured to my left in this Tweet, sat with me as we flicked through my slides. She gave me some brilliant advice on my slides, and then she gave me some tips for coping with nerves during presentations. I think it’s important to point out that these are skills I have, I win competitions (and book deals) on these skills, but that doesn’t mean I don’t need help sometimes. As academics we like to  believe we are experts, that we have irreplaceable skills. If we don’t believe this then everyone is our competition . . .

Here’s the thing, every woman in that photo could do my job better than me if they put their mind to it. We are a strong team, not when we scrabble for funding scraps, but when we sit down together to see where we can learn from one another.

 

2. Acknowledge your colleagues

She won’t thank me but I want to call Jess out specifically here. Jess is one of these people who will always have time to help you if you ask for it. Jess also uses peoples names.

In a meeting, when Jess wants to echo someone’s idea she says “Jill’s point was a good one…”. I’ve started trying to do the same. “I agree with Bob”, “I missed what Alice said, can you say it again?”

I often find myself in meetings where there is a spread of paygrades around the table. You and your fellow early career researchers will not be on the radar until you all start speaking about your achievements. Don’t push your own agenda at the expense of others. When Bob makes a good point, tell people it was Bob’s idea.

 

3. Think about wellbeing

I have another set of colleagues, Kirsty Hughes, Sharon Boyd and Jessie Paterson, who are very engaged with workplace wellbeing. They organise various sessions to get us thinking about things other than work. I’m going to be talking about video games for my team later this month. They’re not mandatory, but they’re there. Just before Christmas my boss was teasing me for me affection for glitter as we made some Christmas cards, and then we pondered our approach to one of my current projects.

Good bosses are very important here, and another place where I’ve always been incredibly fortunate. But even if you don’t have a supportive boss, think about how you and your colleagues interact. Working in Scotland my colleagues and I are big fans of the pub debrief, but there’s plenty to be said for walk-and-talks out in nature, for crafting sessions and opportunities to explore hobbies.

Hobbies teach skills you can bring into the workplace, my photography and videogaming are both things I can use in my role, but that’s not the real gain here. Work shouldn’t make you sick. It’s as simple as that.

 

4. Go home!

Don’t be part of the culture that normalises sleeping under your desk. Go home at a reasonable time. If you are sending an email to a colleague and you see their out of office is on, it’s very easy to delay an email so it gets sent when they’re back, and it takes very little extra effort on your part. Turn off email notifications on your phone, turn off your inbox’s ability to pop up every time a new email hits your inbox. If you have a short question why not visit your colleague’s office, instead of sending an email?

Don’t fall into the trap of saying “this is how it was for me, this is how it’ll be for my students”. I hope the future generation has a better life than ours.

 

5. Reflect on feedback

This is the one I find most challenging. I like to think of myself as amazing at all times, but I’m not. I do things wrong, I lack several skills, I have a long way to go. I found my Higher Education Academy application to be a revelation in this sense. I still struggle to take feedback on board, but I like to think I’m getting there.

Trying to hear feedback as about the work, and not about me, is not easy. On the whole academics are good at things and don’t like failing, but our work is always about failing. You’re never going to answer that question perfectly, you’re never going to be perfect. Let yourself be messy, let yourself fail, give yourself space to grow. How else will you know when you need to go to your colleagues for help, or when it’s time to stop bashing your head off the keyboard and go for a walk?

Self-reflection isn’t easy, but there needs to be a lot more of it in science.

Purity, Application and Function: The Real Problem in Science

 

Science is in crisis.

We’ve been hearing this from a wide range of fields, from students to professors, and perhaps most alarmingly, from two of the world’s largest democracies rejecting evidence based policy to elect anti-science policy makers. The culprit is claimed to be peer review, or badly understood statistics, scientists being too wrapped up in public engagement, scientists not doing enough public engagement, the terrible way we treat our science teachers, our devaluing of degrees . . .

I don’t think it’s any of these. I think the real cause of the scientific crisis is specialism.

Before going any further I want to point you towards two comics in the venerated xkcd. Purity and Degree Off. As an interdisciplinary scientist who named her blog ‘Fluffy Sciences’ I open many of my lectures with these concepts. I used to open with Purity long before Degree Off was posted because it makes such an important point. The culture of science has a deeply ingrained problem with application. The more applied a scientist is, the more we look down on them. A mathematician is worth a dozen engineers because at the end of the day, the mathematician can be taught to do anything the engineer can. As the mathematicians say, everything comes down to numbers eventually.

I am not immune to this belief. I’ve spent a lot of my scientific career fighting my own applied nature. When I was specialising in behavioural ecology I maintained that I was interested in the broader – and more serious – sphere of ecology. When I started working in ethology I clung to that behavioural ecology badge like a shield. When I realised I was getting deep into interdisciplinary territory I started reaching for the word ‘ethology’. If I had an ology I’d be fine. Interestingly, in my interview for my current role I was asked what attracted me to educational research. My answer was that I liked working at the coal face, I liked being able to quickly see the impact of a change.

My answer was honest, and applied, and reader? I have never been happier professionally than I am in my current role.

Recently I feel as though I’m hearing the same thing, over and over. Whether it’s what I have been writing in my application to the Higher Education Academy, whether it’s listening to how the Applied Animal Behaviour and Welfare MSc has changed over the years, or whether it’s listening to Dr Chatterjee’s SEFCE plenary on functional medicine, the problem that each person describes is the same: the specialists are only interested in teaching their subject, not the skills that the world desperately needs.

Chatterjee’s talk was interesting precisely because it set off many of my little professional bugbears. Chatterjee preaches Functional Medicine, a holistic approach to a medical problem that advocates multiple small harmless changes as a first line of treatment. In theory I love the sound of it, its very similar to the approaches I advocate for welfare assessment. But Chatterjee spoke of several case studies, he couldn’t evidence sustained behavioural change for his patients, and I was desperate to ask how such a change could be implemented in a health system which needs measurable metrics both for the assessment of new medics and the quality monitoring of existing medics. These are all serious questions for advocates of functional medicine.

During the talk I tweeted my thoughts, as I often do, and I tweeted that my quantitative heart and qualitative brain were at war when thinking about functional medicine. My heart, which truly loves the comfort of describing things mathematically, rejected functional medicine’s case-by-case approach. My logical brain, which sees the value of qualitative science, understood that the real goal was not making numbers perform on a chart, but changing the intangible and immeasurable experience of the patient.

We specialise early in life. Maths is separate from English in school. You can be better at one subject than the other. I think back to my early years at university. In first year I had three courses, biology, chemistry and archaeology. Learn the facts about biology, this fish does that, this dinosaur likely moved like this. Learn the facts about chemistry, hydrocarbons are stable, lab safety is important. Learn the facts about archaeology, these people lived then, this is the evidence they leave behind. Facts that can be regurgitated in multiple choice questions (a very efficient and useful method of assessing knowledge). Then in second year, 8 separate biology courses. In third year, four separate biology courses, in fourth year another four separate courses. All these courses that are set up independently, assessed independently, and brought together at the end with a dissertation project. 

This approach is a relic of university history where expert lecturers stood up to regurgitate everything they knew about their subject. We know that this is not the best way to teach (1, 2, 3) , and indeed even that it prevents students from making connections between subjects. Yet we persist in creating these divisions. Why?

In some respects it comes back to the need to measure success. It is always easier to measure something when you break it down into smaller chunks, and students need to be measured and to be told how well they’re doing. No student wants to study for four years and then have everything assessed at the end (well as a student that would have suited me perfectly but I don’t think I was normal). So there must be some break down of both the information and skills. The question to me is: what’s the most important thing you want every student to be able to do?

In the first year of your science degree what do you need to know? Do you need to be able to say that parrot fish are able to change sexes in single sex environments? Is it important for you to name every type of bridge structure? These may be reasonably interesting facts, but what is the application? In the last five years I have never been in a situation where that sort of knowledge wasn’t accessible via the small device in my pocket. We have out-brains now that deal with fact retention. Fact retention is the least important part of my role as a scientist.

Not only is fact retention not important for me, as an actual academic who works in research, but most of the students I teach are not going into the hallowed halls of academia. The zoologists are becoming bankers, the engineers becoming salespeople . . . regardless of what you think of it, the undergraduate science degree does not mean you will become a scientist. For those people, what’s the most important thing I could teach them? What’s the most useful thing for them to learn?

It is not the parrot fish.

 

Imagine a first year science degree where the first year looks like this:

Introduction to Science

By the end of this year you will be able to:

  • Identify an appropriate sample frame for a range of populations
  • Distinguish between interview and focus-group data
  • Discriminate between positive, negative and historical controls
  • Describe a manipulative study
  • Describe an observation study

Those learning outcomes are all assessable via variants of multiple choice questions, but also easy to evidence in class, providing excellent opportunities for both formative and summative feedback. This meets our need to measure and give feedback for our students. I would be delighted to even work with an MSc student who could do all of these, but they are still basic skills that any psychologist, chemist, physicist or biologist should really be able to do. Not only that but the banker and the salesperson, the people with the degrees who have no intention of ever doing research. These are skills that the world needs.

You could use examples from many different fields while teaching this subject. You could show how a focus-group responds to a new bread recipe, bring in some accessory knowledge from everything from agriculture to chemistry (Learning Outcome 2).  You could look at the testing of a bridge’s strength and compare that with observation of the bridge in use (Learning Outcomes 4 & 5). Even those students who do want to become scientists are interested in the how of the world, and all of these examples are interesting and worthwhile learning a little bit about.

Specialist knowledge is important, but specialists are by definition an expert in one thing. We need more people with more general knowledge. Science needs to get over its specialism fetish if it hopes to help the world move forward. Science needs to get over its specialism fetish if it hopes to help itself.

Being a physicist is not better than being a stamp collector. We shouldn’t be teaching students otherwise.

degree_off
“Degree Off”, XKCD – CC Attribution, Non Commercial

Bad Science Careers Advice

Oh, WayBack machine. You were supposed to help us find old Geocities webpages, lost in the midst of time, and now you help us see terrible articles written in Science Careers magazine. How we love you.

Picture this. You’re a postdoc, you’ve just started a new job, and your supervisor keeps staring down your top. You write to Science Careers for help, and the reply is . . .

Well read some of it yourself.

As long as your adviser does not move on to other advances, I suggest you put up with it, with good humor if you can. Just make sure that he is listening to you and your ideas, taking in the results you are presenting, and taking your science seriously. His attention on your chest may be unwelcome, but you need his attention on your science and his best advice.

Jezebel responded by saying it sets the ‘Sexist Incidences in Science’ calendar back to zero. Science Careers quickly pulled the article. I’m not sure what editorial team let it go by to be honest. But then, I think we’ve established that I’m not really au fait with editors in the science world.

We can sit and snipe about this, making funny comments, but here’s the thing – the letter writer is still sitting in this office with someone peering at her tits. So I’m going to answer her as I would answer one of my students:

Dear Alice Fluffy,

Q: I’ve just joined a new lab for my second postdoc. It’s a good lab. I’m happy with my project. I think it could really lead to some good results. My adviser is a good scientist, and he seems like a nice guy. Here’s the problem: Whenever we meet in his office, I catch him trying to look down my shirt. Not that this matters, but he’s married.

What should I do?

—Bothered

Dear Bothered,

Let’s start with the obvious here, this behaviour is bothering you.  You have a choice. Either you adjust your expectations and expect to feel uncomfortable in your place of work, with someone you are supposed to be working collaboratively with. Alternatively, you can raise the issue and hope that both you and your advisor, who is apparently nice, can both behave in such a way that you will both feel comfortable together.

It’s really not for me to tell you which path to choose. I think every woman has to pick her battles. In my career I’ve faced sexual harassment a few times, and I haven’t always taken action against. The truth is that harassment is subjective, and it’s not always a clear cut case of “this is wrong”.

The problem, however, is when someone like you or I wants to speak up, but doesn’t because they’re afraid of the consequences to their career.

As a society, we need to learn how to hear the words “this makes me uncomfortable” and not immediately take huge umbrage. Some people will tell you to put up with this, to live in a work environment that makes you feel uncomfortable. And here’s the thing – if you would rather do that than risk the censure of openly wanting an equal work environment, no one has the right to judge you. You only take on the battles you want to in this life.

But let’s say you do want this fight (because it could well be a fight), here’s how to start.

Do you know what the first aider’s golden rule is?

1) Protect yourself.

Never put yourself in a situation where you feel vulnerable. Start documenting now. Even just a word file with times and dates of meetings, what happened, when, how did it make you feel. Nine times out of ten, no one will ever see this but you.

2) Contact your equality and diversity officer.

All universities should have an equality and diversity officer. They will be in charge of facilitating your institute’s duty of care towards you (and yes, your institute does have one toward you – why didn’t I tell you this earlier? Because it’s their responsibility, not yours. You need to make the decision to do this yourself). They will be able to point you in the direction of further advice, and they may be able to instigate some staff-wide training.

3) Be prepared to say ‘bygones’

So far, your supervisor has irritated you, but they haven’t behaved obscenely. When they learn that their behaviour has made you upset, they’re going to feel bad about it. People respond to this in different ways. People who are genuinely nice will apologise. Slightly less nice people will try to just push through it and change their behaviour. People who are more like me will probably go bitch to their friends and be cool towards you for a while (this is okay, we’re none of us the villain in our own tale). True dicks will try to make things worse for you, that’s when you bring out the documentation and start the whole process again.

The point is, once you have addressed the behaviour, you have to take it as a learning event. Some people learn their lesson, some people don’t. You have to re-evaluate the situation after you have given your input to it, which is, essentially: I am bothered.

Be bothered. You’re allowed to be bothered by this. You’re a scientist, and you should be valued for what that brings to the table.

Good luck, Bothered.

The Empathetic Spreadsheet

Serendipity smiles on FluffyScience. I said I wanted to talk about the peer review scandal and the very next day I’m asked to act as the peer reviewer for the first time! If I ever needed an excuse to talk about peer review, I certainly have it now.

The peer review scandal everyone has been talking about is this: 120 computer generated conference papers were withdrawn by Springer. Including a delightful sounding paper about an empathetic spreadsheet. It sounds shocking. But it’s probably not quite as shocking as you think it is.

Let me explain using my own first hand knowledge of peer review. I don’t pretend to be an expert by any stretch of the imagination, but by fortunate happenstance I have enough publications, and enough different kinds of publications, to walk you through the process.

Have you checked out my Google Scholar profile? The link’s over on the right hand sidebar. Or just click here. You’ll see that there are currently five items in my profile. You can use Web of Knowledge instead but that requires an academic log-in, doesn’t update as quickly and isn’t as comprehensive in its record keeping. Therefore we’ll stick with Google.

All five of those publications have a Digital Object Identifier which basically means they have a permanent presence online. And they’re all linked to my name. The top three publications on that list are scientific papers. There’s MacKay et al 2012, MacKay et al 2013 and MacKay et al 2014. Then there’s a conference proceedings and a book chapter about the video game Halo (that’s another story).

Therefore I have publications in three categories: Papers, Conference Proceedings and Book Chapters. Now. Which publication wasn’t peer reviewed?

If you guessed the video game chapter, you’re correct. Video games, much as I love them, are not known for their rigorous peer review. You might be surprised to find that the Conference Proceedings (this one for the British Society of Animal Science (BSAS) 2012 conference in Nottingham) were, in fact, peer reviewed.

I’ve presented at two International Society for Applied Ethology (ISAE) conferences, two BSAS conferences, and two regional ISAE conferences. For all six conferences I have had to submit an abstract, a short description of what I intend to talk about. For BSAS the abstract is a page long, with references, subheadings and must present data in table or graph form.

This is quite unusual for my field, ISAE by contrast is something like 2000 keystrokes and frowns on references. On the other side of the fence, many of my colleagues have just submitted papers to the World Congress on Genetics Applied to Livestock Production (doesn’t it sound thrilling?) and these have been three pages in length. They’re papers more than abstracts.  But WCGALP only runs every four years and it is a very large conference, hence the extra work.

All of these conference papers will get comments back on them. Even the regional ones (although my last regional one was a comment simply saying I needed to be more explicit about what behaviour I was recording). The point being that a human has read these papers and passed judgement on it.

Here we stop and acknowledge the scientific committees of these conferences who have an extremely hard job reviewing so many small pieces of science.

So these 120 conference papers that were removed from Springer – what went wrong?

Well first off, many of the authors on these conference proceedings did not know they were co-authors. Someone submitted papers with their name on it without them knowing

But wait – I hear you say. Jill, your conference paper is on your Google Scholar profile. Wouldn’t you be suspicious if an extra publication cropped up? Yes, reader, I would. But note that despite publishing in six conferences only one of them is on Scholar. Why is this paper the lucky one? If I had to guess I’d say someone referenced something in that Proceedings, forcing Scholar to index it. But I may be wrong – Google’s not particularly clear on this. And some of these authors may be in the lucky position of having so many publications they genuinely don’t notice a few extra ones.

So why submit a fake paper with somebody else’s name on it? I’d be surprised if these papers are being presented at the conferences (although I’d love to hear the talk on empathetic spreadsheets). But what I do know is that those fake-papers have to cite other papers and another very important research metric is the number of citations you have. (Mine is a glorious 1).

Yes – fake papers are a problem. But it’s not a problem of bad results getting out there, it’s a problem of the system being gamed, and people using these kinds of research metrics as the only gauge of a researcher’s quality.

Research Metrics

There are ways around this. In the UK we have a new system for assessing research quality in Higher Education Institutes. It’s called the Research Excellence Framework (REF). Funding bodies use this to help them decide how to allocate funds over the next few years.

You enter REF as an institute. REF grades the papers submitted to them based on this framework.

  • A four star paper is world leading research, original, with great impact and the highest quality science.
  • A three star paper is pretty damn good, internationally recognised, good impact and high quality science.
  • A two star paper is internationally recognised as being original research, good impact and high quality science.
  • A one star paper is nationally recognised as being original research, good impact locally and high quality science.

 

The difference between these stars is really all about the impact of the science, which is great. Of course, REF has its own drawbacks. In the next few years you’re going to see a lot of UK papers with sweeping, statement titles instead of informative titles. A paper which would have been titled “The effect of indoor housing on behaviours in the UK dairy herd” will now be titled “Management systems affect dairy cow behaviour [and industry if I could wrangle that in there]”. You’ll also see a lot of new roles being created just before a REF exercise because the papers stay with the primary author. If you have a 4 star publication under your belt you become a Premier League footballer during the transfer season.

But one thing REF is  not vulnerable to is false publications. A panel of experts reviews all the papers that the institute chooses to put forward. No empathetic spreadsheets allowed.

We’ve just finished the first round of REF and it will be interesting to see how it affects research going forward. As animal welfare scientists we’re excited about the emphasis on impact, something we’re good at demonstrating.

Lastly, while 120 papers sounds like a lot, I’d like to direct you towards Arif Jinha’s 2010 paper which estimated that there are 50 million published articles out there. We are talking about less than 0.000001% of articles even if these were papers, never mind conference publications.

 

By that logic, my own publication records contributes 0.00000008% of the world’s papers. I’d better get cracking.