Mixed Methods Research Design: Should This Now Be Considered Suitable? , 04/04/18, A.J.D's Ph.D progression blog

April 04, 2018

Mixed Methods Research Design: Should This Now Be Considered Suitable?

This past weekend has encouraged me to re-evaluate and re-explore the value of using both quantitative and qualitative data within my research project. This is an ongoing task that demands careful and reflective thought, and currently constructing diagrams that illustrate aspects of the design and the way in which these different aspects relate to each other, and the way in which the research shall now progress. Once I have completed these diagrams I shall be sending them to my supervisor for further feedback and confirmation of the design’s suitability. There are, not surprisingly, many thoughts, questions and ideas that I have about the emerging research design. As mentioned, going through all these thoughts, questions and ideas is an ongoing process but there are some key questions and ideas that I am focussing on at the moment with regards to the characteristics and aspects of the research design.

Firstly, and probably most importantly, should I reemploy a mixed methods approach? Is a mixed methods approach actually possible given the data collection context? Instead of collecting qualitative and quantitative data separately as is typically found in most mixed methods research, I have collected qualitative data and from this data set, both qualitative and quantitative data analysis shall be applied. I have a vision about what qualitative and quantitative data I want, but I am working through how this is going to be precisely and exactly realised particularly the quantitative aspect. I realise therefore I am not using mixed methods at the data collection level, but there appears to be a mixed approach at the data analysis methods level. This has implications at the methodology level: should mixed methods be confirmed as the appropriate approach to the research, then grounded theory becomes the qualitative method and not a methodology, whilst network analysis or some form of it becomes the quantitative method.

But here’s something to think about, and forms my second current thought and question: what comes between grounded theory and network analysis? What acts as the bridge that enables qualitative data to cross over into the quantitative realm? I think the answer lies in visualisation. In my understanding, a network is a visual representation or diagram of what is happening. A phenomenon can be understood through its aspects, features, events or activities and these can be represented as a network of nodes and connections. What I am attempting to do here is convert the concepts, categories and their relationships, products of grounded theory analysis, into a network. I am slowly working through how these grounded theory concepts can be converted into aspects of a network and this is going to take some time, but currently I am thinking that concepts and categories can be represented by nodes, and the relationships between categories can be represented by connections between nodes. What I am also interested in is exploring the relationships between these nodes because it is at these points where interesting observations and values can be obtained, but I’ve yet to figure out the way this can be fully considered. I’m thinking at the moment these relationships shall be related to the hypotheses that shall be developed as well as the properties and dimensions of categories and might also might be involved with quantitative analysis. The quantitative analysis shall be used to analyse these relationships to determine the strength between different types of nodes within different contexts, but the exact relationships and hypotheses that are to be explored are undetermined at this time and shall be until the qualitative data analysis section has been completed. This in a sense brings me to a third concern I am working on.

If my research is to adopt a mixed methods methodology again, what type of mixed methods should it be? My previous approach to mixed methods was a sequential exploratory type where qualitative data were to be collected and analysed first followed by the collection and analysis of quantitative data. This was therefore sequential in nature but I am not sure at this time whether my mixed methods approach now would be sequential or transformative: sequential because qualitative analysis will come after qualitative analysis, or transformative because it might be that some aspects of the qualitative data might be transformed into quantitative data. Is this even possible? It is in some context but I’m not sure if my qualitative data will be able to transform into quantitative and I am probably unable to know this till the qualitative analysis phase is complete and I begin to really look at the findings. At a push at the moment I'd say sequential exploratory: might be best to design both types just in case!

There are many other concerns that I now have that I shall be exploring further as my thinking and experimenting of the potential mixed methods approach progresses: in what way should I now present my research questions? The research questions shall have to change to better represent a potential mixed methods approach as the questions cannot be purely qualitative: a question must be qualitative and another must be quantitative but derived from an overarching question that brings both together.

Also, what are the implications on the use of literature and the roles of the literature reviews? At the moment I cannot imagine there being too many changes because of the important role that grounded theory shall continue to play in terms of identifying the nodes and connections of a network, which shall subsequently have some form or forms of quantitative analysis placed onto it (is this really network analysis, or something else?) although I shall have to double check the role of literature within mixed methods research.

What about the product of or the outcomes of the research? What is the nature of theoretical development within mixed methods research? A key role of mixed methods as described in some of the methodological literature is to both build and test a theory and / or a set of hypotheses. The qualitative aspect builds theoretical constructs and hypotheses and the quantitative strand tests these theoretical constructs and hypotheses.

What shall be or should be the extent to which grounded theory is used? Should I use grounded theory to the extent that a general theme of the learning phenomenon can be established and use that as the basis of the network construction and exploration? Or, should I use grounded theory to the extent that categories, relationships and hypotheses can emerge from the data, but use an existing overarching theoretical framework to guide their use in the network construction, and use quantitative analysis to test the identified relationships and hypotheses that come from the qualitative stage? I am not sure at this time.

What about the case study methodology? Should I return to thinking about the value of a case study methodology with mixed methods approach encased within? There is some debate about whether or not a mixed methods approach really is a methodology and not just a strategy of the way in which methods are to be sequenced or arranged. I shall have to revisit this debate area.

I have so many questions at this time, so many more than answers but I have a plan to work through all these different questions and issues that I have discussed here and more besides. I shall probably be writing on here on a regular basis now if only to document this challenging yet exciting journey and therefore to help me reflect upon my ideas and their development.

Thanks for reading! If you’re on your Easter holidays still, continue to have fun!