All 24 entries tagged Methodology

Change, uncertainty, and doubt: opportunities or challenges?

Change, uncertainty and doubt are three concepts that define the dynamics and intricacy of post graduate research. Change occurs as time progresses and can manifest itself in many different ways such as a change to research question, a change to the philosophical perspective, a change to methodology, and a change to research methods. The extent to which a design changes over time depends on the open mindedness, awareness, knowledge and skills that a researcher possesses, which entails realisation of any faults of their research design in relation to the context of the research.

I have experienced change to my research design from the research question all the way to the research methods, as I have been documenting on this blog for quite a while.

But does change entail uncertainty? Should change entail uncertainty? In what way should change be observed? In what way can we observe and deal with uncertainty? In what way should we manage change and uncertainty so that they can lead to opportunities and not difficulties? In what way can we manage doubt?

These are complex questions that provoke different answers. Different researchers will have different ideas about the certainty, or uncertainty, of their design based on their open mindedness, awareness, knowledge, and skills. Uncertainty could come about through a change in the initial selection of design components, which could cause the researcher to think immediately about the validity and relevance of the design to the context. In this context, change causes uncertainty particularly to the validity and relevance of research design. Alternatively, uncertainty could have caused that change to take place: comprehensive reading and thinking could lead the researcher to feel uncertain to the extent that changing a component eases this uncertainty. In this context, uncertainty causes change. When I mention uncertainty I’m talking about reasonable uncertainty and not emotional uncertainty; that uncertainty is born from reason and logically thinking about the design and relevant literature, and not some emotional connection with a particular component.

There is a third scenario: this uncertainty, whether occurring before or after a change in design components, might be found to be built on contestable foundations therefore further thinking and reading could actually render this uncertainty as invalid therefore no changes to research components would be required. In these cases, uncertainty and doubt might not come from this awareness and open mindedness but from other domains or dimensions of the self: confidence levels, self esteem, and so on.

In my opinion based on my own experiences, change can lead to uncertainty but that does not mean that it shall occur every time, and it should be embraced more as an opportunity to improve the design rather than opening the door to being defeated and consigning the design to the bin. During the past year or so I have continuously changed certain aspects of my design. A couple of main examples I have talked about on here is a change from pure qualitative methodology to a mixed methods methodology, and a change from constructivist grounded theory method proposed by Charmaz to a version of the grounded theory method developed by Strauss and Corbin. Additionally, the identification of critical realism as being the most appropriate philosophical guide of exploring the context and phenomena of interest.

These changes have introduced a mixture of uncertainty and certainty, and this still continues. I feel more certain that the research design is the correct way of exploring the phenomena of interest within the defined context as a result of all the literature that I am continuing to explore and question, as well as the critiques and arguments that are developing. But there is a continued sense of uncertainty because of the apparent uniqueness of the design within the context of the research, and therefore is in a sense unproven, and additionally few relevant theoretical and conceptual papers actually exist regarding the design specific to the context. This shall make the research itself a challenge in the sense that whilst certainty in the validity and feasibility of the design shall improve in the future, certainty in its verifiability and applicability cannot be reasonably determined until the research has been completed, although the trial study shall certainly help in this aspect. Even following the trail period I shall never reach absolute certainty about the research design: this is impossible without actually applying the design, reflecting upon the design, and critiquing it.

Change, uncertainty and doubt can bring about feelings of being overwhelmed (although that itself can cause uncertainty) and probably an element of self doubt. Whilst this is understandable (been there, done that, and shall no doubt go through such feelings again particularly of being overwhelmed), change and uncertainty need to be embraced as providing excellent opportunities for development. Embracing them as such opportunities shall lead to creative thinking and of developing unique solutions to existing problems, and therefore provide interesting opportunities to further the platform of debate and discussion about such solutions and problems. In my opinion, uncertainty about research design should be celebrated and embraced, because uncertainty can lead to a researcher’s most prosperous, creative, and inspiring design choices and insights into the phenomena.

‘till next time: keep calm!

Alex Darracott : 10 Jul 2016 20:09 |  Tags: Design Methodology Philosophy Reflection |  Comments (0) |  Close comments |  Report a problem

Progress On Grounded Theory

During the past week I have been reading about Strauss and Corbin’s version of Grounded Theory from philosophical and methodological perspectives in a continuous attempt to fit the method within the context of a critical realist led mixed methods design. As I have previously stated a little while ago I was a little overwhelmed as I came to realise the unsuitability of Constructivist Grounded Theory along with realising the extent and intensity of debates and discussions about Grounded Theory in general, and the implications this might have on the research design. Thankfully, it is all becoming clearer bit by bit!

Philosophy Of Grounded Theory

Reading through the materials so far again emphasises the importance of Ph.D. candidates engaging with their research at the Philosophical level as this shall enable them to fully understand the context and purposes of not only Grounded Theory in general but the different flavours of the method.

In general, Grounded Theory is automatically assumed to align with relativist or interpretivist philosophy and I suppose in a general sense this is true because all flavours of grounded theory involves an element of researcher interpretation of the data ranging from being guided by some sort of presupposed base of knowledge or theory to adopting a complete open mind. But each flavour of grounded theory has a different philosophical and logical approach to dealing with reality, and it was this understanding of Philosophy following adoption of critical realism that made me realise that constructivist grounded theory is inappropriate.

Variants of Grounded Theory subscribe to different assumptions about reality, although these assumptions have been and some continue to be debated in literature. Glaser and Strauss’ version of Grounded Theory aims to disconnect researcher from participants (value-free) therefore subscribing to a Postivist or Post Positivist approach to analysing qualitative data whilst Charmaz’s Constructivist Grounded Theory assumes a strong connection between researcher and participants (value-laden), therefore theory is a construction grounded in the involvement and interaction between researcher and participants. Whilst the position of both approaches are more or less generally agreed upon, the philosophical positioning of Strauss and Corbin’s approach has been and continues to be subject to debate and uncertainty. Charmaz claims that Strauss and Corbin’s approach to analysing data is positivism, but other researchers suggest that it adopts a more pragmatic approach to research. I’m beginning to develop the perspective that this version of grounded theory can be aligned with the principles of critical realism and other middle ground Philosophies. I have not fully worked it out, it is a complex process, but it is all starting to click into place and therefore I am beginning to understand it!

Method Of Grounded Theory

The aim of grounded theory is to produce a theory that is, you guessed it, grounded in the data, but the terminology used to describe the way that this theory or theorising is produced differs among different versions of grounded theory. Regardless, coding is used to produce this theory or theorising, beginning with the researcher reading through qualitative data (for example, an interview transcript) and breaking down the data into little blocks that represent some sort of action, event, and so on, gives it a label or a name and is therefore converted into an object, which is further defined through properties and dimensions, and are then classified into different classes or categories based on similarities of characteristics between objects, a process known as open coding.
Following this, identified classes are further defined through attributes and dimensions and subcategories are created from these categories as necessary through a process known as axial coding, and then the theory emerges through a process known as selective coding.

Regarding the logical engine behind Strauss and Corbin’s version of grounded theory this has been subject to debate: some authors suggest that it subscribes to an abductive logical reason whilst others suggest that it subscribes to induction, and again other authors suggest there is a mixture of logical engines. There is a potential incompatibility problem here because critical realism subscribes to a retroduction logic, which is different from the theory testing of deduction and the pure theory productive of induction as retroduction deals with the explanations of circumstances and is much more of a creative, abstract approach to explaining observations. There is a research paper that I have found that contributes to discussion of making critical realism and grounded theory’s logical engines compatible with each other so this shall be dealt with in time.

What’s next?

The next immediate task is to develop a more practical understanding of grounded theory and develop my grounded theory method through analysing the trial data. The trial data will be able to guide further development of the method and to really find out if Strauss and Corbin’s approach really best fits the context of research.

From a research design perspective I will have to do more work into figuring out the way that critical realism and grounded theory are compatible and can work with each other. Understanding of this is progressing but there is much yet to learn and discover, and to argue and to try to think about areas that have not really been thought about. But understanding is growing, slowly but surely. This is not to mention however the mixed methods context, so that adds a layer of complexity to the situation. Basically, I have to ensure that Strauss and Corbin’s grounded theory is not only compatible with critical realism but also compatible with other methods in a mixed methods environment, and if proven to be so draw a diagram that illustrates the way that critical realism, mixed methods, and all the methods interact and intersect each other.

Among the chaos and challenges, there is a sense of clarity beginning to form!

Alex Darracott : 05 Jun 2016 23:41 |  Tags: Design Groundedtheory Methodology Philosophy |  Comments (0) |  Close comments |  Report a problem

Reflection on the Literature Review so far

The development of the literature review of the thesis is not likely to officially begin till after the upgrade process although this has not stopped me from continuously thinking about the concept of a literature review, its aims and purpose, its structure and layout, and the approach of synthesising and analysing the literature that is to be included. Despite all the other work that needs to be completed in the early stages of the Ph.D., there is argument to suggest that there are important considerations in the early stages of the Ph.D. that can and will influence the literature review at a later time. The following represents my own advice based on the experiences so far on the Ph.D.

Think about it early, and never stop thinking about it

Think about the literature review right at the beginning of the Ph.D even when you are developing your proposal as part of your Ph.D. application. Form draft initial thoughts about what you want to achieve with the literature review and think about what authors you might want to include. I began thinking about the literature review at the beginning through for example deciding upon some of the authors and concepts that I want to include in the review. This however is a continuous and ongoing process because the literature review itself is a continuous, ongoing, dynamic document. There is no room for absolutism in my opinion when constructing a literature review.

Concepts change, your own understanding changes, your research shall change, the context shall change, the methods and methodology might change, and therefore your selection of literature shall change, and this especially the selection of literature shall change constantly as your understanding matures. Embrace it, feel challenged, push yourself and never give up!

Think about it early, think about it before starting the Ph.D., never stop thinking about it, and when you have written the literature review treat it as a first draft and keep thinking about it.

Make sure you record every idea, thought, inspiration, anything that comes to your mind about the literature that you read, or what you experience or observe no matter if it’s small or insignificant. Remember: my own research began as a small near insignificant observation on a teaching course that no other person picked up even though it was right in front of them!

Do not subscribe to a particular method too soon

This is quite important from my experience. To briefly explain, there are various methods used to analyse and synthesis existing literature: meta synthesis, meta-analysis, meta ethnography, narrative synthesis, critical interpretive synthesis, and mixed methods synthesis, to name a few.

Around the middle to latter part of the first year I decided to develop a critical interpretive synthesis approach, but the problem at this time was I had not fully realised the research design. At this time (and as has been thoroughly discussed on this blog) I was planning on adopting a Grounded Theory research design and was going to integrate critical interpretive synthesis data with grounded theory data. However, when I realised the faults of the research design I changed from grounded theory to a mixed methods design and subsequently realised that the critical interpretive synthesis approach was no longer suitable because it generates a theory from the literature and not the research data. I need to rethink the approach that I am going to be using to analyse and synthesis the literature.

Decide what types of literature that is to be included

This is a key factor in deciding the approach that is chosen to analyse and synthesis literature. My literature review shall be complex containing both quantitative and qualitative literature, with each type consisting of different methods, tasks, contexts and Philosophical perspectives. I have selected this extensive set of literature because it suits the mixed methods research design: because data in my research shall be generated from both quantitative and qualitative approaches, it makes sense to analyse both quantitative and qualitative literature.

The analysis of the literature shall be within the context of different concepts that define the general phenomenon of investigation. Defining concepts and developing conceptual understanding shall assist with allocating and categorising literature and therefore make the process of literature management a little easier. My research so far consists of four or five concepts, but conceptual understanding of these concepts are continuously developing, which influences the way in which literature is categorised and also the need to select and evaluate further literature. I shall explain this in a later blog post.

Decide on your research design

This, in addition to deciding the types of literature to be included in the literature analysis and synthesis, is a key factor in deciding which method to use to analyse and synthesis the literature.

Particular research designs shall make particular approaches to analysing and synthesising the literature unusable. A pure quantitative research design might work well with a critical interpretive analysis approach because the purpose of the critical interpretive analysis is to generate a theory from the literature, which can then be tested using a quantitative research design. A critical interpretive analysis therefore would not be suitable for a grounded theory based research design because a theory should be generated from the literature and not from the research data.

It’s an ongoing document

A literature review is continuously developing right up to the point of the point of formally submitting the thesis. It would be completely pointless to write a literature review in the first year of the Ph.D. and then submit it as it is with the thesis submission (around a couple to several years later) and not include any further, latest research. This would be identified in the viva as a serious flaw as the post graduate researcher would have failed to keep with up to date developments in their field and would reduce the authenticity and uniqueness of the research.

Summary

The key point of this blog post is to emphasise the importance of thinking about the literature review as early as you can. Considerations include: type of literature to include, the approach to synthesising and analysing the literature, and the overall research methodology. Remember that the overall research design and the type of literature selected will influence the approach to literature synthesis and analysis.

It is a lot of work and should not be taken lightly!

Alex Darracott : 24 May 2016 17:50 |  Tags: Litmanagement Litreview Methodology Reflection Thesis |  Comments (0) |  Close comments |  Report a problem

The Paradigms and Philosophies of Mixed Methods research: a whistle stop tour!

Those who have been following my blog during the past few months shall have noticed that Mixed Methods has been selected as the most appropriate methodology, that the Convergent Parallel design has been selected as the most appropriate variety of Mixed Methods, and that the methods of data collection have been decided upon along with most of the data analysis methods. What hasn’t been thought about till recently is the Philosophy of Mixed Methods.

Mixed Methods methodology developed as a result of the paradigmatic wars between quantitative and qualitative approaches: authors back in the 1960s and 1970s were adamant that both entail differing Philosophical and Paradigmatic assumptions and therefore frame the research in ways that were not compatible with each other. However, reconciliation between differing paradigms began and accelerated during the 1980s where writers opposed this methodological dualism.

Paradigmatic and philosophical assumptions and perspectives are extensive and the debates of suitability have been ongoing since reconciliation attempts began, so they are complex fields (seriously I am not kidden here: I’ve been thinking about this for years and I still don’t know everything and never will) where there isn’t a right or wrong answer. All that can be achieved is a researcher understanding their own views of reality and work towards developing arguments as to why their research contains particular paradigmatic and philosophical assumptions and perspectives. Do bear with me as I continue to learn and develop paradigmatic and philosophical assumptions about my research relative to a Mixed Methods methodology and also relative to the selected methods. This has to be a careful, thoughtful process: I cannot just select things at random. These assumptions are important to consider because they provide the basis or framework for a mixed methods project, or any research project.

There are certain paradigms (frameworks of research) that I can safely discard and suggest that they are not relevant to my research. This includes the feminism paradigm, which focuses research around women’s rights and whilst I have a lot of respect for women and their rights, feminism is not a part of my research so shall no longer be considered. The other paradigm is the Transformative-Emancipatory developed by Mertens (2003), which focuses on the intersection between Mixed Methods methodology and social justice although there is an observation that this has overlapped somewhat with the feminism paradigm. When you think about what feminism really means (not the extremists who perceive feminism as a male hating agenda) and its relationship with social justice, this makes sense. However whilst I have an increasing interest in social justice and this might be considered in future research projects it is not a part of my research currently therefore shall not be considered any further.

Moving toward discussions of paradigms that are more relevant, there is a selection of paradigms in relation to Mixed Methods that are most relevant for my Ph.D. The first is the PostPositivism paradigm, developed out of criticism of Positivism and therefore views reality as probabilistically true where Positivism (the paradigm of Science) views reality as really true and fully independent of the mind. Whilst PostPositivism works with quantitative methods and methodologies it also works with qualitative approaches and many who identify themselves as PostPositivists do utilise Mixed Methods. Another paradigm that is well acquainted with Mixed Methods is Pragmatism. Key differences between this and PostPositivism can be found at the Epistemological level in that PostPositivism understands reality as a single reality that is probabilistically true and independent of the mind whilst Pragmatists view reality as containing elements that are accessible and independent of the mind as well as elements that are constructed and therefore dependent on the mind. From an epistemological perspective, Pragmatism already leans more towards Mixed Methods than PostPositivism. However, Pragmatism is not without its problems therefore the third paradigm that is being considered is Critical Realism where apparently it can reconcile Absolutism and Relativism perspectives at the ontological level, whereas Pragmatism reconciles at the epistemological level from what I can currently understand but this does not appear to be reported much in the literature from what I have read so far. According to Creswell and Clark (2011) Critical Realism adopts and supports characteristics from both quantitative and qualitative approaches, although the use of Critical Realism is not as common as Pragmatism. But it has to be remembered that just because Pragmatism might be used more than PostPositivism and Critical Realism it doesn’t mean that it’s any more relevant to my research and the context of my research.

Additionally there are Mixed Methods projects that use multiple world views or paradigms, referenced as a dialectical paradigm, instead of a single paradigm, and have been based on the way that a researcher views social reality. Further, there are approaches that involving using multiple paradigms not in relation to the way that the researcher views reality, but of the type of Mixed Methods being used. For more information on this, read Greene (2007) and Creswell and Clark (2011)

As a side note, this whole linking between Philosophy and Methodology has been experienced in my research so far. Previously I had chosen to adopt a Constructivist Grounded Theory as the methodology and this entailed Relativist ontology and a Constructivist epistemology. Switching the methodology to a Mixed Methods approach entails a Philosophical view that in some way combines or reconciles Absolutism and Relativism ontologies and therefore Positivism (or PostPositivism in Social Sciences) and Constructivism epistemologies. It would not have been acceptable to have continued with a Relativist paradigm given that my research contains methods that include the collection and analysis of quantitative data, which aligns with a different paradigm. This would have been identified and critiqued in the Upgrade Paper and especially in the thesis and the Vivo examination.

So, gosh that was a long post! In brief, the paradigms that are of most relevance to this research are: PostPositivism, Pragmatism and Critical Realism. These shall be discussed more as I explore them in relation to Mixed Methods and in the context of my own research!

References:

Creswell, J.W., Plano Clark, V.L (2011): Designing and Conducting Mixed Methods Research (2^nd Ed). SAGE: America

Greene, J.C (2007): Mixed Methods in Social Inquiry. Jossey-Boss: San Francisco

Mertens, D.M (2009): Transformative Research And Evaluations, Guilford Press: New York

Alex Darracott : 22 Feb 2016 14:23 |  Tags: Design Epistemology Methodology Paradigm Philosophy |  Comments (0) |  Close comments |  Report a problem

Conflicting Issues In Literature: Design And Methodology

Another issue that new researchers and Ph.D. candidates shall have to deal with is the conflicting terminology within literature. Terminology is conflicting because writers use different terms interchangeably to mean the same thing but the meanings behind the terms differ significantly. In the case of this blog post, the terms “design” and “methodology” have been and continue to be used in literature to mean the blueprint of a research project but they are terms that carry different meanings and I shall use this blog post to present my own definitions (and add to the already confused mess of terminological definitions), which are probably likely to change in the future!

A research design is the blueprint of a research project: a logically designed or constructed document that defines the layout of the research project, illustrating through narrative and diagrams (usually the case for the thesis) the methods used to collect and analyse the data in a way that provides answers for a hypothesis or research questions. A research design illustrates the relationship between the defined research problem, the defined research question, the methodologies and methods, the underlying Philosophical assumptions of these methodologies and methods, and the way in which data shall be collected and used to answer the research questions. Research design should be considered and developed following the identification of a research problem and the construction of the research questions. The different research designs within Educational Research include Experiment based, Observation based, Longitudinal based, Case Study, Ethnography, Grounded Theory, and Phenomenology, among others, all of which define that previously mentioned relationship and characteristics of that relationship in different ways.

Methodology is part of a research design that provides a framework for the data collection and data analysis. A methodology defines the methods that are to be used, the approach or model used to implement the methods, the timing of implementing these methods, the importance of these methods, and therefore the way in which assigned questions shall be addressed and the data that is to be expected. The key difference between methodology and design therefore is that methodology does not explain the overall research problem or research questions, but is associated with a particular research question or questions to address a particular aspect of the research problem. A design does illustrate the overall research problem and questions and the relationship between the research problem, the research questions, the methodology, methods, and expected data in answering aspects of the problems and the questions. A research methodology can be quantitative, qualitative, or mixed methods.

I mentioned that Grounded Theory can be an overall design but it can also be a methodology within a design and, in the case of my research, a method within a methodology. Constructivist Grounded Theory was originally going to be a methodology within an explanatory research design, but this was dropped because Constructivist Grounded Theory as a methodology works exclusively with qualitative data. There was no way I could use quantitative data with the Constructivist Grounded Theory methodology therefore switched the methodology to Mixed Methods, and repurposed Constructivist Grounded Theory as a method within a Mixed Methods methodology. As I began to elaborate on my methodology in the Upgrade Paper I did come across a stumbling block: the literature and its conflicting approach to defining methodology and design, and authors were referring to Mixed Methods as both a design and a methodology.

What did I do to overcome this barrier? I thought carefully about the different types of Mixed Method methodologies and their suitability for the context of my research. The type of Mixed Methods that has been selected as suitable is convergent parallel and this has been referred to in the literature as a convergent parallel design although some authors have called it a convergent parallel model, but that’s just going beyond the point of driving a person insane.

I think therefore considering that the methodology defines the way that research questions are addressed, and that the design acts as the blueprint or illustration of the way in which the research shall proceed, it’s safe to say that the methodology is definitely Mixed Methods whilst the design of the research can be defined as a Convergent Parallel design.

This post is attempting to highlight the difficulty that some researchers might come across when dealing with terminology use in the research literature, and that it is so easy to be thrown off course initially as you try to develop a more substantial understanding of these terminologies. Developing that substantial understanding and a detailed, careful consideration of the terms “design” and “methodology” is the only way you are going to be able to properly define them.

Till next time: don’t accept a definition in the first resource you come across! Question and explore!

Alex Darracott : 10 Feb 2016 18:01 |  Tags: Design Dissertation Methodology Thesis Upgrade |  Comments (0) |  Close comments |  Report a problem

Thoughts On The Research Design

The previous week I had mentioned that the decisions made at a certain level of the research design can influence other decisions at other levels, so now I shall explain more about what I mean by that, with future blog posts delving into this further.

The research design is the description and documentation of the processes, and their interrelations, involved with the collection, analysis and use of data within a particular study. The design of a study is determined by the research problem that has been identified and the research questions that have been developed.

The first level that needs to be engaged with is the Philosophical level, and by this I mean the researcher, including the Ph.D. candidate, needs to establish their perspectives of reality (ontology) and the way that knowledge of this reality should be attained (epistemology). There is a large variety of different Philosophical perspectives from Absolutism to Relativist therefore it can take a while to establish understanding and even then this might actually change. As has been documented throughout previous blog posts, I had considered myself an Interpretivist and a Constructivist therefore holding a Relativist Philosophical position of reality and therefore of research. However as I further critically analysed the methodology that I had selected at the time the more I subconsciously began to align with a Pragmatist perspective of research. Subconsciously because I was developing a methodology that I thought aligned more with a Relativist position; briefly, I was trying to be a Pragmatist within a Qualitative methodology, and for this research that simply was not working. I realised that my research design was following a Pragmatist route when I discovered that a particular model of Mixed Methods methodology suited the problem and the questions. Everything then started to make more sense.

Have I always been a Pragmatist when it comes to research? Perhaps I always have and never really realised it till I had the opportunity to really think about my own views about reality, to select initially what I thought was the appropriate methodology and then to critically analyse this methodology within the context of research. What’s interesting about Pragmatism is that whilst some authors suggest that Pragmatism attempts to locate the middle ground between Absolutism and Relativism, it can be argued that being pragmatic about research can lead to a person being a relativist about research. This is because since Pragmatism allows the researcher to select the methodologies and methods that work best, those methodologies and methods would be selected relative to the research problem and research questions.

So after all that Philosophical thinking, is the rest of the research design easier? In theory yes; in practice, sort of! It is important to remember that a methodology and the subsequent methods cannot be selected without careful thought and consideration of not only the context of the research but also in the context of other methodologies and methods and their appropriateness. Remember as a Ph.D. candidate it is important to be able to learn about a variety of methodologies and methods so that it is possible to justify why certain methodological and method selections have been made, and to explain the inappropriateness of others. This is something that is ongoing with my own work, and I need to decide to what extent do I really engage with methodological debates and discussions and contribute to them.

There is a wide variety of different methodologies, methods, and approaches to using these methods, available to select and integrate into the research design but again what is selected must be the most appropriate to deal with the research problems and handle the research questions. A methodology therefore describes and analyses a variety of characteristics of the design including the general approach used to handle the problems and the questions, along with the methods used, the order in which they are used, and the importance of each method in providing the required data.

My methodology of my Ph.D. is Mixed Methods, with the specific model of the methodology being Convergent and Triangulated, referred also as the Convergent Parallel model, and the selection was determined by identifying methodological problems of existing research and the development of the research questions, along with understanding to the suitable level which methodology would best address the research problem and research questions. Briefly, the Mixed Methods methodology defines the use, ordering, importance and value of the methods in many different ways than other methodologies, such as a case study, and remember that each model of the Mixed Methods methodology differ from each other slightly in these respects.

So, when the methodology has been decided upon it’s time to choose the methods. Whatever methods are suitable for the methodology is endless as there is no right way and depending on their structure a method can be used with multiple methodologies. As an example, the case study methodology can be either quantitative based, or qualitative based. If the case study is to be quantitative then methods that generate figures and numbers would be used, such as closed questions on a questionnaire; qualitative based case study methodology would need methods that generate data that expressed the perspectives and experiences of the individual, such as an Interview technique. With Mixed Methods methodology this is even more complex, because it can’t be either quantitative or qualitative: both strands have to be used and therefore there is wide variety of methods that can be used and several ways in which these strands can be converged or combined appropriately.

Developing the research design is a complex task and goes way beyond what has been described in this blog post. I’ve simply presented a general overview of some of the ideas that I have about research design and some of the key points that need to be considered carefully when designing research. I’m still learning; I’m still learning about my own research design and still adjusting the design in accordance to what I am reading not only from research methodological textbooks but also the way that other researchers have implemented methodologies and methods and designed their research in general, particularly those relevant to the Mixed Methods designs. I have decided fully on the methodology as Mixed Methods, the model of Mixed Methods as Convergent Parallel, and decided on the data collection and most of the analysis methods that shall be used. The key areas of the design are now in place with the finer details of the design continuing to be thought about.

The sheer amount of Philosophical perspectives, methodologies and methods that can be thought about and used is diverse and complex, with much overlapping, but must be something that the new researcher including Ph.D. candidates much engage with. It simply is not the case where a Ph.D. candidate can jump into a research project with any random methodology and methods because this might go against the Philosophical stances that the researcher is claiming. Apparently in several Ph.D. theses a researcher would claim to follow a relativist position when they use methods that subscribe more to the positivist position. So this needs to be carefully thought about. Additionally therefore there is a need to be fully aware of all the methodologies and methods that can be used, select that or those which best fit, and develop argumentation as to why those methodologies and methods are most appropriate. In my opinion, the argumentation that develops to justify and defend methodological and method selections, and the overall design of the research, is just as important as the selection itself.

Till next time: keep thinking!

Alex Darracott : 29 Jan 2016 17:34 |  Tags: Design Methodology Philosophy Research |  Comments (0) |  Close comments |  Report a problem

Engagement at the Philosophical level

The Ph.D. is not just about generating new knowledge about a phenomenon: it is also about being engaged at the Methodological and Philosophical levels. Being engaged at the Methodological level means really thinking about the methodologies and methods that have been used to explore and develop new knowledge about the phenomenon of investigation. The uniqueness of a Ph.D. therefore lies not just in thinking about it in terms of developing new knowledge but about the way in which this new knowledge is developed and understood. Being engaged at the Philosophical level means to think about your own perspectives of reality, the way that knowledge of this reality is collected, and understanding a variety of different Philosophical perspectives of reality and their relevance towards the research project along with understanding the way in which your perspectives of reality influences research design. This post shall deal with being involved at the Philosophical level.

Previous Thinking

Previously I thought of myself as a constructivist, an interpretivist, a relativist and a contextualist. I began to reject the notion of an objective reality and therefore had the idea that we create or construct our own reality, that therefore reality is a little different for each of us and that the way we come to understand and attain knowledge within this reality is different for all and our perceptions of the usefulness of related processes also differ.

This view was initially reflected in my own research design through favouring a qualitative methodology and using qualitative based methods to explore the phenomenon of interest. As time progressed however and a more significant understanding of the research problem and research methodologies was attained, I began to grow an appreciation for quantitative methodologies and methods. Philosophical and Methodological battles therefore began to occur as I attempted to understand the way that quantitative data could be included in a qualitative methodology. These battles were a reflection of the fact that what was occurring was going against the way that I perceived the relationship between reality and research exploration with Social Science disciplines: that you cannot define behaviour and generalise behaviour of phenomena through using statistical analysis and relationship between variables. But the more I thought about this (and the more that I continue to think about this) the more that exploring particular aspects of the phenomenon using quantitative analysis made more sense. Using a methodology where quantitative and qualitative approaches complement rather than compete with each other made more sense when an aim is to attain a substantial understanding of the phenomenon.

Current Thinking

There appears to be a group of researchers who subscribe exclusively to quantitative methodologies and methods and therefore perceive reality as absolute; that reality exists independent of our thoughts and behaviour of the mind and therefore can be understood through deconstructing or reducing reality down to a series of variables and exploring relationships between them. There is another group of researchers at the other side of the Philosophical and Methodological Spectrum who are exclusively qualitative; that they perceive reality as being relative and contextual, and that therefore each person develops their own reality within the context they are within. Then there are those in the middle who believe that reality can be understood through the complementation of both perspectives. Remember however that within Mixed Methods there can be no “mixing” or combining of these perspectives, only that they are used to deal with separate but related research questions and problem areas.

So where do I stand with all of this at the moment? I still consider myself as a constructivist: I perceive reality as being subjective, that each of us develop our own realities and that this construction of reality and reality itself is relative only to the context that we are within. But, I do and am beginning to value the quantitative relative to my own research problem and research question therefore I would place my own perspectives and research itself now towards the middle.

General Thoughts

Note that I am not suggesting that all Ph.D. candidates should immediately start considering the middle as the answer to everything. Which side you place your research is influenced by your own stances and understanding of its Philosophy and Methodology, and a sound grasp, understanding, and critical analysis of the relevant, current literature. The research questions, the research problems, the research purposes, the methodology that you select, and methods that you adopt should be led not by your own agendas and Philosophical perspectives, but by the needs identified in the literature.

What are you really investigating? What do you want to investigate? What are the constructs of your research? What are your Philosophical views? What way do you perceive reality? What methodology are you adopting? What methods are you going to use?

All these questions, and more, should be led by that understanding of the literature, and your own biases and assumptions need to be placed aside as much as possible. But this is not always achieved, as even the most objective person has even the smallest amount of bias and favourability towards particular research methodologies and methods. Researcher bias therefore is a big topic of debate within academia and the way in which researcher bias influences the results and therefore questions are asked as to what influences researcher bias to occur in the first place.

It is challenging when you really start questioning your own perspectives because some can go into a complete denial about the complementary aspects of differing methodologies and methods, but this is a challenge that all Ph.D. candidates should tackle. Again, don’t feel that you should subscribe to a particular methodology or method just because it appears fashionable, but go with what is right for your own research questions and problem areas. Once you feel authentic, you begin to produce authentic work, and therefore raise the respect and authenticity levels of research work as a whole.

‘till next time: question yourself and your views of reality, and do what is right for the context you are in!

Alex Darracott : 17 Jan 2016 15:20 |  Tags: Design Epistemology Methodology Philosophy Prd |  Comments (0) |  Close comments |  Report a problem

Methodology now in place: the convergent flavour of the Triangulated Mixed Methods methodology!

The methodology has been set in place and that is the Mixed Methods methodology; specifically, Triangulated Mixed Methods methodology (triangulation simply means to collect and analyse data from multiple sources using multiple methods in order to increase validity and reliability of the research findings: more about this shall be discussed in time). There are various flavours of Triangulated Mixed Methods each of which having a specific, clear, concise and contextually defined set of objectives therefore each flavour is suitable for a particular purpose. Out of all of these flavours I have decided to select the convergent flavour of the triangulated mixed methods methodologies.

Triangulated Mixed Methods Methodology: the Convergent flavour.

This convergence design has been termed in various ways in existing literature including “convergent parallel” design, but regardless the aim of this flavour is to converge quantitative and qualitative findings at the interpretation level. This shall enable the findings to be compared, contrasted, corroborated and related (hence convergence) in order to discover similarities and differences in order to increase validity and reliability of research findings (hence triangulation). But there are other interesting potential uses for this converged (or mixed) results such as developing further research methods to explore further aspects of the phenomenon that were not been previously considered.

Other varieties of Mixed Methods and indeed other flavours of the Triangulated mixed methods differ in the order of which quantitative and qualitative data should be collected and analysed, whether or not the quantitative or qualitative data should be independently collected and analysed or integrated at various stages, and the importance or weighting of both types of data. The Convergence model encourages the separate, independent collection and analysis of quantitative and qualitative data, but converge at the interpretation stage. The model also promotes a concurrent (where both quantitative and qualitative can be collected simultaneously within the same time phase of the research) approach to collecting data instead of sequential (quantitative then qualitative or qualitative then quantitative). This means that the findings of the quantitative does not influence the findings of the qualitative, and vice versa. Basically they are both collected at the same time, but do not influence each other or data collected using other methods. What this can do however is influence the design of any further methods that might be used throughout the duration of the research. Further to this, the model also encourages an equal weighting of quantitative and qualitative data in answering research questions and dealing with aspects of the research problem.

More questions!

The key decisions have been made with each decision bringing about more questions and challenges that need to be addressed, but this is the case with all decisions made about research design. If you are not generating any questions about your research design as you go along then your inquiry into your own thinking, perspectives about reality, purposes and uses of your own design and a complete and full understanding of the underlying problems and questions and the relationship between these and the design shall be unguided and chaotic. Questions bring order and a sense of direction to any research project, that their development and refinement are continuous, and is something that each Ph.D. candidate should be engaged with at all levels and stages of their Ph.D. research.

Therefore, the selection of the Mixed Methods methodology, the selection of the type Triangulated Mixed Methods, and the selection of the Convergent flavour, along with the previous selections of specific methods that shall collect quantitative and qualitative data and the ongoing decision making regarding data analytical methods, introduces many more challenges and questions than answers! There simply does not appear to be any right or wrong answer or approach to deal with any of these challenges or questions: what therefore needs to be done is attain a full understanding of each challenge and question, carefully read and analyse relevant literature, and develop a solution or answer with suitable argumentation.

Key questions are: could mixing of the data occur at both the analysis and interpretation stages? Would this approach to mixing be appropriate for my research? What could the potential findings be? What implications could this have on any aspect of the research design? What implications could this have on the rigour, validity, reliability, generalisability, completeness and comprehensiveness of the findings, discussions, and research design overall?

I am not in a position to answer these questions yet, but they along with all other questions and challenges, and every other question that shall occur in the future, shall be answered in time!

‘till next time: let your research design be guided not by your answers but by your questions!

Alex Darracott : 17 Jan 2016 15:14 |  Tags: Design Methodology Mixedmethods Triangulation |  Comments (0) |  Close comments |  Report a problem

Revisiting Philosophical and Methodological problems, and solving them!

During the past few blog posts I have been discussing the various Philosophical and Methodological problems that have occurred even before the time that Constructivist Grounded Theory was initially considered as an overall methodology. It was realised that this really was not going to work and therefore scrapped plans to use Constructivist Grounded Theory as a methodology and instead decided to use Mixed Methods methodology; more specifically, Triangulated Mixed Methods methodology, whilst using Constructivist Grounded Theory as a method along with other methods to collect and analyse data. It did not take long to realise that this form of Mixed Methods would practically answer those questions that I have been asking for a while.

Philosophical Problems

The central problem I had was reconciling differing Philosophical perspectives: Positivism and Interpretivism. Even when Constructivist Grounded Theory was replaced with Triangulated Mixed Methods methodology the reconciliation between widely differing Philosophical perspectives was not apparent straight away.

Whilst reading through the Philosophical literature of Mixed Methods methodology it became apparent that merging or combining these perspectives is impossible and not desirable in Mixed Methods methodology. This is because the differing Philosophical perspectives entail particular methodologies which themselves entail the development of particular methods that address different but related questions, sub questions and problem areas of a wider research project. In my Ph.D. research for example the research problem and research questions have been designed in a way that entails the need for differing Philosophical perspectives and therefore differing methodologies and methods to properly investigate the phenomenon of investigation.

From this, Mixed Methods methodology makes sense to use because it enables the mode of inquiry to encompass two related but separate Philosophical perspectives that deals with different questions and problems of the same phenomenon. But what of the Philosophical perspective of Mixed Methods? There is a general consensus in the literature that the Philosophical perspective of Mixed Methods is Pragmatism, which is a Philosophical orientation of reality that defines research design in terms of its usefulness and that it works to an acceptable level. What this basically suggests is regardless of the Methodological perspectives that are a part of a research design, as long as it is purposeful and explores the phenomenon of investigation as required, then it’s an acceptable research design. In addition to Pragmatism some papers reference methodological relativism as the key perspective but this shall need further exploration. Some initial thinking suggests that Pragmatism and Relativism along with Contextualism and Interpretivism could be all related in some way but this needs further exploration. There appears to be plenty of debate and discussion of Philosophical perspectives of Mixed Methods methodology and these shall be explored in time.

In all however, Pragmatism appears to be the overarching Philosophical perspective and has therefore answered my question about Philosophical reconciliation, but shall be reading further into Pragmatism as a research design Philosophy. So, what of the methodological problems?

Methodological problems

Any Philosophical problem of a research design introduces a Methodological problem because they are related. The Methodological problem that was encountered at the time therefore was the merging or combining of quantitative data and qualitative data in order to correlate, combine, merge, and corroborate data as fully as possible in order to present a holistic analysis of the phenomenon of investigation. Just like the Philosophical problem, it was realised that the Methodological problems would be resolved simply through introducing Mixed Methods methodology.

Mixed Methods methodology offers a number of different solutions to the problems of mixing quantitative and qualitative data and I have decided to go for mixing at the interpretation stage. What this means is both quantitative and qualitative data shall be analysed separately using their respective sets of analysis methods, but the discussion shall corroborate, compare, contrast, and relate quantitative findings and qualitative findings. This obviously has been noted in academic literature as being challenging and I shall talk about this another time, but in the meantime I think this approach to dealing with the methodological problem works. Additionally, mixing could take place at the analysis level therefore qualifying the quantitative data and quantifying the qualitative data although I am not sure at this time if this would be really relevant. This shall need further investigation and thinking.

So in summary: the previous Philosophical and Methodological problems have been resolved simply through changing the methodology itself, but this has introduced pages of new questions that need exploration, and the answers to those questions shall produce more questions but that is the way research works!

‘till next time: you won’t learn unless you ask, but be prepared to ask more questions from the answers!

Alex Darracott : 15 Jan 2016 18:41 |  Tags: Methodology Mixedmethods |  Comments (0) |  Close comments |  Report a problem

Methodological Breakthrough, Part B: Introducing The New Methodology!

Introducing Triangulated Mixed Methods Methodology

Ta da! This has come as a breakthrough for my research as I have now identified what I believe to be the research methodology that is most suitable for my research. Triangulated Mixed Methods is a research methodology that applies Triangulation approaches within the context of Mixed Methods research, which essentially according to some writers enable higher levels of validity and reliability through comparisons and corroborations of differing types of data from different sources, which exactly matches my vision of my research project.

From the initial rereading, Cresswell provided the clearest and most useful definitions of this type of Mixed Methods methodology that convinced me of its suitability. Cresswell describes Triangulated Mixed Methods Methodology as suitable for research projects involving comparisons, validations and expanding discussions between quantitative and qualitative findings. This is suitable for my project because it will involve comparing quantitative data with qualitative data and using these further analytical comparisons and discussions to expand on separate analyses and discussions that shall be made with each data set in the thesis.

There are other reasons, but that was the major, influential definition of Mixed Methods that has encouraged the favoured methodological view to Triangulated Mixed Methods.

What does all this mean now for my research Methodology and research Philosophy?

In brief: Triangulated Mixed Methods methodology is now the research methodology for my Ph.D. with Constructivist Grounded Theory now being used as a research method along with questionnaires. Interview and focus groups shall be used in addition at a later stage as and when deemed necessary. This obvious impact on my methodology will have an impact on my research Philosophy, although the Philosophical assumptions and perspectives of Triangulated Mixed Methods, and Mixed Methods in general, appears to be highly discussed and debated by a lot of authors and Philosophers (oh fun!)

So will this methodology make reality any easier to understand?

Er, no, well, it will, eventually! Basically, even years before starting the Ph.D. I had an idea that my research would be quite complex because what I am doing is exploring perceived learning (quantitative data, qualitative data) and actual learning processes that take place (qualitative data, mostly). This direction has not changed; it has only became more specified and detailed but I am not going to discuss the specifics on here: I shall leave them to my future published research papers and thesis. The methodology now selected makes a lot more sense to me because it allows me to investigate the phenomenon in exactly the way that I envisioned.

What next?

Loads. Sheer absolute loads to do, which is fine because it gives me plenty of blog material! Methodologically speaking, I need to select the most appropriate variant of the Triangulated Mixed Methods methodology to use, as there are several variants that have been designed and debated, although I already have a fair idea but need to do more reading and experimenting into this. Also, I need to identify Philosophical assumptions and develop Philosophical arguments for using Mixed Methods methodology and this shall take a little while given the amount of debates from various authors. Following this, I then need to carefully plan the way that Constructivist Grounded Theory and Questionnaires shall work effectively within a Triangulated Mixed Methods methodology, and carefully think about the practical assumptions and considerations that Triangulation makes upon the data analysis. Not only this, but I also need to carefully consider the Philosophical assumptions, arguments, practical applications and so on of both Constructivist Grounded Theory and Questionnaires and the way that a Triangulated Mixed Methods methodology actually bring these Philosophical and Methodological differences together in the way that research objectives are achieved.

Additionally I need to carefully consider the way in which the methodology and methods all come together to deal with issues of data validation, integrity, reliability, consistency, coherence, authenticity, and so on, and also develop ways in which challenges that each method and the methodology provides shall be carefully managed, maintained and dealt with so that any data errors are avoided as best as possible.

All this and much more shall be considered within the thesis and various research papers that shall be published from the research. Now that the methodology and methods are set, I can begin to think about, within the context of my research, all these Philosophical, Methodological and practical issues and much more than has been discussed here as I think I have wrote enough about the subject for the time being!

‘till next time: is there really such a thing as objective reality?

Alex Darracott : 09 Jan 2016 21:30 |  Tags: Groundedtheory Methodology Mixedmethods Qualitative Quantitative |  Comments (0) |  Close comments |  Report a problem