All 9 entries tagged Research Design
View all 11 entries tagged Research Design on Warwick Blogs | View entries tagged Research Design at Technorati | There are no images tagged Research Design on this blog
December 31, 2019
Reflections Of The Year 2019
Reflection is an intellectual endeavour and process that should occur continuously throughout the journey of a Ph.D. Reflection acts as a means of learning through enabling the charting and tracking of developments in our understanding, the various points or events that have resulted in those developments, to understand and identify patterns of problem resolution, and studying how our prior understanding, meaning and learning have been used in order to progress and enhance ourselves and our research further. In a nod to Philosopher Heidegger we could argue that we are reflective beings. We are continuously learning and developing through engaging with reflective processes, and through constructing meaning of these reflections. Although we are arguably reflective beings and therefore do not generally subscribe to any arbitrary and culturally acceptable reflective time points, it is an idea to use particular times to stand back and attempt to view the wider picture. It is with that in mind that I progress through this time of reflecting, learning, planning, and strategizing.
When I reflect back on what has transpired through the year I can observe moments of great personal success, and moments of feeling completely overwhelmed and very challenged academically. Completing the coding framework towards the summertime was a great personal success and the process of completing the framework drew me closer towards a fascination of qualitative research. Throughout not just this part of the year but the whole year, my philosophical, methodological, and data conceptualisations and understanding continued to develop and redevelop as I encountered various insights and constructed and questioned my own meanings of these insights. This questioning is continuous and ongoing: I am continuously questioning and evaluating my insights and the process of arriving to my own insights, and continuously evaluating new insights relative to my prior insights and understanding in order to arrive at new understanding that more closely represents the phenomenon of interest. Not only this, but I am also continuously developing and defining my own position and role as a qualitative researcher and what it means in general to ‘be’ a qualitative researcher. This is a very complex area and I am realising that I’m going off topic……
Along with completing the analytical framework, I was also completing various thesis chapter drafts and this drafting continued till around late September or early October. Prior to this completion, however, around the summertime I was beginning to find some of my analysis questionable. The analysis was suitable in the achievement of constructing a coding framework, but was not able to provide significant and detailed explanations about the process of the particular social learning phenomenon being investigated. I then realised that the problems experienced earlier with Grounded Theory were being experienced with thematic analysis. This was both a good and an overwhelmingly challenging thing. A good thing because it helped me to critically evaluate thematic analysis and grounded theory further as means of analysing social processes. Although it was right to develop the coding framework, I had to figure out a way in which I could use that framework to identify patterns of social learning. I needed to apply further analytical methods, and this led to (a) the need to overhaul my thesis chapters, (b) reconceptualization of the data, and (c) being completely overwhelmed!
The addition of extra analytical methods alongside thematic analysis was considered for a while. A conversation with my supervisor, however, confirmed the need for these methods so they were adopted. Alongside thematic analysis based methods, therefore, I added basic quantitative methods, and a pattern identification process. I shall not talk much about these methods here now simply because these methods might need redevelopment as I retest the coding framework against the entire collected data, and as I, therefore, use these methods to analyse a greater range of data, think more deeply about how these methods relate to my philosophical position and methodological perspective, to further the discussion and justification of them, and think more about how they interconnect. They have been discussed to a certain extent, but I feel that during the year these discussions and justifications shall be further enhanced and developed.
It suffices to say, however, that reflecting on their application in the research so far, it is clear to observe that when comparing all three different methods (thematic, basic quantitative, and pattern identification), each provided results that supplemented each other but also, unexpectedly, contrast each other, and provide a large volume of insights and observations about the phenomenon that were not previously considered or thought possible. The unexpected nature of these insights and the behaviour of the methods, and the volume of these insights, were completely overwhelming. My previous findings, understandings, and interpretations of the data, and developing conceptions of the phenomenon were challenged. These insights provided new opportunities to explore and explain the phenomenon of interest relative to the research question.
That was probably the most challenging academic experience I have come across so far. Challenging because of my preconceptions of the phenomenon and assumptions of what could be found by each method, built from what I had observed through coding data and building themes of the data. Although it could be argued that preconceptions are a hindrance (this has been argued in literature), I found that they were not blocking my ability to perceive and observe new or unique insights. In other words, I found that I was not attempting to “stuff” the new findings within my own preconceptions. I remained open minded and willing to accept that there might be something new and contradictory, and where contradictions were found they needed to be reasoned or resolved in some way. When I really think about it, those preconceptions were not a hindrance to my learning, but provided a platform upon which further learning occurred whilst being open or sensitised to the possibilities of there being something new. This is a substantial debate within the academic field.
Moving on, it was a significant and very important moment for many reasons for my research and how I understand myself and my research at the philosophical, methodological, personal and practical levels. It is all these considerations that have led to the requirement to overhaul the thesis chapters, and this began in November with the rewriting and reconstruction of the literature review. This is due to be followed up over the coming months with overhauling the research design, findings, and discussion chapters and these shall be discussed on here in time.
Where does all this lead me? The future! I am structuring a longer planning time frame in order to plan the tasks and activities to engage with over the comping months, and as a part of this I shall be writing a series of blog posts that documents the plan for the coming months, whilst accepting that I might come across further analytical ideas that were previously considered irrelevant or unexpected.
Briefly, however, the following tasks are to be engaged with:
The discussions that I have made so far as a result of the new insights and new analytical additions are continuous and ongoing, and any assumptions and interpretations of these findings will need further testing and refining as I rework the analysis. I had conceptualised the phenomenon in a way that entailed the analysis of certain types of data segments, but the new insights is now encouraging me to explore the whole data in order to build a much wider picture in accordance with the research question.
Each thesis chapter shall be given further edits and a complete overhaul where it is considered necessary in order to accommodate and best explain the new insights and the implications of the additional analytical methods. I shall initially establish a new outline for each thesis chapter before proceeding with the writing (and, of course, discuss it on here!).
The analytical framework shall be further tested in different contexts. I am not in a position to suggest any changes that could or could not occur, it all depends on what is interpreted from the data and how the framework matches up with the data (framework had to align with the data, not data aligning with the framework. This is process known as ‘stuffing’ the data to fit the framework, and it arguably does not work).
The other main task is to publish as much as I can in academic journals. I do feel now that I am in a position where I can get my findings and philosophies in publishable form during the year. Of course my ideas need some reworking before being publishable, but it is my aim by the end of next year to have more papers published on as much as I can!
And, of course, to continue to build post-doctoral opportunities. Throughout this whole process, I am beginning to visualise how a post-grad position and application could be shaped and the ideas and directions that I would like to take my research at post-doctoral level. I am early into this process, and I don’t really plan on focussing on this too heavily at the beginning of the year, but I suspect more focus shall be placed on this as summer approaches.
All this and more shall be discussed on this blog during the coming year!
Thank you for reading my reflections. Wishing all of my blog readers new and old a Happy New Year and a productive and positive year ahead!
July 08, 2019
Ph.D. Update On The Thesis Work So Far, Part A
I apologise for not writing a blog post in quite a while! I noticed that the previous update was way back earlier this year. Admittedly, blogging was put aside for a while as I simply wanted to focus on writing the thesis and complete the data analysis with the intentions of returning to the blog when I had more time to spare to blog about what I have completed and where I am going with everything.
Since I wrote the previous update there have been times when I have felt overwhelmed not because I have struggled with knowing what to say, but knowing what to say where. This has not necessarily led to times of anxiety and paranoia, but of uncertainty. What carried me through the times that I have been overwhelmed and felt uncertain is this single thought: I’d rather feel overwhelmed due to having a lot to say, than to feel underwhelmed with nothing to say! It takes time, but persevere and make sure you are continuously writing. It doesn’t matter what form your ideas take on paper, just get them down on paper and sort out the edits and presentations afterwards.
The Literature Review
Much of the literature review has now been completed and it’s a case of editing what I have already written and complete and edit the critical summary section. A section that I have been working on during the past few months involves the critique of various analytical coding frameworks pertaining the exploration and analysis of the phenomenon of interest. This has not been an easy section to write because of the very nature of qualitative research and approaches needed to write qualitative theses. Briefly, the approach that I am adopting to handle and critique the literature more generally is to split the literature review in a couple of parts, each of which serving different purposes. The first literature review chapter contextualises the phenomenon of interest. By this, the first literature review refers to conceptualisation and definition: I am explaining and critiquing how the phenomenon of interest has been conceptualised in the literature, how the phenomenon has been identified and explored across different contexts, and to critique these approaches to exploring the phenomena in order to situate the need for my research within these critiques.
With the analytical models, in this first part of the overall review of the literature, I have to explain the models in a way that demonstrates how the phenomenon of interest has been analysed, and critique the general approach of the models. The second part of the review is integrated in with the discussions of the findings, and I shall explain this in the next blog post.
Research Design Chapter
This is more or less complete in various drafted forms, it’s just a matter of trying to put the whole chapter together. I have written the introduction section, explanations and descriptions of the research design itself, explanations of the research questions and objectives, my position as a researcher, my philosophical position, and the explanation and justification of the selection of the methodology and methods. Other sections I am working on include discussions about the sources of the data, the setting of the research, and detailing the process of coding and thematic development. Additionally, I am attempting to write justifications in terms of how the methodologies and methods have been used before so that I can attempt to verify the historical effectiveness of various aspects of the research design. Phew!
This has been another chapter that has received many edits and redesigns, but I am now happy with the chapter with the way it is and the way it is progressing. Still a fair bit to write, but everything is basically written in pre-draft form it’s just a matter of editing and putting the sections together so it shouldn’t be too bad. What has been the most challenging section, to be honest, has been the Philosophical section and then working out the way this relates to the methodology. It can take a long time to work out your philosophies, and even then they can change so try not to be too much of an absolutist no matter what your position you believe best matches your own. Be dynamic and be flexible.
In Part B, I shall discuss briefly where I am with the latter part of the thesis.
April 17, 2019
Research Design Chapter Philosophical Section: How Much Is Too Much? Part A
When writing the research design chapter, and indeed when engaging with postgraduate research, a key issue is Philosophy. Philosophical issues relating to the phenomenon of interest and the research context have to be acknowledged, identified, documented, critiqued, reflected upon, and strongly associated with the research methodology. Philosophy drives methodology, and the methodology provides the framework that guides the research methods and procedures. It is imperative to ensure that strong links, cohesiveness and cohesion exist between philosophy, methodology, methods and procedures of the research within your writings so that the design can stand up to academic scrutiny, and to ensure that findings are consistent, correct, appropriate, and suitable for the context and the main research objectives.
Those are separate topics for another time, but referring to writing the Philosophical section of the research design of a thesis a key question is, how much is too much? This is an interesting question that I continuously have asked myself when writing the philosophical section of the research design. I am of the firm belief that nothing is ever, and should ever, be wasted. Nothing you write on the Ph.D. is ever wasted as something can be turned into something else, even a publishable form of something else.
During my time on the Ph.D. I have written extensive notes on paper and in digital form about numerous philosophical, both ontological and epistemological, positions. Even back at this time I was questioning how I could apply what I was exploring to the methodology, how each position affected my perspective of the phenomenon, and the way I could best record and express the positions in the thesis. Whether you are writing in pre-draft form on paper or in digital form, don’t be afraid to ask yourself questions early, but don’t restrict your creativity and inquiry. Allow your thoughts to come out, to develop, and to become as complex as they are required to be. You know how complex your ideas should be, and you know how complex you want them to be to fit the context. But again, don’t reject anything. I have been writing the draft form of the research design chapter for quite a while. The Philosophical aspect has experienced a number of rewrites as my pre-draft form ideas matured further and as I engaged with more philosophical ideas and different philosophical authors.
Where to begin with this minefield? I began fairly early in thinking about research design to read the theses of other post graduates. It did not take long to find a stumbling block: there is no universal law or standard that appears to guide how much is too much or too little. The problem, and difficulty, is that theses, although they might focus on the same methodology, differ widely in their philosophical coverage. Some theses make a passing suggestion towards philosophy and include it in a discussion about methodology, whilst other theses provide more detail and include a separate Philosophical section followed by a discussion of methodology. Even the Philosophical section, however, differs with some making short references to ideas about reality and knowledge, whilst others talk about knowledge without referring to any sense of reality even though they reference an ontological position.
What is important to remember is that despite the diverse range of philosophical coverage, there is some sort of expectancy to ensure cohesiveness and consistency in your approach. You cannot, for example, say that you’re adopting constructivist ontology and an objectivist epistemology supporting an experimental methodology. You cannot, in my view, talk about epistemology and pay lip service to ontology if you’re making explicit statements about how you come to understand reality. If you are talking about reality, then you’re talking about ontology. If you’re talking about the nature, structure, limits and origins of your knowledge and of coming to know this reality, then that’s epistemology. If you’re talking about how you are to gain knowledge about reality, that’s methodology. It’s important to remember this.
Is it worth reading though these theses? Yes, it is. Engaging with other theses enables us to become more acquainted with the self or being as a researcher. It makes us question how we should present our philosophical stance, and to wonder why such diversity in Philosophical coverage exists.
Engaging with these theses has in party contributed to increasing the value and importance of acknowledging, recognising, critiquing and engaging with my own philosophical stance, and the way my stance could be communicated. There is no particularly strict guide, and it’s important to explore and experiment in order to find what is best. This takes many redrafts. I’m sure many of the longer term readers of this blog have followed my Philosophical battles as I oscillated between different positions in order to situate or locate my views of reality within the extended literature. One needs to be careful to not pigeon-hole their beliefs or to ‘stuff’ their beliefs within a particular position just to tick a box. Your beliefs need to be engaged with critically and reflectively. They need to be intellectualised, and to be intellectually engaged with, so that they can logically be applied to your research, be integrated cohesively within your research design, and communicated consistently within your writings.
How much is too much or too little? It simply depends on what is right for your research, and how you relate your philosophical position to your research, and how valuable discussing ontological and epistemological issues are in relation to your research, research question, and phenomena of interest.
I shall cover this more in the next blog post where I discuss and explain further my experiences so far!
February 21, 2019
A Year In Reflection, Part C: Thesis Progress
I apologise for the lateness of the continuation of the reflective posts, where I reflect over the past year’s progress. With this final blog post in the series of reflective posts, I shall focus on the thesis.
I find myself in an interesting position when it comes to the order in which the thesis chapters are being written. Typically, the chapters of a thesis are written in order: introduction, literature review, research design, findings and discussion of findings (I accept this is a very simplistic overview!). I appear to find myself switching between chapters at different times, that writing sections in later chapters help to further develop previous chapters, and that I appear to be writing the findings and discussion of findings chapter (albeit in very rough form) at the same time as engaging with data analysis.
Most influentially, the engagement with the data analysis process has shaped the development and direction of the literature review, the use of the literature, as well as the direction of the research design and the construction of the research design chapter. This is probably to do with the nature of the research: I am adopting an inductive approach to qualitative analysis, and I am coming to realise that inductive research shapes our understanding of not just the data but also the wider literature landscape. Additionally, the changes to philosophical and methodological stances, as has been reported in the two previous blogs, have occurred through engagement with the data. Furthering this, it is the process of critical engagement with the data e.g., the act of asking questions about the data, about what I was perceiving and interpreting from the data, that led to alterations of my philosophical and methodological stances. Ultimately this has led to the reworking of the research design chapter’s philosophical sections.
Reflecting further, I did attempt to write the research design chapter prior to data analysis, as is typically the case, but I found this difficult. I found this difficult because I had to predict what methods I was going to use, but because I was experimenting with different ideas I could not rationalise the decision making at that time. Therefore, I found it better to write the research design chapter (particularly writing about the application of the data analysis methods) at the same time as actually performing data analysis. I have found this to be very beneficial because not only have I detailed the different steps that I took (and as I continue to take) to analyse the data, I also detailed reasons why and justified every phase, every step, and every method of data analysis, and continue to do so. I do believe that I made the right choice in writing about the data analysis at the same time as actually engaging with data analysis.
Every stage and every phase have been carefully documented, related, and justified, with every data analysis method used also being justified. In addition to all of this, I have been writing continuous theoretical memos to document the analysis insights, observations, etc. that shall go towards the findings chapter and the chapters related to each identified theme.
Essentially, engaging with the data has not only added to my literature review chapter, but also added to the research design chapter and, as mentioned, impacted upon the directions of the research design including my ontological position as previously discussed. What I am saying is, yes you can begin with an ontological or / and epistemological stance with various research methods, and as much as you might get on well with those methods it does not mean that they are the correct approaches. I was using Grounded Theory for a while and I was getting on well with it till I started to perceive the data differently. These changes entailed a shift in ontological understanding of the data, which led to changes in the methods used.
Have some ideas to begin with but be prepared to be flexible and changeable in terms of your ontological and even epistemological positionality. What’s interesting is that my epistemological positioning hasn’t changed much: it’s the ontological position that has changed. This might sound a bit odd given that ontological concerns impact the epistemological level. Some writers argue that epistemological concerns logically entail ontological positioning. Whilst this is true, what I am arguing for is that there does not have to be a strict adherence to this relationship. A realist ontology should not always necessitate an objectivist epistemology, for example.
In summary, try not to trap yourself in the idea that you simply must write a thesis in a particular order and in a particular way. It’s best to be adaptable and dynamic and allow yourself to be guided by your thinking, your observations and your analyses rather than what could be perceived to be a set institutionalised approach to your writing. Of course you have to get the chapters completed in good time to be reread, proofread, etc, but not in such a restrictive way. If you find, like me, that your research is naturally guiding you towards writing more about the research design at least initially than the literature review then so be it. Be guided by what you do and what you observe. Seek advice and clarification yes, but be true to who you are and what you believe is right for your thesis.
Remember: you are the author of your thesis. No one else can write your thesis in the way and order that you believe shall bring out the best in yourself, and your thesis!
December 30, 2018
Ph.D Update: Up To Christmas 2018 Part A, Coding Framework and Thematic Analysis
Wishing my blog readers a Merry Christmas and a Happy New Year! I apologise for not writing any blog updates since the middle of November. There were a few tasks I wanted to complete before Christmas so had no spare time to complete any blog posts. Now that the New Year is approaching, I’m now planning what to do between January and Easter and there is a lot to complete but I shall get to that in a while. In the meantime, this blog post is one of two posts that shall provide an update of my most recent work: this blog post covers the development of the coding framework, and the next part shall cover the progress of the literature review.
Themes, Sub Themes and Coding Framework
When I wrote about the continuous framework development back in mid November, the coding framework was, at least tentatively, complete. I was also in the middle of rechecking all previously coded data to ensure that I had been interpreting consistently and coding accurately. Since that time, the idea of interpreting consistently and coding accurately has become clearer along with understanding how interpretation consistency increases coding accuracy. This is especially an interesting point given that coding is subsequent to, and a reflection of, the act of interpreting.
Whether or not coding accuracy and interpretation consistency increased truth or progresses towards truth is highly debatable given the nature of qualitative research and the characteristics of inductive thematic analysis approach. I could argue for, and apply means to, increasing the validity, accuracy, consistency and credibility of my approach and the findings, but can I really argue that the findings represent truth and that my approach could lead people closer to the truth?
What I can argue in the thesis is for the importance of accurate coding and consistent interpretation leading to more valid and reliable findings, whilst at the same time accepting that different researchers shall interpret the data in different ways and, therefore, could view any data segment differently depending on various personal factors. Essentially, coding is an interpretation e.g., a code represents an interpretation of whatever action, event, etc. is appropriate and relevant to the research question. If you code a series of segments using the same code but the segments are not consistent then that code would represent an inaccurate or incorrect interpretation. I have some possible examples that I could think about in the thesis, but I have to give this some thought when I put the research design chapter together. I shall be going into a lot more detail in the thesis.
Just before Christmas, I had completed the rechecking of the previously coded data and can state that I am satisfied that my coding is accurate and that my interpretations are consistent at least in accordance with my own interests and research questions (again, I shall be talking about this more substantially in the thesis). What I had not expected to complete by Christmas is the categorisation and classification of codes into different sub themes and themes. Contrary to what appears to be the norm, I have been able to develop themes from codes that were not the most commonly occurring, but codes that represent what I consider to be important observations within the data. Important observations in reference to the research questions and the characteristics and aspects of the phenomenon of research interest that interests me the most. It has to be emphasised that the coding framework and the thematic development as currently stand do not represent the final product. The themes shall be developed and reformulated as time progresses. This shall be as a result of the processes of thematic validation and verification using a variety of different processes. These include a further examination of themes to identify similarities and possible opportunities to combine themes, as well as the possibility of identifying “super themes,” and conversations with other academics regarding the codes, sub themes and themes that I am using.
In all, I am pleased with the progress that has been made with the thematic analysis and development. The next stage of the analysis shall begin early next year and this shall involve not just the validation and verification of the themes, but also validation and verification of relationships between themes through both qualitative and quantitative means. The quantitative representation does not necessitate a mixed methods approach but does necessitate a multimodal design where the quantitative data simply supports and adds weight to what was identified and explained qualitatively. Working this out shall naturally take time!
November 19, 2018
Ph.D Update: Up To Mid November 2018, Part B: Continuing To Write Extensively
Writing is a continuous, ongoing task in qualitative research but the question is, what do you write? Obviously, many qualitative methodological textbooks and my own experiences suggest that it is very important to document what you observe and begin to interpret very early in the qualitative process. Typically, quantitative research is fairly set in nature and the writing of the research findings usually take place following the analysis phase. With qualitative research, you begin to write about your findings and interpretations at the very beginning of the analytical process. Your writings, interpretations and coding schemes, etc. all change and evolve over time, and it is always wise to write about these changes as they occur.
Reflect on these changes and alternatives, explain the way in which these changes have impacted your research, compare the changed approach to the previous approach, and evaluate these changes. All these reflections shall form a part of your analysis and overall production of the research design chapter and later thesis chapters.
Typically in qualitative research, data analysis and writing of the interpretations and findings occur simultaneously. What I am finding that is in addition to the norm is that I am writing about the research design as I go through each data analysis stage and phase. I have found that my analytical lens and general analytical approach have changed as I have progressed through the data analysis and as I have reread the data several times. With this, I am not just writing and contributing towards the findings and discussion related chapters simultaneous to data analysis, but also various aspects of the research design chapter.
Trust me, this can be quite mind boggling. But for me, it’s an approach that works as I have always viewed little sense in writing the research design chapter before the data analysis began. I did attempt this before, but as I progressed through the data analysis I found that what I found was challenging what I thought, and continues to do so. It made sense for me from that point to write about the design as I progressed through the data analysis.
It was more than a couple of years or so ago that I started the qualitative journey after moving away from mixed methods approaches to investigating the phenomenon of interest. I suppose back then I was aware of the need for writing about the data itself and what I was to observe, but I had no idea that at the time I would effectively be writing about the research design AND the data observations and thematic development simultaneously but this is the way that my research appears to have been worked out.
Qualitative research is nuanced and there really is no set path towards the way you are to write your qualitative thesis! Plus do remember that it is an ongoing process: you cannot write about an observation once and then leave it. It’s a long running, complex, detailed, deep process of understanding and comprehending what it is you are observing.
'till next time, keep applying that pen to paper! Or hands to keyboard! Or both!
November 02, 2018
Ph.D Update: From The Middle Of October 2018
It has been quite a while since I wrote the previous blog post as I have been steeped in data analysis with the sole purpose of developing the coding frame. There is too much detail to cover in an update blog post so I shall simply focus on the core accomplishment, and that is the development of the coding framework!
For the past few many months I have been developing a coding framework that is intended to assist qualitative researchers in the exploration of social learning phenomena (I am obviously not going to go into this in too much detail on here: more extensive details shall be found in the thesis and, fingers crossed, published papers). In developing this coding framework I have switched from a grounded theory methodology to a thematic analysis with concepts borrowed from grounded theory (e.g., the writing of theoretical memos, and the idea of theoretical saturation, and some ideas from constant comparisons, etc.), and also changed direction in coding (e.g., switched direction in coding for particular data characteristics and functions). Extensive notes have been written and continue to be written as to the reasons for the changes, the exact process and aspects of the analysis, and the relationship between the components and stages of analysis. As data analysis is continuous, I am effectively writing notes about the research design as the analysis progresses. In my view, there is no sense in doing the data analysis and then writing the research design chapter (even in rough note form) after that. It is really best to do both tasks simultaneously especially if it’s qualitative research.
Now I am in a position where I feel that I have developed a coding framework and I am beginning to identify themes that explain the core principles, characteristics, dynamics and forms of the phenomena of interest in relation to the research questions and the research context.
Even though I have developed the coding framework, the work is not complete.
The next stage is the process of refinement, verification and validation of the coding framework along with continuing to refine the themes that are developed from the codes, which themselves shall be going into the next stage of refinement and checking.
In a nutshell, the refinement and checking process shall involve a deeper examination and comparison of all the coded data segments. In line with the thinking of grounded theory (which I think should be a part of overall qualitative research thinking), I have been writing extensive theoretical memos on various aspects of the analysis process and this includes memos for each code.
With each code memo, I am placing each similarly coded segment into the document relevant to the particular code in order to document the location and content of each coded segment. The next step with these memos for each code is to closely compare each segment to ensure that they are similar enough in characteristics, function, purpose and features (all of these aspects of the data have been written extensively about on paper and continue to be) to be given the same code. Other tasks include the comprehensive comparisons of their similarities, to discuss and examine the way they are similar and which sub-group of the code they belong, based on their characteristics and features. I shall, again, be extensively documenting this process stage by stage. It is expected that this process shall lead to a refinement of some of the codes and understanding of the codes, and the continuous task of identifying more themes, and refine and develop existing themes. Again, I intend on extensively documenting this process.
Other processes of verification and validation shall include the potential use of a focus group where a group of graduates is being planned to apply the coded framework to test it (part of the inter rater process) and also I plan to situate the codes and most importantly the developing themes within existing literature. In other words, I plan to use existing literature to verify and validate the data, and to use the themes to expand on existing understanding of the phenomena, and to explain the way in which the coding framework can be used along with other frameworks for different purposes.
This blog post does not do justice the amount of work that is involved and what shall be involved in the future, seriously. I’ve written now well over four hundred pages perhaps nearer to five hundred pages or more, on both the computer and on paper, on the research design, the phenomena itself, and observations that I have made of the data so far. And I’m not done with it yet because I have not detailed the processes that are yet to come and that which I am just about to begin engaging with.
These pages are not formally drafted: they are a mixture of a series of quick thoughts or notes on a page, pages of extended thoughts and observations, reflections on the process so far, critiques of the research design, notes and extended thoughts on the problems I have come across, developments of philosophical and ethical groundings and justifications, critiques and explanations of the research process I am adopting, and much more.
Obviously there is not much in the way of cohesive or logical ordering to these notes: I am simply writing everything down as anything comes to me. That works for me and is the best approach; otherwise you’ll be so worried and focused on order that you’ll miss out on important details and the serendipity of it all.
I shall worry about the order and logic of everything in the future: the most important thing is that everything is being recorded in whatever order that occurs, using whatever medium I can get access to at the time either on the computer or on pen and paper (and sometimes both at the same time!).
That’s basically been the key activity since writing the blog post: developing the coding framework to a point where I am happy with it, and can move it forward to the next stage of refinement, verification and validation. The other tasks obviously have been to extensively and comprehensively document everything that I do: the what, how, why, when and where.
Brain…….is……frazzled!
‘till next time!
September 06, 2018
Currrent State Of Play: The Research Design Chapter
This is the chapter that shall describe, explain, evaluate and critique the development of my new approach (coding scheme) of exploring the phenomenon of interest. The chapter shall also describe and explain the development and application phases of the coding scheme and the way in which categorical and thematic development took place. Therefore, the chapter prior to this deals with a variety of research designs that were tested, whilst this research design chapter deals with the research design that was actually used in the Ph.D. project.
This chapter is a continuous, ongoing and progressive document because it is being written at the same time as data is being analysed. With a quantitative research project the typical process is to write the research design chapter first before carrying out data analysis, but with the qualitative analysis I am finding that I am writing the research design chapter and performing data analysis concurrently. It depends on preferences: some people might like to write their methodological chapters before carrying out the research whilst others might write their chapters afterwards. But with me, I’m writing the chapter as I progress through the phases and stages of data analysis. For me, it makes sense to write about each stage and phase as I encounter each of them because, as I would be engaging with that phase or stage at the time, I can fully elaborate and explain the processes I used within that particular phase or stage.
Because the chapter is work in progress, the structure of the chapter has not been finalised although I have a rough outline of the chapter in place. These include sections that discusses, evaluates, critiques and explores my philosophical beliefs and my personal background (interests, beliefs, experiences, knowledge prior to the Ph.D., etc.), and their possible impact on the development of the coding scheme and categorical and theme development (a process called ‘Researcher Reflexivity’). The outline also includes sections that discuss the methodology and the data collection and analysis methods.
I feel that I have made fair progress with this chapter. I have written lots and lots of notes about my beliefs, experiences, philosophies, my critiques and use of methodology, methods etc. and continue to do so. It’s becoming a matter soon to simply knit these sections together to form the chapter, and work out what I need to develop next. What I am focussing on currently, however, is comprehensively detailing and explaining how I am analysing the data; the phases and stages of data analysis that shall result in the new coding scheme and the identification and development of themes. The writing of this section, obviously, shall continue for as long as data analysis continues.
Lots of editing and rewriting to do, obviously, but I think on the whole I have wrote a considerable amount but shall need to knit the sections together after the data analysis process. That way, I can observe where I need to go next with the research design chapter. Writing the chapter especially the specific data analysis section at the same time as carrying out the data analysis has, however, helped tremendously with documenting with precision and accuracy exactly what I am doing, where, when, how, and why.
September 05, 2018
Current State Of Play: General Observations
Literature Review
Since writing the previous blog post back in early August, I have focussed on restructuring and rewriting the literature review sections, and have adjusted the scope of the literature as well as collected and analysed further literature. Thoughts and arguments within the literature review have been reconstructed and extended.
The literature review now has a beginning, middle and concluding structure, and this is the structure I intend to use for each chapter though written in a way that the introduction connects with the conclusion of the previous chapter, and the conclusion section leads into the introduction of the next chapter. All the sections in the literature review are interconnected: they might refer to different topics, but these topics are related in a way that logically, coherently, consistently and cohesively constructs thoughts, ideas, arguments and perspectives.
Unsurprisingly, as with everything at postgraduate level it is not quite black and white. With all Ph.D. theses, every chapter should also be referencing the first chapter: the introduction, where the research context, issues, problems and questions shall be presented and discussed. Referencing the first chapter gives each chapter situatedness, context, a framework for the chapter discussions, and a guide whilst allowing for open mindedness, flexibility, originality, creativity and innovation. Each chapter, therefore, needs to state the way in which it addresses research problems, context, purposes or questions, or a mixture if necessary.
With qualitative research where themes are to be developed, each chapter is related to each identified theme. The theme chapters are expected to adopt some sort of network structure where every chapter relates to and cross references each other. I shall probably discuss this more at a later time.
Effectively, the literature review has been completed for now! The next round of edits shall take place before Christmas or at some point early next year.
Thesis Structure
The thesis has been structured to an extent. I say to an extent because it is impossible to plan chapters related to findings within a qualitative research project because essentially the structure and content of these chapters are led by observations in the data and the framework and themes that emerge from the data. The structure leans toward the qualitative nature of thesis structure production, as shall be discussed more in a future blog post.
Research Design
Unchanged at the philosophical level (essentially, moderate realism ontology with an interpretivist epistemology), though the methodology has changed from mixed methods, to grounded theory, and to now more general qualitative methodology with the potential for some quantitative data to be embedded within it. The quantitative data would be used to complement and support the qualitative and perhaps be used to further evidence some of the claims made from the qualitative observations and thematic development.
Regardless of the quantitative, it is the qualitative that drives and dictates the research and, therefore, drives and dictates the structure of the thesis.
Data analysis appears to be leaning towards a mixture of concepts and processes from thematic analysis (particularly the aspect on developing themes), grounded theory (such as constant comparisons, maximising variance, open coding features, and theoretical sampling), and retroductive / abductive reasoning. The relationship between these approaches and the way they have been and are going to be used shall be explained in the thesis and discussed on here when appropriate.