I have not been blogging as diligently lately, and one of the reasons for this is that I have been a bit preoccupied with writing resubmissions. As part of this process, I had to revisit the issue of treatment effect consistency which I discussed last summer. This post discusses an alternative way of assessing and quantifying whether treatment effect (in)consistency is present, using methods adopted from meta-analysis.
This final post finishes the discussion of the previous three (you can find them here, here, and here) by looking at treatment effect heterogeneity and design heterogeneity.
Continue reading “Scotcet and implementation failure 4. – Treatment effect and design heterogeneity with a demonstration in R”
This post continues two earlier ones (this one and this one) and assesses the effect consistency across the matched pairs in the ScotCET dataset. Part of the redacted dataset can be downloaded at the bottom of this page which will allow you to carry out the same analysis presented below. Continue reading “ScotCET and implementation failure 3. – Treatment effect consistency in a blocking design with a demonstration in STATA”
How can one evaluate the veracity of the claim made by MacQueen and Bradford (2017), that the treatment effect emerging from the ScotCET RCT is, in fact, attributable to the experimental design, despite the apparent failure of implementation? For this assessment, one needs to discuss some design features of ScotCET. Continue reading “ScotCET and implementation failure 2. – The design features of ScotCET”
As outlined in my earlier post, one of the key propositions in the procedural justice literature is that – at least in most Western countries – procedural justice has an outsized importance in shaping views regarding the police. Yet, there have been only a few studies that established a causal relationship between police practices and the perception of procedural justice (e.g., Lowrey et al., 2016; Sahin et al., 2016), and none, that has explored its mediating role (although see Mazerolle et al. (2013) who used a path analysis approach – more on this in another post). Thus, in my first paper, I decided to “pry open” the black box of causality, and investigate procedural justice’s causally mediating role. Continue reading “ScotCET and implementation failure 1. – An apparent implementation failure”