Community Safety and Policing Research Program, Global Justice Lab, Munk School of Global Affairs and Public Policy, University of Toronto

the seven findings, in plain language

What predicts a school's ties to outside organizations

A project of the Community Safety and Policing Research Program, Global Justice Lab, Munk School of Global Affairs & Public Policy, University of Toronto.

Results

Schools differ in how many organizations they work with

Schools differ mainly in how many of the eight organizations they work with: parents' groups, civic groups, local businesses, churches, social services, mental-health providers, juvenile justice agencies and the police. The particular ones a school picks are close to unpredictable. Knowing the count barely narrows them down, and nothing else the survey records narrows them either: not the size of the school, not its grade level, not whether it sits in a city or the countryside, not the make-up of its student body.

A statistical model of the whole network says the same thing. The uneven spread of ties across schools comes out at -1.33, and the minus sign means some schools hold far more ties than chance would give them. Schools vary far more than they would if each relationship were decided on its own.

A two-mode network diagram of a sample of schools from 2015-16. Circles are schools, sized by how many of the eight organizations they work with, and placed nearer the center the more they work with. Squares are the eight organizations. Navy marks schools with security staff, which sit throughout rather than in a cluster of their own.
Figure 1. Schools and the organizations they work with. Squares are the eight organizations; circles are schools, sized by how many organizations they work with.

Table 1. Bipartite exponential random graph model of schools and the eight organizations, 2015-16 wave (n = 1,805 schools)

(1) The neighborhood on its own (2) Adding what the school runs
Shape of the network
Baseline rate at which schools and organizations are tied (edges)<br>how dense the network is overall, like an intercept +0.149 (0.020)*** -0.052 (0.037)
How unevenly ties are spread across schools (gwb1degree, decay 0.4)<br>negative means some schools hold far more ties than chance would give -1.608 (0.130)*** -1.332 (0.138)***
What the school is dealing with
Recorded incidents of crime and violence<br>standardized +0.063 (0.019)***
Crime level the principal reports for the area<br>standardized; higher means more crime. This is the principal's description, not a recorded crime count +0.044 (0.016)** +0.003 (0.016)
What the school is
Size of the school<br>standardized +0.097 (0.016)*** +0.022 (0.019)
What the school runs for itself
Employs security staff<br>guards, resource officers or sworn police +0.250 (0.041)***
Formal process for consulting parents<br>standardized; includes training or services offered to parents +0.165 (0.017)***

Note: A coefficient is the change in the log odds of a school working with a given organization. The first two terms describe the shape of the network. The rest ask whether schools with more of that characteristic hold more ties, which this kind of model calls an activity effect. Column 1 puts the neighborhood in on its own; column 2 adds the three things the school runs for itself, and the neighborhood coefficient falls to nothing, which is the paper's direct-and-indirect result inside the model. Unweighted, since exponential random graph models do not take survey weights. The neighborhood coefficient in column 1 is +0.051 at a decay of 0.2 and +0.036 at 0.8, so it does not turn on that parameter. \\\p < 0.001, \\p < 0.01, \p < 0.05.

One faint pattern does survive. Among the eight organizations, three pairs turn up together slightly more often than chance: social services with mental health, juvenile justice with police, and civic groups with businesses. The effect is small, and it sorts the organizations rather than the schools, so the finding that schools have no types still stands.

Table 19. Co-occurrence of organizations on the same side, against randomizations holding the margins fixed, by survey

Wave Within-side co-occurrence, z Social services with mental health, z Juvenile justice with the police, z Civic groups with businesses, z
2005-06 22.3 10.0 9.5 11.5
2007-08 16.5 9.3 9.0 9.0
2015-16 14.7 11.0 7.3 7.1
2017-18 19.9 10.2 5.4 10.1
2019-20 15.0 7.5 6.9 7.8
2021-22 16.4 8.9 7.0 7.4

Note: Each z compares the observed number of schools holding both ties in a pair (summed over the twelve within-side pairs in the first column, single pairs in the others) against 300 curveball randomizations that hold every school's count of ties and every organization's prevalence exactly fixed, so the margins explain none of it. The structure is present in every wave and it is small: the first two eigenvalues of the tetrachoric correlation matrix are 2.9 and 1.5, so the count's dimension is roughly twice the size of the sides dimension, and at a fixed count the within-pair residual correlations sit near +0.06 against a compositional baseline of −0.14. A varimax rotation of the two factors reproduces the community and government sides used throughout the paper. Randomization seed 7; reproduce.R rechecks the observed totals exactly and the z-scores with independent draws.

A dot chart of how much schools that resemble each other on size, grade level, urbanicity and student body also resemble each other in which organizations they work with, shown for each of the six surveys. Every estimate is close to zero, and the sign is not the same from one survey to the next.
Figure 2. How much being alike matters, by wave. Small either way, and neither kind of likeness leads consistently.

These figures cover the 13,167 school-years that work with between one and seven of the eight. The 2,028 that work with all eight or with none are set aside, and putting them back leaves the main estimate at +0.125 instead of +0.126.

Security staff, parent processes and equipment predict most

Schools that have security staff, a formal process for consulting parents, and security equipment work with more outside organizations. This is the strongest pattern in the data. Two schools one standard deviation apart on those three differ by about half an organization out of the eight.

It holds in all six surveys, from +0.41 in 2017-18 to +0.51 in 2005-06. Drop any single survey and the overall figure stays between +0.463 and +0.487. It holds at every grade level too: +0.52 in primary schools, +0.42 in middle schools and +0.33 in high schools.

You might worry that this is circular, because security staff can include police officers and one of the eight organizations is the police. It is not. Leave out both the police and parents' groups and count only the other six, and the figure is +0.367, the same rate per organization.

The index counts how much a school runs, not which kind of organization it favors. Hold the count fixed and security staffing leans slightly towards the government organizations (+0.075), the parent process towards the community ones (-0.098), and equipment towards neither (-0.015).

Table 17. Security staff, the parent process and equipment, and the crime level, entered alone and entered together

Entered alone Entered together
What the school has built (staff, parent process, equipment) +0.485*** (0.021) +0.477*** (0.021)
How its principal reads the environment +0.126*** (0.029) +0.079** (0.027)
The two multiplied -0.036* (0.017)
...the reading of where the students live (11,335 school-years; entered with capacity in the second column) +0.165*** (0.028) +0.119*** (0.027)
Does advantage build reach?
Share of students expected to go to college -0.050* (0.024) -0.043 (0.024)
Share testing in the bottom fifteen per cent +0.042* (0.021) +0.031 (0.021)
Average daily attendance +0.013 (0.018) +0.020 (0.018)

Note: n = 13,167. Survey-weighted, standard errors clustered on the sampling stratum within wave, in brackets. All predictors standardized, so each coefficient is the difference in the count of organizations between two schools one standard deviation apart. What the school has built is an index of the three standing arrangements the survey carries in every wave: security staffing (harmonized to any-versus-none across a wording change in 2015-16), the formal parent process, and security equipment; each is standardized, the three are averaged, and the average is restandardized. The capacity coefficient carries the scrutiny the environmental one does. Estimated within wave it is 2005-06 +0.506, 2007-08 +0.467, 2015-16 +0.474, 2017-18 +0.411, 2019-20 +0.482, 2021-22 +0.486, significant in all six; leaving any one wave out keeps the pooled estimate between +0.463 and +0.487. It is not an artefact of overlap between the index and the ties (the staffing measure includes sworn officers; one tie is law enforcement): on the six ties excluding the police and parents' groups it is +0.367 (0.019), the same rate per organization. The index measures how much machinery, not which kind: at a fixed count, security staffing goes with the government side of the field (+0.075) and the parent process with the community side (-0.098), while equipment goes with neither (-0.015). In the joint rows the two main effects come from the additive model; the product row comes from the model that adds it, whose main effects are +0.479 and +0.077. The interaction implies an environmental slope of +0.113 (0.032) at -1, +0.077 (0.027)** at +0, +0.042 (0.032) at +1, +0.006 (0.043) at +2 standard deviations of capacity: the first two separate from zero and the last two do not, so the environmental route is clear at and below average capacity and cannot be distinguished from zero in the sixth of schools more than one standard deviation above it. The last three rows test whether advantage builds reach. Entered alone, the share expected to go to college and the share testing at the bottom carry the wrong sign for a position account; entered together neither separates from zero, and with the crime reading and all five student-body measures present they are -0.017 and +0.002. Nothing here suggests that advantage builds reach. \\\p < 0.001, \\p < 0.01, \p < 0.05.

A coefficient plot with horizontal error bars. What the school runs for itself is the largest estimate at about +0.48 of an organization per standard deviation. The principal's description of the area is smaller at about +0.08. The five student-body measures sit at or across zero, and the two closest run in the opposite direction from a social capital account.
Figure 3. The two sources, and the student body. Each coefficient is the change in the count of organizations per standard deviation of the predictor, with size, grade level, urbanicity and wave controlled everywhere; hollow circles add nothing else, and solid circles also control the measure named beside them. The crime readings' fall from hollow to solid is the share of the neighborhood association overlapping the in-house items; the grey student-body rows are the position account's own test, and it fails.

How the principal describes the neighborhood

The survey asks principals to describe the crime level in the area around the school as low, moderate or high. Schools whose principals say high work with more outside organizations. The gap between the schools called low-crime and those called high-crime is about a third of one organization, on a count that averages 4.0. It shrinks to about a tenth once the school's own staff, parent process and equipment are accounted for, and it is still there.

That is the point where the two explanations can be told apart. Resource dependence predicts it. Social capital predicts the opposite, because it reads a wide network as a sign of an organization doing well.

The effect is not the same in every survey. Pooled across all six it is +0.126, but a test says the surveys genuinely differ from each other rather than wobbling by chance (F = 3.53, p = 0.004). So treat +0.126 as an average over six years that differ, not as one stable number.

Four panels of dot-and-line charts. For each of the eight organizations, and then for the count of them, the share of schools working with it rises from low- through moderate- to high-crime areas. Six of the eight rise and parents' groups falls. The top row uses the principal's description of the school's own area, the bottom row the areas where students live, and the second is steeper.
Figure 4. The environmental source, against both readings of the environment. The top row uses the principal's description of the area where the school is located; the bottom row the areas where the students live. Left: for each of the eight organizations, the share of schools working with it where the principal calls that area low, moderate or high crime. Six rise and two fall against both readings, and the coefficients are larger against the second. Parents' groups, in red, falls against both. Grey dashed lines are reported but not built on. Right: the same as a count, all eight together and then four organizations on each side. Every point is the average prediction from a survey-weighted regression of the outcome on the reported crime level, holding school size, grade level, urbanicity and wave at the sample distribution, so the three points compare the same schools placed in low, moderate and high crime in turn. Asterisks come from a companion regression using the reported crime scale as one continuous term, with standard errors clustered on the strata: p < 0.001, p < 0.01, p < 0.05.

Which organizations schools in rougher areas add

When a school in a high-crime area works with more organizations, the extra ones are spread across community groups and government agencies alike. They are not concentrated on the police and the courts. The count of community partners and the count of government partners both rise by about the same amount, and the balance between the two sides does not change.

Drop the police from the count altogether and the link between the principal's description of the area and the number of organizations gets stronger, not weaker. Whatever is going on, it is not policing under another name.

Table 18. Each of the eight organizations against the crime level, holding the total number constant

Organization Side Coefficient Clustered SE p
Parents' groups community -0.028*** 0.004 0.000
Civic organizations community -0.003 0.004 0.499
Local businesses community +0.011* 0.005 0.027
Churches community +0.015*** 0.004 0.001
Social services government +0.009* 0.004 0.041
Mental-health providers government +0.017*** 0.005 0.000
Juvenile justice government +0.001 0.005 0.847
Police government -0.023*** 0.005 0.000
&nbsp;&nbsp;Parents' groups, with parent turnout also controlled community -0.012* 0.006 0.044

Note: Linear probability models, one per organization, per standard deviation of the reported crime level, survey-weighted, standard errors clustered on the sampling stratum within wave, controlling for size, grade level, urbanicity, wave and the total count of organizations. Because the count is held constant, a coefficient reads as a change in the share of schools holding that tie at a given number of ties: the mix, not the amount. The turnout row uses the four surveys carrying the attendance items. The two negative coefficients are negative in every wave and significant on every leave-one-out sample. The shift does not change the balance between the community and government sides, and it comes on top of the rise in the count, not in place of it. \\\p < 0.001, \\p < 0.01, \p < 0.05.

Two ways of asking about the area

The survey asks principals about crime twice. Once about the area where the school sits, and once about the areas where its students live. The second question predicts the number of organizations better than the first: +0.165 against +0.126.

The two questions do not share a response scale. Reading them as though they did reversed one of this project's results before the error was caught.

It also matters that the reading is the principal's, not a recorded crime statistic. Put the school's own recorded incidents into the model and the principal's description keeps predicting. Put in how much trouble is reported inside the school and that washes out while the reading of the outside does not. The reading of the surrounding area does the work, not what has already happened in the building.

The two that do not rise: parents' groups and the police

Six of the eight organizations become more common as the reported crime level rises, once school size, grade level, where the school sits and which survey are allowed for. Two do not.

Parents' groups become less common, at -0.016 per standard deviation. The survey suggests why. It also asks how many parents turn up to school events, and in the areas principals call high-crime, fewer do. The schools are not turning away from parents. There are fewer organized parents there to work with.

Work with the police is no more common, at -0.012. We report that and do not build on it. It holds in 2021-22 alone, and the pooled figure does not survive dropping any of three of the six surveys. The argument about enforcement rests on the counts instead.

What changed over the sixteen years

Between 2005-06 and 2021-22, the share of schools working with juvenile justice agencies fell from 40% to 26%. The share working with mental-health providers rose from 52% to 76%. The other six barely changed.

Through all of it the average number of organizations a school works with stayed in a narrow band, between 3.8 and 4.4. Which organizations schools worked with changed. How many they worked with did not.

A line chart with one line per organization across the six surveys, 2005-06 to 2021-22. Juvenile justice falls from 40 to 26 per cent of schools and mental-health providers rise from 52 to 76 per cent. The other six lines stay close to flat.
Figure 5. The share of schools working with each of the eight organizations, by wave, survey-weighted. Juvenile justice fell and mental-health providers rose; the other six barely changed.

Table 11. Share of schools working with juvenile justice and with mental-health providers, by survey and by the crime level the principal reports

2005-06 2007-08 2015-16 2017-18 2019-20 2021-22 Change
Mental-health provider
High-crime areas 66% 68% 72% 76% 87% 70% +4 pts
Moderate 56% 51% 65% 68% 81% 78% +21 pts
Low-crime areas 50% 50% 55% 62% 76% 76% +25 pts
Juvenile justice
High-crime areas 45% 37% 21% 33% 21% 22% -23 pts
Moderate 42% 41% 35% 28% 32% 21% -21 pts
Low-crime areas 39% 39% 28% 27% 31% 27% -12 pts

Note: Survey-weighted shares, n = 13,167. Crime level is the principal's description of the area. The two rows that changed over the period are shown; the other six organizations barely changed. On mental health, high-crime schools led low-crime schools by 15 points in 2005-06 and the two were level by 2021-22. Between 106 and 144 schools report a high level of crime in any one wave, so a single cell carries a standard error of roughly four points and the wave-to-wave movement in that row should not be read closely. Interacting the crime measure with time, the association with the count of organizations falls across the six waves by -0.144 (p = 0.026). The fall sits in the pandemic year, not in a gradual narrowing: estimated without 2021-22 it is -0.040 (p = 0.54), and on the four pre-pandemic waves -0.016 (p = 0.79). So the convergence in the levels shown above does not appear as a downward trend in the association before the closures. Taken one organization at a time the trend does not separate from zero either, at p = 0.10 and p = 0.08. \\\p < 0.001, \\p < 0.01, \p < 0.05.

The change did not happen evenly everywhere. Split the two organizations that changed by the crime level the principal reports and the shift shows up in both, but it runs further in the schools whose principals call the area high-crime.