2016AmherstElementaryBuildingProject:

Teacher/StaffandParent/Guardian
SurveyResults
McBassi&Company
January13,2016

Overview:
SurveyDetails

DescriptionofSurveys

Twosurveysdesignedtogatheranonymousopinionsregardingthe4optionsbeing
consideredbySchoolCommittee*
AdministeredonlineJanuary4,2016,toJanuary10,2016
Identicalmajorelementsforbothteacher/staffandparent/guardianversions:

Onepagesheetfromdistrictonfacts/implications
Favorable/unfavorableratings
12factors choose3mostimportant
Rankbuildingoptionstoptobottom
Openendedadditionalcomments

Quickturnaroundsurveys
Getopinionpulseinwaythatcanbequantified
Noguaranteeresultsarerepresentativeoffullpopulationsbeingsurveyed(thisistrue
ofalmostallsurveys)
Beespeciallycarefulinterpretingresponsesfromsmallgroups
Quantitativeresultscomplementedbydetailedopenendedresponsessubmittedby50
percentofparent/guardianrespondentsand38percentofteacher/staffrespondents

*Responsestosomeparents/guardianscommentsaboutthesurveydesignareavailableina
separatedocumentappendedtotheendofthisreport.
3

BuildingOptionsUnderConsideration

OptionA: ReplaceWildwoodwithanewbuilding(360K6students);Crocker
FarmremainsPreK6;FortRiverremainsK6

OptionB: ReplaceWildwoodandFortRiverwithasinglenewbuildingthat
containstwoseparateK6wings(670students);CrockerFarmremainsPreK6

OptionC: ReplaceWildwoodandFortRiver;reconfigurethedistricttohavea
newunifiedbuildingcontaining2separateGrade26wingsforallARPSGrade
26(750students);CrockerFarmbecomesaPreK1EarlyChildhoodCenter

OptionD: ReplaceWildwoodandFortRiver;reconfigurethedistricttohavea
newunifiedbuilding(750students)containingonewingforGrades24andone
wingforGrades56;CrockerFarmbecomesaPreK1EarlyChildhoodCenter

Teacher/StaffSurvey:
DetailedResults

Teacher/StaffSurvey
Allteachers/staffin3Amherstelementary
schoolsinvited(viaemails)torespond
Breakdownsbyschoolandbyjobtype
Overallresponserate=50%
Teacher/staffsurveymarginoferror=+/ 5.9%
(95%confidencelevel)
6

Teacher/StaffSurvey:ResponseRates

Note:Manyofthetablesinthisreportuselighttodarkgreenshadingto
visuallyindicaterelativelows(lightergreen)torelativehighs(darkergreen)
withinagivendataroworcolumn.
7

Teacher/StaffSurvey:OverallFavorability
OptionA

OptionB

OptionC

OptionD

20

23

27

15

22

%VeryFavorable%Favorable

17

28

34

47

15

10

14

13

19

17

%Neutral%Unfavorable

27

33

%VeryUnfavorable

Teacher/StaffSurvey:FavorabilitybyGroup
%ofrespondentsratingeachoptionFavorableorbetter(i.e.,
FavorableorVeryFavorable)

Teacher/StaffSurvey:FavorabilityPointsbyGroup
AverageFavorabilityPoints:0.0to4.0scale
(0=VeryUnfavorable,1=Unfavorable,2=Neutral,3=Favorable,4=VeryFavorable)

10

Teacher/StaffSurvey:RankingOptions
OptionA

OptionB

OptionC

OptionD

%TopChoice

11

40

42

25

20

24

48

56

16

23

18

34

13

23

%2ndChoice%3rdChoice%BottomChoice

Teacher/StaffSurvey:TopChoicebyGroup
%ofrespondentsrankingspecifiedoptionas#1choice:

12

Teacher/StaffSurvey:%OpentoConsidering
%ofrespondentslikelyopentoconsideringeachoption
Definedas:rankingchoiceeither1stor2ndAND
favorabilityratingofNeutral,Favorable,orVeryFavorable
0

OptionA

10

20

30

40

60

70

31

OptionB

13

50

66

OptionC

37

OptionD

37

80

90

100

Teacher/StaffSurvey:%OpentoConsidering
%ofrespondentslikelyopentoconsideringeachoption
Definedas:rankingchoiceeither1stor2ndAND
favorabilityratingofNeutral,Favorable,orVeryFavorable

14

Teacher/StaffSurvey:UnderlyingFactorsOverall
%ofrespondentscitingeachfactorintheirTop3factorsmost
importantindeterminingtheirpreferencesamongthebuilding
options:

15

Teacher/StaffSurvey:UnderlyingFactorsbyTopChoice
%ofrespondents,bytopchoice,citingeachfactorintheirTop
3factorsmostimportantindeterminingtheirpreferences
amongthebuildingoptions:

16

Teacher/StaffSurvey:UnderlyingFactorsbyJob
%ofrespondents,byjobcategory,citingeachfactorintheirTop
3factorsmostimportantindeterminingtheirpreferences
amongthebuildingoptions:

17

Teacher/StaffSurvey:UnderlyingFactorsbySchool
%ofrespondents,byschool,citingeachfactorintheirTop3
factorsmostimportantindeterminingtheirpreferencesamong
thebuildingoptions:

18

SummingUp:Teacher/StaffSurvey
OptionBisviewedmorefavorablyandisthetop
choiceofahigher%ofrespondents,withbroad
appealacrossschoolsandjobcategories
Afewvariations:
FortRiverrespondentsstatisticallysignificantlydifferent
onmanyresponsesthanCrockerFarm/Wildwood;still
favorOptionB,butnotasstrongly
ELLteachers,preschoolteachers/specialistsfavorOptions
C/D

HealthyWork/LearningEnvironmentandImpacton
StudentLearningbothcitedinTop3by60%+
19

Parent/GuardianSurvey:
DetailedResults

Parent/GuardianSurvey
Parents/guardiansofcurrentorfutureelementary
schoolstudentsinvitedtorespond
Outreach:2emails,backpackflyer,robocall,PGO
blogsandcommunications,superintendentemail
newsletter,contactedlocalpreschoolanddaycare
centersbyemailandphone
Breakdownsbyschool,gradelevel,special
education
Estimated overallresponserate=27%
Marginoferror=+/ 4.1percent(95%confidence
level)
21

Parent/GuardianSurvey:ResponseStatistics
451overallresponses
SurveyavailableinEnglishandSpanish;received1Spanishresponse

Estimated27%responserateisbasedoncalculationusingunique
parentemailaddresses;estimateexcludesfutureparents
Surveyalsoopentofutureparents(liveinAmherst,havechildren
notyetofschoolage);68responsesreceivedfromthisgroup
69%ofrespondentswouldbedirectlyaffectedbypossiblenew
buildingand/orreconfiguration(i.e.,atleastonechildinK2or
notyetinschool)
22

Parent/GuardianSurvey:ResponseStatistics
Amongparentswithchildreninelementaryschools,response
proportionswerequitecomparabletoschoolenrollmentand
specialeducationpercentages:

Forschoolbyschoolcountsandbreakdowns,respondentswithchildreninmultipleschoolsare
includedinallapplicableschools.Theyarecountedonlyonce,however,foroverallaverages.
23

Parent/GuardianSurvey:OverallFavorability
OptionA

30

OptionB

31

OptionC

OptionD

12

19

19

11

%VeryFavorable%Favorable

24

15

19

32

12

10

16

23

14

21

17

%Neutral%Unfavorable

39

44

%VeryUnfavorable

Parent/GuardianSurvey:FavorabilitybyGroup
%ofrespondentsratingeachoptionFavorableorbetter(i.e.,
FavorableorVeryFavorable)

Differencesacrossschoolsarestatisticallysignificant(95%+confidence
level).Thisisalsotrueofalmostallotherparent/guardianschoolbased
differencesintheslidesthatfollow.
25

Parent/GuardianSurvey:FavorabilityPointsbyGroup
AverageFavorabilityPoints:0.0to4.0scale
(0=VeryUnfavorable,1=Unfavorable,2=Neutral,3=Favorable,4=VeryFavorable)

26

Parent/GuardianSurvey:RankingOptions
OptionA

OptionB

OptionC

OptionD

%TopChoice

27

48

32

21

22

38

34

38

16

40

14

24

14

41

%2ndChoice%3rdChoice%BottomChoice

Parent/GuardianSurvey:TopChoicebyGroup
%ofrespondentsrankingspecifiedoptionas#1choice:

28

Parent/GuardianSurvey:%OpentoConsidering
%ofrespondentslikelyopentoconsideringeachoption
Definedas:rankingchoiceeither1stor2ndAND
favorabilityratingofNeutral,Favorable,orVeryFavorable
0

10

20

30

OptionA

OptionD
29

50

51

OptionB

OptionC

40

55

29

31

60

70

80

90

100

Parent/GuardianSurvey:%OpentoConsidering
%ofrespondentslikelyopentoconsideringeachoption
Definedas:rankingchoiceeither1stor2ndAND
favorabilityratingofNeutral,Favorable,orVeryFavorable

30

Parent/GuardianSurvey:UnderlyingFactorsOverall
%ofrespondentscitingeachfactorintheirTop3factorsmost
importantindeterminingtheirpreferencesamongthebuilding
options:

31

Parent/Guardian Survey:UnderlyingFactorsbyTopChoice
%ofrespondents,bytopchoice,citingeachfactorintheirTop
3factorsmostimportantindeterminingtheirpreferences
amongthebuildingoptions:

32

Parent/Guardian Survey:UnderlyingFactorsbySchool
%ofrespondents,byschool,citingeachfactorintheirTop3
factorsmostimportantindeterminingtheirpreferencesamong
thebuildingoptions:

33

SummingUp:Parent/GuardianSurvey
OptionsAandBveryclose(withinsurveymarginof
error)onalmostallsummarymeasures
Statisticallysignificantdifferencesacrossschoolsin
mostmeasuresoffavorabilityandpreferences
Responsesfromdirectlyaffectedparentsandfrom
parentsofchildrenreceivingSpecialEducation
servicesarebothsimilartooverallsampleofall
respondents
Topfactorscited(50%+):ImpactonStudent
Learning,HealthyWork/LearningEnvironment
34

www.mcbassi.com

RESPONSESFROMMcBASSITOPARENTS/GUARDIANSSURVEYCOMMENTSONTHE
DESIGNOFTHEAMHERSTELEMENTARYSCHOOLBUILDINGPROJECTSURVEY
January11,2016

Approximately5percentofopenendedcommentsreceivedinthejustcompletedparent/guardiansurvey
containedsomecritiqueofthesurveydesign,thesurveyprocess,and/ortheoptionspresentedwithinthe
survey.ThisdocumentprovidesabriefresponsefromsurveyadministratorMcBassi&Companytotheissues
raisedinthosecritiques.

SURVEYISPOORLYDESIGNEDORBIASED:Manycommentsinthiscategoryseemedrelatedtothelimited
numberofbuildingoptionsincludedinthesurvey,andreflectedfrustrationthatotheroptions(e.g.,
renovatingWildwood;buildingtwoseparatenewschools)werenotincluded.Otheroptionswerenot
includedinthesurveybecausetheSchoolCommitteewaslookingforfeedbackononlythefouroptionsitis
activelyconsidering.

Othercommentssuggestedthesurveywasspecificallydesignedtoyieldaprespecifiedsetofresultsdesired
bytheSchoolCommitteeand/oradministration.Thisisnotthecase.Theonlysurveycontentprovidedbythe
SchoolCommitteewastheonepageimplicationsPDFdocument.Allothersurveycontent(includingall
descriptionsoftheoptionsandfactors)wasdraftedbyMcBassi,whichhasnostakeinthesurveyoutcome.
TheSchoolCommitteereliedonMcBassistextandrecommendationsandmadeonlyverylightedits.Indeed,
themostsignificantsetofchangesthatweremadetotheoriginalsurveydraftcamefromsuggestions
submittedtotheSchoolCommitteebyparentreviewerCatherineCorson.

SURVEYWASRUSHED:Thesurveytimeline,fromapprovaltoresults,wasindeedquitecompressed,butwe
areconfidentthesurveyiswellsuitedtoaccuratelycaptureopinionsontheoptionsbeingconsideredbythe
SchoolCommittee.Themostsignificantpositiveeffectofalongertimeframewouldhavebeentoincreasethe
responserates(bysomeunknownamount).While,formanyreasons,itisalwaysbettertohavealarger
numberofdifferentrespondents,wearealsoencouragedbythefindingthatresponsepatternsfromearly
respondentsandlaterespondentstothesurveyseemedsimilar,providingsomeevidencethatthereisnot
significantdifferencebetweenthemostenthusiasticrespondents(whotendtorespondearly)andotherswho
respondedneartheendofthe(admittedlyshort)surveyresponsewindow.

MISSINGFACTORS:Somerespondentsnotedthatimportantfactorswerenotavailableinthelistof12
presented.Mostfrequentlycitedwasschoolsize.Thefactorquestionwasdesignedtopresenta
manageablenumberoffactorsforrespondentstoreviewandprioritize.Inourexperience,aquestionlikethis
becomesmoreconfusingorunwieldyforrespondentsasthenumberofpossiblechoicesincreases,especially
forcomplexfactorslikemanyoftheonesaffectingthisdecision.Wethereforesoughttolistarelatively
limitednumberofdifferentfactors.Havingreviewedparentscomments,however,itisclearthatschool
sizeinparticularwouldhavebeenausefuladditiontothelist.

ONLYALLOWEDTORANK3FACTORS;WOULDHAVEPREFEREDTORANKTHEIMPORTANCEOFEACHONE
ONTHELIST:TheSchoolCommitteewasmostinterestedinlearningwhatfewfactorsweretheverymost
importanttoeachrespondent,andtofacilitatethis,requestedadesignthatwouldeliminatethepossibilityof
respondentspotentiallyrankingalloralargepercentageofthefactorsasveryimportant.Wetherefore
specificallydesignedthequestiontobeforcedchoice,whererespondentswerepresentedwithalistof
multiplepositivefactors,andaskedrespondentstoselectthelimitednumberthatweremostimportantin
shapingtheirpreferences.

FACTORSAREINTERDEPENDENT:Otherrespondentsnotedthatthe12factorsareinterdependent.Weagree,
butthiswouldbetrueofanysetoffactorsrelatedtosuchacomplexdecision.Wesoughttodifferentiatethe
inherentlyinterdependentfactorsasmuchaspossible(andaddedfactordefinitions,perMs.Corsons
suggestion,inanefforttoclarifyhowtheydifferedfromoneanother).

NOOTHER(FILLINBLANK)OPTIONFOREACHQUESTION:Aprimarygoalofthesurveywastoquantify
opinionsofrespondents.Thereisalwaysatensioninsurveydesignbetween(1)providingflexibilityto
respondentstocapturemostaccuratelytheirpreciseopinionsand(2)beingabletoquantifyresultsmore
broadlyinastraightforward,meaningfulway.Morerespondentflexibilitythusmeanslessabilitytoquantify
andsummarizetheresultsclearly.Wesoughttoaddressthistensiondirectlybyenablingboth:keepingthe
initialquestionsclosedendedandquantifiablewhileprovidinganunlimitedopenendedcommentboxatthe
endofthesurvey.(Fully50percentofparent/guardianrespondentstookadvantageofthisopportunityto
sharetheircomments.)

NOSOCIOECONOMICORDEMOGRAPHICQUESTIONS:Whetherornottoincludetheseitemswasan
extremelydifficultdecision.Intheend,socioeconomicanddemographicquestionswerenotincludedfortwo
mainreasons,reflectinganothertradeoffinherentinsurveydesign.

First,therewasstrongemphasisatthemostrecentSchoolCommitteemeetingonthedesireforafully
anonymoussurvey,andtheentiresurveywasdesignedwiththisinmind(forexample,itasksonlyabout
studentsgraderanges,notspecificgradelevels).Wefeltthatincludingalargenumberofquestionsregarding
personalcharacteristicscouldunderminethismessage.Wethereforeavoidedanyquestionswithsmall
potentialresponsegroupsthatmayhaveerodedrespondentsconfidencethattheirresponseswere
anonymous.

Second,everyquestionaskedaboutpersonalcharacteristicsincreasesthelikelihoodthatarespondentwill
choosetoabandonthesurvey.Theparent/guardiansurveyalreadyopenswith4(or5)keypersonalquestions
(inAmherstschools,whichschool,whichgrade(s),specialeducationstatus).Tohelpmaximizeresponserates,
weoptednottoaddadditionalpersonalcharacteristicquestionsontopofthese.

Alternatively,othercommentssuggestedaskingoptionalsocioeconomic/demographicquestions.Inour
experience,largepercentagesofrespondentstypicallyoptoutofansweringsuchitemswhenpermittedtodo
so.Thismakesitextremelydifficulttointerpretanycountsforsuchquestionswithlargenumbersofmissing
values.

NOOPTIONINCLUDEDTOGOBACKANDCHANGERESPONSES:Abackbuttonwasnotincludedinthe
surveybecauseoftheinitialscreeningquestionsusedtoconfirmthatrespondentswerecurrentorfuture
Amherstelementaryparents.Wesoughttoavoidactivelysignaling,byinclusionofthebackbutton,that
changestosuchresponses(potentiallyinordertogainaccesstothesurvey)wereacceptable.

FINANCIALINFORMATIONNOTINCLUDED:Financialinformation(costsofvariousoptions)wasnotincluded
inthesurveybecauseitwasnotavailableatthetimeofthesurvey.

SURVEYWASINTERNETONLY:ThecompressedtimelinenecessitatedanInternetonlysurvey,asdistributing,
collecting,andcodingpapersurveyswasimpracticalgiventhereportingtimeconstraints.TheSchool
Committeeattemptedtoaddressthisissueinitscommunicationstoparents/guardians,whichspecifically
invitedanyonewithoutInternetaccesstotakethesurveyataschoolcomputer.