Livingston Schools Work to Ensure Survey Data is Valid and Reliable

ADAPT Coalition Senior Coordinator Joel Torres Credits: Carolyn Moses
Superintendent of Schools Christina Steffner Credits: Carolyn Moses

LIVINGSTON, NJ – In response to several Livingston residents who raised concerns over the validity of the recently administered Alcohol & Drug Abuse Prevention Team (ADAPT) Coalition survey at last week’s Livingston Board of Education (LBOE) meeting, Superintendent of Schools Christina Steffner followed up with both ADAPT and Epiphany Community Services (ECS) to get answers to the community’s questions and presented her findings at Monday’s LBOE meeting.

The survey was fielded last month to students who voluntarily opted into taking it during their school day in health classes at Mt. Pleasant Middle School, Heritage Middle School and Livingston High School.

Last administered in the township in 2014, the ADAPT survey strives to take a snapshot of attitudes that students have toward alcohol, drugs, tobacco use and substance abuse at two-to three-year intervals. Since the survey’s inception in 2012, it has been used in 17 unique districts in New Jersey and has been administered to nearly 8,200 students.

Sign Up for E-News

ADAPT works in concert with ECS to analyze survey results and give feedback on survey methodology and data corruption, upon request.

In response to issues raised around the potential of data corruption during the public comment portion of last week’s LBOE meeting and the claim by one parent that he was able to repeatedly take and submit the survey while off school premises, Steffner reached out to ADAPT and ECS in follow up.

According to Steffner, in order for ECS to include a survey in its final analysis, each survey must have been taken on school grounds at the appointed time, be 100-percent completed and include consistent responses on sets of questions designed to be paired and to yield like answers.

ECS was given all three of Livingston schools’ respondent data to review and analyze. The first step in that process was to put the data through a “cleaning process,” which tests for validity, reliability, accuracy and identification of potential limitations of collected data, according to Steffner.

Of the nearly 3,000 surveys originally submitted, 756 were found by ECS to be unusable. Of the unusable data, 425 surveys were found to be less than 75-percent complete.

Sixteen survey respondents failed a test question formulated to assess a respondent’s level of honesty when taking the survey by looking at whether the respondent replied affirmatively to having knowledge of a fictitious drug used in surveys of this type. An additional 90 surveys were rejected for including inconsistent responses between pairs of questions asking the same thing in a slightly different way.

“We then asked ECS to go back and look at surveys that weren’t started within 10 minutes of their being administered in the classroom,” said Steffner. “Those 225 surveys were also rejected, as we assumed that if the students were taking the survey with the teacher in the room, they would have started within that time frame.”

Ultimately, 2,270 surveys were found to be usable. These surveys are considered valid and reliable by the industry standard with a margin of error of 95 percent—a very high confidence rating, according to Steffner.

“At this point, ECS feels they have a great deal of data they can count on as being accurate, valid and reliable,” reported Steffner. “They also feel that Livingston Schools provided some really good data that is representative of the students who took the survey.”

ADAPT Coalition Senior Coordinator Joel Torres was also on hand at the meeting to speak about the methodology and eventual goal of the survey.

Torres discussed the limited funding associated with the administration of the ADAPT Survey as a reason why it hasn’t been used more in Essex County.  Because the survey is free to take and utilizes limited grant dollars, it is typically administered to only two or three school districts within Essex County every few years. This year, the survey is being distributed in both Livingston and East Orange.

Data from the surveys is not publicly shared, although schools can request a private report for their own uses. Additionally, because each school’s information is kept private, the county-wide assessment that ADAPT eventually releases focuses on trends, rather than on data specific to each district queried.

“The goal of the survey isn’t to pinpoint what various towns are doing right or wrong when it comes to substance abuse,” said Torres. “It’s more to show that the programs that ADAPT provides are effective, as well as both evidence and research-based. These results will help us make sure that the programming we’re offering is going to be helping and supporting the community.”

Results from the Livingston survey will be ready within a month, with the results of the county-wide survey becoming available a few months following that.

TAP Into Another Town's News:

Sign Up for E-News


Livingston Pitcher Ryan Cardona Named Athlete of the Week

April 5, 2018

LIVINGSTON, NJ — As spring sports begin at Livingston High School, the varsity baseball team’s star pitcher, Ryan Cardona, has been named the season’s first Athlete of the Week.

The senior threw 91 pitches in an extra-inning showdown against Millburn, a Top 10 team, on Saturday morning—walking one and striking out 12 before being taken out. Although the ...

Full Pet Grooming Service 25% OFF

April 20, 2018

LITTLE FALLS, NJ - Cloud Canine Grooming Salon & Spa in Little Falls is open for business and owner and pet stylist Melissa DiRoma is offering 25% off a FULL GROOMING SERVICE for all new customers. Call (973) 837-8884 or visit to schedule your appointment. Mention promo code TAP DOG for discount. 

About Cloud ...

Free Wellness Event at The Joint Chiropractic

WEST CALDWELL, NJ — The public is invited to a "Wellness Event to Remember" at The Joint Chiropractic in West Caldwell on Thursday, April 19 from 7 p.m. to  9 p.m.

Guests will include:

Michael Piercy, owner of The Lab
Justyna Debski, owner of Revive Mind Body
Karen Caplan, owner of Nutrition Transitions

Join the ...

Luxury Facial Services 50% OFF

MILLBURN, NJ - DeAmour Salon & Spa is proud to announce its newest team member, Renee Rudikh, formerly of the famous Georgette Klinger Spa at the Short Hills Mall.

Rudikh has extensive experience and specializes in a plethora of facial styles including: deep pore cleansing/European, microdermabrasion with collagen, teenage, men's, back, LED and customized European ...

YMCA $0 Enrollment in April

LIVINGSTON, NJ - For the month of April, the West Essex YMCA is offer $0 enrollment. 

Take advantage of all that your local Y has to offer for the whole family!

Personal Training
Group Classes
Low monthly membership
And much much more!...

Check out all that the Y has to offer HERE

About the West Essex YMCA:
The West Essex YMCA has ...

MAX Challenge of West Orange - 2 Weeks FREE and more...

WEST ORANGE, NJ - The MAX Challenge of West Orange is about to start its next challenge.  Sign up before April 9, and you will receive maximum benefits, including two weeks free!



12 weeks for the price of 10
Unlimited fitness classes 
Nutritional ...

deAmour Salon - Complimentary Blowout with Other Select Services - $40+ Value

Millburn, NJ - Salon Profilo in Milburn has recently rebranded to deAmour Salon & Spa! In celebration, owners Roula and Grace are inviting new and existing clients to enjoy a complimentary blowout with any color service. Call (973) 379-8300 to schedule your appointment. Promo code: TAP COLOR

deAmor Salon specializes in multiple coloring techniques and stays current on industry ...

Upcoming Events

Sat, April 21, 10:30 AM

West Essex YMCA, Livingston

Healthy Kids Day at the West Essex YMCA

Health & Wellness

Mon, April 23, 1:30 PM

Livingston Public Library, Livingston

Monday at the Movies: LOVING VINCENT

Arts & Entertainment


Wed, April 25, 10:00 AM

Estelle Finkel Center for Learning, Livingston

Upcoming 2018 Spring SAT and ACT Courses

County Announces Improvement Plans for Grover Cleveland Park Playground and Tennis Courts

April 20, 2018

CALDWELL/ESSEX FELLS, NJ — Nearly $1.2 million in improvements will be made to modernize the Essex County Grover Cleveland Park playground and tennis courts.

Essex County Executive Joseph DiVincenzo, Jr. announced his improvement plans on Friday morning, stating that Grover Cleveland Park is a popular site for families and children, and that the playground and tennis courts need to be ...

Take A Chance on the Livingston Library To Conclude

April 20, 2018

LIVINGSTON, NJ — The Friends of the Livingston Library’s annual “Take A Chance on the Library” Auction & Raffle will be ending Tuesday, April 24  when the public is invited to the Library’s Program Room as winners are announced, beginning at noon. The event invites all members of the community to “take a chance on the library” by ...

Letter to the Editor: Don't Complain. Vote!

April 12, 2018

Don’t Complain; Vote!

It’s no secret that people have strong feelings about what’s happening in our country. It’s also true that much of politics is local. In November, 11th District residents will have the opportunity to choose a new congressional representative who will not only serve as a critical check on the federal level, but also determine how our distract fares ...

Cluelessly Clueless

I teenaged my way through high school under the assumption that my parents had no idea what I was doing.  I like to think I was pretty good at withholding information and presenting situations in ways that were other than they really were.


Still, sometimes they found things out.  Like the time my friends plopped me on our front door step at one o'clock in the morning ...