>> WELCOME AND THANK YOU 
ACKNOWLEDGE STANDING BY.
AT THIS TIME ALL PARTICIPANTS 
ARE IN A LISTEN ONLY MODE.
I WOULD LIKE TO NOW TURN THE 
MEETING OVER TO THE CENSUS 
BUREAU.
THANK YOU.
>> TOMMY WRIGHT.
>> GOOD MORNING AND WELCOME BACK
TO THE SPRING MEETING OF THE 
CENSUS ADVISORY COMMITTEE 2019.
OF COURSE IT'S TIME TO PLAY THAT
WONDERFUL GAME, WHO SAID THAT.
IT'S THE LONGEST RUNNING GAME 
AMONG FEDERAL ADVISORY 
COMMITTEES.
MAYBE WE'LL GET AN AWARD AT SOME
POINT.
THERE'S NO LOSERS, NO WINNERS, 
AND LET THE RECORD SHOW JOHN WAS
IN HIS SEAT AT
8:30.
2030 CENSUS
BASED ON PEOPLE.
IF I DOSE OFF TOMORROW MORNING 
IT'S BECAUSE I STAYED UP 
WATCHING THE OREGON DUCKS PLAY
VIRGINIA.
I'M A MEMBER OF A TEAM WHO 
HAPPENS TO OCCUPY THE MIDDLE 
POSITION.
EVERY HOUSEHOLD WILL HAVE THE 
OPTION OF RESPONDING ONLINE, BY 
MAIL OR BY PHONE.
SEVERAL PEOPLE MAY HAVE SAID
SOME OF THESE.
PROVE A 
LOT, LEARN A LOT.
PROVE AT, LEARN AT.
MICHAEL.
IT IS A NEAR CERTAINTY THE LEVEL
OF NON-COMPLIANCE WOULD SPIKE 
RELATIVE TO HISTORIC
NORMS STANDARD OF SURVEY DESIGN 
AND ESTIMATION AND REPORTING
REFERRING TO THE CENSUS BUREAU.
59% SAID THEY DID NOT
TRUST THE FEDERAL GOVERNMENT.
>> WHAT IS THIS QUOTE?
SEVERAL PEOPLE SAID START YOUR 
FUTURE -- SHAPE YOUR FUTURE, 
START HERE.
JUST GO TO
DATA.CENSUS.gov.
MOST SOPHISTICATED MARKETING IN 
THE WORLD.
AL, ARE WE READY
TO GO?
AND LOOKING AT ACCURACY AND 
RECONSTRUCTABILITY AND
FINALLY, DOES NOISE AND FUSE 
DATA STILL MEET STATISTICAL 
PURPOSES.
THERE'S ONE MORE.
THIS IS THE
FUN PART.
BOTH OF YOU
SAID IT.
IF ANYONE INTENDS TO GIVE PUBLIC
COMMENT THIS MORNING AND HAS NOT
DONE SO PLEASE PROVIDE YOUR NAME
AT THE REGISTRATION GUEST.
ACKNOWLEDGE WEBCAST VIEWERS A 
PHONE NUMBER WILL SHOW UP ON 
YOUR SCREEN DURING THE SECTION 
AT 11:00 TODAY.
I'D LIKE TO REMIND MEMBERS AND 
THOSE IN THE ROOMS USING YOUR 
SMARTPHONES TO TAKE PICTURE AND 
RECORDING DEVICE
S IS NOT ALLOWED WITHIN THE 
CENSUS BUREAU.
I'D LIKE TO REMIND MEMBERS, WHEN
YOU ARE READY TO SPEAK, TURN UP 
YOUR NAME CARD AS WE DID 
YESTERDAY, TURN ON YOUR 
MICROPHONE AND CLEARLY STATE 
YOUR NAME ACKNOWLEDGE THE 
RECORD.
THIS IS NEEDED EACH TIME YOU 
SPEAK FOR  THE MOST ACCURATE 
TRANSCRIPT.
EVERY MEMBER SHOULD HAVE 
RECEIVED A TRAVEL REIMBURSEMENT 
RECORD AND ACKNOWLEDGE COMMITTEE
MEMBERS WHO NEED A RIDE FROM THE
BUS TO THE HOTEL IT WILL LEAVE 
PROMPTLY AT 2:15 AND WILL MAKE A
STOP AT 2:45 AT THE RONALD 
REAGAN AIRPORT AND DUE TO 
FEDERAL GUIDELINES THE 
REFRESHMENTS ACKNOWLEDGE THE 
COMMITTEE ARE ACKNOWLEDGE 
MEMBERS ONLY.
I'D LIKE TO TURN IT OVER TO 
ALLISON PLIER -- PLYER TO MAKE 
OPENING REMARKS.
>> GOOD MORNING, EVERYONE.
IN THE SOUTH WE RESPOND WHEN 
SOMEBODY SAYS GOOD
MORNING.
GOOD JOB.
>> IT'S GREAT TO HAVE EVERYONE 
BACK AND WE'RE GLAD KRISHNA WILL
CALL IN AT 9:30 ACKNOWLEDGE THE 
POPULATION SURVEY DISCUSSION AND
HE AND PETER WILL CALL IN 
ACKNOWLEDGE THE FINAL 
RECOMMENDATIONS.
SO I HOPE EVERYONE CAN STAY 
UNTIL 2:00 TO FINISH IT UP.
I THINK WE'RE IN GOOD SHAPE 
ACKNOWLEDGE GETTING THE 
RECOMMENDATIONS FINISHED DURING 
THE MEET WHICH IS IS GREAT.
SO REALLY APPRECIATE THAT WE 
WERE ABLE TO KEEP EVERYTHING ON 
TRACK YESTERDAY.
SOME OF THE PRESENTATIONS WENT A
LITTLE LONG.
I'LL KEEP ENCOURAGING PRESENTERS
TO KEEP IT TO THE TO MINUTES, IF
YOU CAN, SO WE HAVE TIME 
ACKNOWLEDGE DISCUSSION 
ACKNOWLEDGE WHAT WE'RE HERE 
ACKNOWLEDGE AND WE'RE DOING A 
GOOD JOB SO I LOOK FORWARD TO 
THE CONVERSATIONS TODAY.
>> TOMMY WRIGHT.
THANK YOU, ALLISON.
THE FIRST PRESENTATION TODAY
IS ON COMMUNITY PARTNERSHIP AND 
ENGAGE MANY PROGRAM AND WILL BE 
BE AN EVERY VIEW.
AN
OVERVIEW.
>> GOOD MORNING.
I'M FROM THE SOUTH TOO.
I EXPECT A RESPONSE.
I'M DALE KELLY, CHIEF OF THE 
FILL DIVISION AND RESPONSIBLE 
ACKNOWLEDGE THE FILL DIVISION OF
THE DECENNIAL CONSENSUS.
I ALSO WANT TO THANK THE SUBJECT
MATTER EXPERTS IN THE ROOM.
I AM GOING TO TALK TO YOU ABOUT 
OUR COMMUNITY PARTNERSHIP AND 
ENGAGEMENT PROGRAM.
THE ACRONYM ALSO KNOWN
AS CPEP.
YESTERDAY WE HAD UPGRADES ON THE
INTEGRATED PARTNERSHIP AND 
COMMUNICATIONS PLAN.
THEY MENTION THE COLLABORATION 
BETWEEN LOCAL AND NATIONAL 
PARTNERSHIPS AND HOW WE'RE 
BRINGING AWARENESS TO THE 
CENSUS.
MR. FON
TENOT DESCRIBED HOW WE'LL 
PROVIDE EVERY PERSON IN THE 
NATION AN OPPORTUNITY TO BE 
COUNT.
OUR SPECIALISTS ARE ON THE 
GROUND CONNECTIONS WITH THE 
TRUSTED VOICES IN THE COMMUNITY 
THAT WILL MAKE THIS HAPPEN AND 
THAT WILL WORK ACKNOWLEDGE 
PEOPLE UNLIKELY TO RESPOND
TO THE CENSUS.
SO THE ROLE OF OUR PARTNERSHIP 
SPECIALISTS AND MEETING THE 
PRIMARY GOAL OF THE COMPLETE AND
ACCURATE COUNT OF THE POPULATION
AND HOUSING IS TO EDUCATE, 
ENCOURAGE AND ENGAGE.
WE NEED PEOPLE TO UNDERSTAND WHY
IT'S IMPORTANT AND THE BENEFITS 
TO RESPONDING TO THE CENSUS.
AND THROUGH OUR SPECIALISTS, WE 
ENCOURAGE PARTNERS TO MOTIVATE 
IN THEIR COMMUNITY TO 
SELF-RESPOND.
HOWEVER, IF SELF-RESPONSE IS NOT
THE FIRST CHOICE, THEY FOSTER 
THE RELATIONSHIPS WITH OUR 
ENUMERATORS.
WE ARE ENGAGING GRASSROOTS 
ORGANIZATIONS TO REACH GROUPS 
WHO WE CONSIDER HARD TO LOCATE, 
HARD TO CONTACT, HARD TO 
PERSUADE AND HARD TO
INTERVIEW.
WE HAVE BUILT RELATIONSHIPS WITH
COMMUNITY-FAITH BASED AND 
ORGANIZATIONS AN OTHERS TO 
INCREASE AWARENESS
AND PARTICIPATION.
THIS IS NOT AN EXHAUSTIVE LIST 
OF ORGANIZATIONS WE CONSIDER AND
THE VOICES WE DEPEND ON TO REACH
POPULATIONS WITH HISTORICALLY 
LOW RESPONSE RATES.
OUR STATE AND LOCAL OFFICIALS 
ARE CERTAINLY IMPORTANT TO THIS 
EFFORT.
AS MENTIONED YESTERDAY, THERE 
ARE CURRENTLY 46 STATE LEVEL AND
OVER 1500 LOCAL COMPLETE COUNT 
COUNTIES.
WE ALSO RELY ON OUR ORGANIC 
ORGANIZATIONS.
THE INDIVIDUALS AND FAMILIES 
INTERFACE WITH ON A DAILY BASIS 
TO USE THEIR INFLUENCE TO 
INCREASE AWARENESS AND 
PARTICIPATION IN THE 2020 
CENSUS.
AND WE KEEP CONNECTIONS THROUGH 
OUR ORGANIZATIONS WITH OUR 
CUSTOMER RELATIONSHIP MANAGEMENT
SYSTEM OR C.R.M. TO REPORT 
ACTIVITIES OF CURRENT AND FUTURE
PARTNER.
WE ALSO USE THIS TO GENERATE 
REPORTS ON STATUS OF ACTIVITIES 
OF PARTNER ORGANIZATIONS WITH 
THE CENSUS.
THE INTEGRATION OF THE COMMUNITY
AND IT ENSURES CONSISTENT 
MESSAGING ABOUT THE 2020 CENSUS 
REGARDLESS OF WHICH PROGRAM IT 
IS COMING FROM.
MOST IMPORTANT IS WE DELIVER THE
RIGHT MESSAGE TO THE RIGHT 
AUDIENCES AT
THE RIGHT TIME.
WE ARE TAKING ADVANTAGE OF PRINT
AND DIGITAL MEDIA TO DISSEMINATE
OUR MESSAGE.
WE RELY ON OUR SPECIALISTS AND 
PARTNER TO CONVEY THE 2020 
CENSUS IS CONFIDENTIAL AND IT'S 
IMPORTANT.
THEY SUPPORT CENSUS IN SO MANY 
WAYS FROM BEING THE TRUSTED 
VOICE AND COMMUNICATOR TO 
VOLUNTEERING OR INVITING CENSUS 
HEADQUARTERS BACK TO VOLUNTEER 
AT EVENT TO GET THE MESSAGE OUT 
ABOUT THE OPPORTUNITY TO BE A 
PART OF THIS MASSIVE 
UNDERTAKING.
THEY PROVIDE INFORMATION ON 
AVAILABLE JOBS.
WHEN WE HIRE PEOPLE WE INTEREST 
TO TRAIN THEM AND WE NEED SPACE 
TO CONDUCT THESE TRAININGS.
IT IS OUR PARTNER WILLING TO 
DONATE SPACE WITHIN THEIR 
COMMUNITIES SUCH AS THEIR 
CHURCHES, SCHOOLS OR CIVIC 
CENTERS AND OTHERS AND WE'RE NOT
ASKING OUR PARTNER TO CREATE NEW
WAYS TO SUPPORT THE CENSUS, 
WE'RE SIMPLY ASKING THEM TO USE 
WHAT THEY ALREADY HAVE IN PLACE.
FOR EXAMPLE, IF AN ORGANIZATION 
HAS A NEWSLETTER OR A BLOG OR 
WEBSITE, WE'RE ASKING THEM TO 
CARRY THAT MESSAGE
ABOUT CENSUS.
DEF
 WHEN IT COMES TO RECRUITING AND
HIRING IT HAS TO BE 
REPRESENTATIVE OF THE PEOPLE OF 
THE NATION AND WE WANT 
ENUMERATORS COMFORTABLE IN WHICH
THE NEIGHBORHOODS THEY WORK AND 
LIVE.
OUR LOCAL PARTNER ARE THE 
SUBJECT MATTER EXPERTS TO 
PROVIDE INPUT AND
INPUT AND
ADVICE ON PREFERRED MESSAGING 
AND ENUMERATION METHODS.
THE CENSUS BUREAU PARTNERSHIP 
PROGRAMS INCLUDES STAFF THAT 
WILL ENGAGE MORE THAN 300,000 
NATIONAL AND LOCAL PARTNER.
IN 2010 OUR GOAL WAS 789 
PARTNERSHIP SPECIALISTS.
ACKNOWLEDGE 2020 
 ACKNOWLEDGE
2020
WE KNOW HOW IMPORTANT IT IS TO 
CONNECT WITH PEOPLE AS SOON AS 
POSSIBLE.
THIS SAY SNAPSHOT OF OUR
INTERACTIVE MAPPING IT IS 
ANOTHER TOOL THAT WE USE FOR 
EFFECTIVEAS POSSIBLE.
THIS SAY SNAPSHOT OF OUR 
INTERACTIVE MAPPING IT IS 
ANOTHER TOOL THAT WE USE FOR 
EFFECTIVESOON AS POSSIBLE.
THIS SAY SNAPSHOT OF OUR 
INTERACTIVE MAPPING IT IS 
ANOTHER TOOL THAT WE USE FOR 
EFFECTIVE COMMUNICATION AND WE 
USE IT TO IDENTIFY HARD TO 
SERVICE AREAS USING 2012 AND 
2016 AMERICAN COMMUNITY SURVEY 
DATA.
THIS TOOL IS AVAILABLE TO OUR 
SPECIALISTS.
IT'S AVAILABLE TO OUR PARTNER 
AND THE PUBLIC FOR ACCESS ABOUT 
AREAS ACROSS THE NATION THAT 
TRADITIONALLY HAVE LOW
RESPONSE SCORES.
IT LETS US KNOW WHERE SPECIAL 
AREAS ARE NEEDED FOR AREAS WITH 
LANGUAGE BARRIERS OR POVERTY 
LEVELS OR WHERE RESIDENTS ARE 
DISPLACED DUE TO NATURAL 
DISASTERS.
THIS IS ANOTHER SNAPSHOT OF THE 
TOOL.
IT SHOWS IN THIS PARTICULAR 
SLIDE IT SHOWS WHERE LOCAL 
PARTNERSHIP SPECIALISTS NEED TO 
FOCUS THEIR EFFORTS WITHIN THE 
REGION TO DEVELOP OUTREACH AND 
WORK WITH LOCAL PARTNER TO 
INCREASE AWARENESS AND 
PARTICIPATION.
THEY HAVE ACCESS AND SPECIALIST 
AND PARTNERS HAVE THIS 
INFORMATION IN ADVANCE TO MAKE 
DECISIONS.
IT'S CRITICAL FOR OUR PLANNING 
OF A DISTRIBUTION OF STAFF.
WE KNOW WHERE PARTNERSHIP 
SPECIALISTS ARE NEEDED BY USING 
THIS TOOL.
AS I MENTIONED, IT'S AVAILABLE 
TO THE PUBLIC.
I'LL GIVE YOU THE WEBSITE ON
A SUBSEQUENT SLIDE.
I'LL ASK.
WE KNOW IT WILL TAKE THE ENTIRE 
COUNTRY TO ACTIVELY SUPPORT AN 
ACCURATE 2020 CENSUS COUNT BY 
BECOMING A PARTNER IN A 
GRASSROOTS ORGANIZATION.
OUR PUBLIC BECOMES A MEMBER OF 
DIVERSE GROUP OF 2020 CENSUS 
PARTNER AND PART OF A NETWORK 
PART OF LOCAL ORGANIZATIONS THAT
HAVE PERSONAL LIVE ACCESS TO 
CENSUS DATA TO ASSIST IN 
ACCURATE REPRESENTATION FOR 
THEIR COMMUNITY.
AND THE ASK OF OUR PARTNERS IS 
THEY ASK EVERYONE TO 
SELF-RESPOND AT THE BEGINNING OF
A PEAK OPERATION AND WE HAVE
500,000 TEMPORARY JOBS
AVAILABLE NEXT SPRING.
I'LL FAST FORWARD THROUGH THIS 
SLIDE BECAUSE MARIA WENT THROUGH
THE VERSION YESTERDAY AS WELL AS
THE INFORMATION ON THE RELEASE 
OF THE WEBSITE.
I WANT TO TALK ABOUT OUR 
PARTNERSHIP PORTAL.
IT IS ANOTHER TOOL THAT IS 
AVAILABLE TO LINK RESOURCES AND 
IT PROVIDES A TOOL KIT WITH 
SUGGESTIONS ON HOW TO BEGIN 
TAILORING OUTREACH EFFORTS.
IT PROVIDES A LIST OF SUGGESTED 
ACTION ITEMS ON HOW TO SPREAD 
THE WORD AND AN ONLINE SIGNUP 
FORM TO JOIN THE EFFORT.
AND WE ALSO PROVIDE ACCESS TO 
DATA DISSEMINATION SPECIALISTS 
THROUGH WORKSHOPS AND YOU'LL SEE
THE PHONE NUMBER LISTED ON THE 
BOTTOM OF THE SLIDE.
I THINK I STAYED WITHIN MY TIME 
AND WE'RE TRYING TO CONNECT WITH
AS MANY ORGANIZATIONS AS 
POSSIBLE FOR THE HARD TO COUNT 
COMMUNITIES.
I WANT TO THANK YOU FOR YOUR 
TIME AND APPRECIATE ANY 
SUGGESTIONS OF ORGANIZATIONS 
THAT WOULD BE INTERESTED IN 
BECOME PARTNER OR THE CENSUS 
BUREAU SHOULD
ENGAGE WITH IN THE LOCAL AND 
REGIONAL LEVEL.
WITH THAT I WANT TO TURN THE 
FLOOR OVER TO 
JESSICA.
THANK YOU.
FOLKS WERE TALKING YESTERDAY AND
WOULD APPRECIATE A PAINTING OF 
THE PICTURE OF WHO SOME OF THE 
LOCAL PARTNERSHIP SPECIALISTS 
ARE AND WHAT A DAY IN THE LIFE 
OF A LOCAL PARTNERSHIP LOOKS 
LIKE OR WHAT A FOCUSSED AREA OF 
AN INDIVIDUAL LOOKS LIKE TO 
UNDERSTAND THE SCOPE UNDER A 
SINGLE PERSON SO YOU MIGHT BE 
ABLE TO -- 
>> WE HAVE SUBJECT MATTER 
EXPERTS IN THE ROOM.
A DAY IN THE LIFE OF A 
SPECIALIST, GOOD QUESTION AND 
THANK YOU FOR THAT.
SO AS WE SEE IT,
SO AS WE SEE IT THIS SAY PERSON 
OUT IN THE COMMUNITY MAKING 
CONNECTIONS.
I'LL GIVE AN EXAMPLE.
IN THIS COMMUNITY, SOME OF THE 
LOCAL CHURCHES BECAUSE WE KNOW 
PERHAPS THOSE CHURCH MEMBERS OR 
THAT PASTOR OF THAT CHURCH IS 
MAKE THE CONNECTION IN THE 
COMMUNITY WE WANT TO CONNECT 
WITH ANY ORGANIZATION THAT 
COMMUNICATES WITH PEOPLE IN THE 
COMMUNITY TO TALK WITH THE 
IMPORTANCE CENSUS AND WHY IT'S A
BENEFIT TO RESPOND TO THE CENSUS
OR
PARTICIPATE.
SPECIFIC IN THE DAY IN THE LINE,
JAIME, I'LL LOOK TO YOU BECAUSE 
YOU HAVE THE EXPERIENCE OF GOING
OUT AND BEING PART OF THAT 
ORGANIZATION.
>> GOOD MORNING.
I'M JAMIE CHRISTY LAST CONSENSUS
I WAS THE REGIONAL DIRECTOR FOR 
SOUTHERN CALIFORNIA.
HARD TO ANSWER YOUR QUESTION 
DIRECTLY BECAUSE THE SPECIALIST 
AS DIVERSE AS THE COUNTRY IS.
WE
WOULD HAVE UNIQUE AREAS OF 
FOCUS.
WE HAVE SPECIALISTS IN THE STATE
OF HAWAI'I AND THERE WOULD BE 
EFFORT TO WORK WITH THE 
POPULATION LIVING IN
HAWAI'I.
THEY WOULD SPEND DAYS GOING TO 
SPECIFIC ORGANIZATIONS.
IN SOME WAYS IT WAS A SALE PITCH
AND WOULD TRY TO SELL THE CENSUS
AND ENGAGE THEM AND FIND OUT 
EVENTS THEY HAVE SCHEDULED, 
ALIGN RESOURCES WE WOULD HAVE 
LIKE MAYBE THINGS WE COULD PASS 
OUT AT FESTIVALS OR
FAIRS AND SHE WOULD BE THE VOICE
FOR THAT COMMUNITY.
MAYBE LATER SHE'D WORK WITH THE 
ORGANIZATIONS THERE AND THE NEXT
DAY SHE MAY WORK WITH THE MAYOR 
OF HAWAI'I OR HONOLULU ON EVENTS
THE CITY WAS PUTTING ON.
IN HER INSTANTS IT WAS FOCUSSED 
ON A UNIQUE POPULATION.
OTHERS HAD WORK ON THE 
GOVERNMENT.
IN LOS ANGELES COUNTY WE'D HAVE 
A LIAISON AND BRIEF DEPARTMENT 
REPS ON THE CENSUS TIME LINE AND
THE HIRING GOALS AND SPECIFIC 
AREAS OF FOCUS AND THE AVENUES 
THE CITY HAS TO COMMUNICATE WITH
RESIDENTS OR COUNTY HAD TO 
COMMUNICATE WITH PEOPLE IN 
UNINCORPORATED AREAS.
THE PARTNERSHIP PROGRAM IS AS 
DIVERSE AS THE POPULATION IS.
WHAT'S UNIQUE IS WHAT DALE 
REFERENCES IN TERMS OF THE AREA 
FOCUS.
IT ISN'T UNIVERSAL.
IT'S FOCUSSED ON SPECIFIC AREAS.
USUALLY DEFINED BY GEOGRAPHY AND
SOMETIMES DEFINED BY 
CHARACTERISTICS MUCH A 
POPULATION.
WE SHORT OF REFINED OUR FOCUS 
THERE.
DOES THAT HELP?
>> YEAH,
THANK YOU SO MUCH.
>> ANY SUGGESTIONS IN 
ORGANIZATION WOULD BE A PARTNER 
OR THE CENSUS SHOULD ENGAGE WITH
AT THE LOCAL AND REGIONAL LEVEL.
FROM MY BACKGROUND AS AN 
OPPORTUNITY OR I'M CURIOUS IF 
THIS IS AN AREA OF FOCUS THATTED
TOO OUT TO ME AND THIS IS LESS 
GEOGRAPHIC AND MORE ABOUT 
PARTICULAR POPULATIONS OR 
CHARACTERISTICS BUT PEOPLE 
IMPACTED BY OUR CRIMINAL JUSTICE
SYSTEM AND IN KORS RATED COULD 
BE -- INCARCERATED COULD BE 
GREAT ADVOCATES FOR 
PARTICIPATION.
THEY'RE OFTEN FAMILIAR WITH HOW 
THE CENSUS COUNTS THOSE PEOPLE 
AND ALLOCATION AND OFTEN 
INTERESTED IN ADVOCATING FOR 
ADJACENT TOPICS SUCH AS THE 
RESTORATION OF
VOTING RIGHTS.
SPECIALISTS WHO KNOW HOW TO TAP 
INTO THAT EXISTING ENGAGEMENTS 
TO ENCOURAGE NOT JUST DIRECTLY 
AFFECTED PEOPLE BUT THE PEOPLE 
AROUND THEM AND THEIR 
COMMUNITIES TO ENGAGE COULD BE 
AN INTERESTING AVENUE TO 
EXPLORE.
AND THERE'S EXAMPLES OF THIS.
TRANSITIONING HOUSES ARE OFTEN 
ALREADY PARTICIPATING IN THESE 
COMMUNITY PARTNERSHIPS.
FOR EXAMPLE, THEY'RE OFTEN 
FUNCTIONING AS
POLLING STATION.
AND THERE IS A POINT FOR THE 
CONVERSATIONS AND EVEN PRISON 
NEWSPAPERS.
I LIVE IN CALIFORNIA IN THE BAY 
AREA AND SPEND A LOT OF TIME AT 
SAN QUENTON AND THE NEWSPAPER 
REACHES 13,000 PEOPLE IN THE 
CDCR.
BY EXTENSION, THEY'RE COMMUNITY,
FRIENDS AND FAMILY.
JUST A THOUGHT, FOR EXAMPLE, A 
GROUP OF PEOPLE WHO MIGHT BE 
ESPECIALLY INTERESTED IN THIS 
AND HAVE THE ABILITY TO ACTIVATE
THEIR COMMUNITIES.
AND ONE FOLLOW-UP QUESTION 
FRAMED IN A COUPLE WAYS AND 
CURIOUS HOW CPEP MEASURES THE 
EFFECTIVENESS OF PARTNERSHIP
SPECIALISTS AND HOW YOU ATTEMPT 
TO DETERMINE ATTRIBUTION FOR HOW
THEY TRANSLATE TO PARTICIPATION 
AND I FRAMED IT IN A COUPLE WAYS
IN THE SLIDES.
THERE'S A COUPLE WAYS TO GET AT 
THE INTENT OF THE QUESTION BUT I
WANTED TO OFFER THAT FOR 
DISCUSSION.
>> THANK YOU, I APPRECIATE THAT 
QUESTION.
SO WE HAVE FOUR MEASURABLE 
OBJECTIVES THAT WE PUT
IN PLACE FOR THE CPEP PROGRAM 
AND WE EXPECT TO REACH OUT TO 
300,000 NATIONAL AND CPEP AND 
WE'RE PLANNING TO REACH OUT TO 
OR FORM 300,000 PARTNERSHIPS BY 
MARCH OF 2020.
THE OTHER IS WE ARE ESTABLISHING
PARTNERSHIPS WITH AT LEAST ONE 
ORGANIZATION AND THOSE THAT 
REACH DIRECTLY FROM OUR 
OBJECTIVES THAT SERVE IN ALL 
TRACT A LOW RESPONSE SCORE OF 30
OR 9%
OF ALL CENSUS TRACKS AND TRACT A
LOW RESPONSE SCORE BETWEEN 20
AND 30.
THIS IS INFORMATION WE GET FROM 
THE ROAM WITH WE CAN IDENTIFIED 
WHERE WE NEED TO PUT OUR 
PARTNERSHIP SPECIALISTS OR HAVE 
TO FOCUS ON WITH THE LOW 
RESPONSE RATE.
WE HAVE THE INFORMATION IN 
ADVANCE.
WE CAN MOVE THEM AS NEEDED.
THE OTHER OBJECTIVE IS TO 
FACILITATE THE FORMATION OF THE 
COMPLETE COUNT COMMITTEES AND 
SIMILAR EFFORTS IN ALL 50 STATES
INCLUDING THE DISTRICT OF 
COLOMBIA, PUERTO RICO AND CITIES
WITH A POPULATION OF 200,000 BY 
JANUARY OF 2020.
WE HAVE AT LEAST 46 STATE LEVEL 
AND OVER 1500 COMPLETE COUNT 
COUNTIES.
AND THEN THE LAST IS TO PROVIDE 
SUPPLEMENTAL LANGUAGE SUPPORT 
FOR OVER 100 LANGUAGES DIRECTLY 
OVER VIA THE ESTABLISHED
PARTNERSHIPS.
I HOPE THAT GETS
TO YOUR ANSWER.
I DEFINITELY UNDERSTAND THE 
OBJECTIVES.
I'M INTERESTED TO WHAT EXTENT 
YOU CAN THREAD THAT THROUGH 
ACTUAL CENSUS COMPLETION.
THAT'S HARD TO DO OR INTEGRATED 
ACROSS A BUNCH OF DIFFERENT 
ORGANIZATIONS.
THAT WOULD THE HEART OF THE 
QUESTION.
IT'S FRAMED IN A COUPLE OTHER 
WAYS IN THE SLIDE.
DO WE HAVE A
WAY OF ONE WAY TO THINK ABOUT IS
IF WE SPENT MORE MONEY ON MORE 
COMMUNITY PARTNERS WOULD THAT 
TRANSLATE TO HIGHER CENSUS 
COMPLETION RATES AND WHAT ARE 
THE THINGS WE'RE TRACKING THAT 
TRANSLATE TO CENSUS COMPLETION?
>> WHEN YOU SAID COMMUNITY 
PARTNER ARE YOU TALKING ABOUT 
PARTNERSHIP SPECIALISTS?
>> NOT THE 300,000.
THAT WOULD BE HARD TO DO.
>> WE KNOW IN 2018 WE DIDN'T 
HAVE PARTNERSHIP SPECIALISTS ON 
THE GROUND AND IT MAKES A 
DIFFERENCE.
WE THINK IF WE DON'T HAVE PEOPLE
IN THESE COMMUNITIES AND 
CARRYING THAT MESSAGE THERE IS 
GOING TO BE LESS AWARENESS OF 
THAT.
I DON'T KNOW IF THERE'S 
SOMETHING ELSE ANYONE ELSE WOULD
LIKE TO ADD.
YOU'RE RIGHT IT'S A HARD PROBLEM
BECAUSE WE'RE HITTING THEM WITH 
ADVERTISING AND WE'RE HITTING 
THEM WITH OTHER KINDS OF 
MOTIVATION.
I THINK WHAT YOU'RE ASKING IS DO
PARTNERSHIP SPECIALISTS WORK AND
HOW DO WE KNOW IT WORKS AND DOES
IT GET SOMEBODY TO ANSWER THE 
CENSUS QUESTION.
WE HAVE ACTUALLY IN PREVIOUS 
CENSUSS HAVE DONE RESEARCH -- 
CENSUS WE HAVE DONE RESEARCH IN 
PARTNERSHIP WITH PROGRAMS AND 
THE CONCLUSION WAS BROAD, YES, 
IT'S EFFECTIVE.
WE JUST CAN'T SAY HOW EFFECTIVE 
IT WAS.
IT'S HARD TO SAY.
AND TO THE SECOND WAY YOU 
PHRASED THAT, ARE SOME MORE 
EFFECTIVE THAN OTHERS?
CLEARLY THERE'S A DIFFERENCE IN 
RESULTS AMONG SPECIALISTS BUT IT
DEPENDS ON WHAT WE'RE ASKING 
THEM TO DO.
WE HAVE A COMMUNITY OF 
CAMBODIANS IN L.A. COUNTY AND 
IT'S A SMALL COMMUNITY.
THE SCOPE OF WHAT THAT 
PARTNERSHIP SPECIALISTS WAS 
ASSIGNED TO DO WAS NARROW.
IT'S RIGHT OUTSIDE OF LONG 
BEACH.
THEY ONLY DID A HANDFUL EVENTS 
WITH A SMALL HANDFUL GROUP OF 
PEOPLE BUT IF THEY DIDN'T DO 
ANYTHING WITH THOSE PEOPLE WE 
PROBABLY WOULDN'T HAVE COUNTIED 
THE CAMBODIAN COMMUNITY.
SO WAS THAT AN EFFECTIVE 
OUTREACH FROM A DOLLARS AND 
SENSE OUTREACH?
PROBABLY NOT.
BUT FROM A DATA QUALITY 
PERSPECTIVE IT WAS HUGE AND
INVALUABLE.
IT'S DIFFICULT TO ANSWER.
EVERYONE UNDERSTANDS GRASSROOTS 
AND ENGAGEMENT AND FACE TO FACE 
IS INVALUABLE FOR
COMMUNITY INDICATED THEY WOULD 
NOT RESPOND.
WE'RE NOT ONLY LOOKING AT WHERE 
THEY'RE ENGAGING BUT WHAT IS THE
RESULT OF THAT ENGAGEMENT.
IT'S ONE THING TO BE A PARTNER.
WE'RE ALSO TRIES TO ITEMIZE 
THROUGH THE C.R.M. TOOL AND THE 
RESULTS OF THAT PARTNERSHIP AND 
IN THE PAST WE TRIED TO ASSIGN A
DOLLAR VALUE TO CALCULATE WA WE
WE -- WHAT WE CALL VALUE-ADDED 
BUT DOLLARS AREN'T ALWAYS THE 
BEST MEASURE OF SUCCESS.A WE -- 
WHAT WE CALL VALUE-ADDED BUT 
DOLLARS AREN'T ALWAYS THE BEST 
MEASURE OF SUCCESS.WE -- 
WHAT WE CALL VALUE-ADDED BUT 
DOLLARS AREN'T ALWAYS THE BEST 
MEASURE OF SUCCESS.E -- 
WHAT WE CALL VALUE-ADDED BUT 
DOLLARS AREN'T ALWAYS THE BEST 
MEASURE OF SUCCESS. -- 
WHAT WE CALL VALUE-ADDED BUT 
DOLLARS AREN'T ALWAYS THE BEST 
MEASURE OF SUCCESS.-- 
WHAT WE CALL VALUE-ADDED BUT 
DOLLARS AREN'T ALWAYS THE BEST 
MEASURE OF SUCCESS. WHAT WE CALL
VALUE-ADDED BUT DOLLARS AREN'T 
ALWAYS THE BEST MEASURE OF 
SUCCESS. WHAT WE CALL 
VALUE-ADDED BUT DOLLARS AREN'T 
ALWAYS THE BEST MEASURE OF 
SUCCESS.WHAT WE CALL VALUE-ADDED
BUT DOLLARS AREN'T ALWAYS THE 
BEST MEASURE OF SUCCESS.
>> MY NAME IS CATHY PETIT.
I ORGANIZE A NETWORK OF 
COMMUNITY PARTNER THAT DO 
SIMILAR WORK SO I KNOW THIS IS A
VERY HARD JOB AND THEY HAVE 
OBVIOUSLY A LOT OF AUTONOMY AND 
IS IT BETTER TO GO TO THIS OR 
THAT MEETING.
I'M WONDERING, TWO THINGS, ONE, 
WHAT KIND OF TRAINING YOU'RE 
PROVIDING FOR THEM.
HOW DO YOU ONBOARD THEM OR ARE 
THEY GENERALLY PEOPLE WHO ARE 
DATA DISSEMINATION SPECIALISTS 
AND SHIFTING OVER AND ALREADY 
FAMILIAR AND WHAT KIND OF 
ONGOING PEER CONNECTIONS THEY 
HAVE.
THERE'S CAMBODIANS ALSO IN 
HOUSTON SO MAYBE THEY CAN HELP 
EACH OTHER.
AND I ALSO THINK IN THOSE 
EXAMPLES YOU SAID THEY COULD SET
THEIR OWN GOALS.
THAT'S A VERY SPECIAL QUESTION.
SO WHAT WAS THE UNDERCOUNT OF 
CAMBODIANS AND THE SELF-RESPONSE
SCORE AS TRACKED IN 2010 AND 
WHICH ONE IS IN 2010.
TO ENCOURAGE THEM TO THINK ABOUT
WHAT THEIR OWN MEASUREMENTS 
WOULD BE.
1500 IS A LOT BUT IT'S ALSO NOT 
SO MUCH THAT YOU WOULD INCREASE.
I'M WONDERING HOW TO SUPPORT 
THESE FOLKS AS THEY'RE DOING 
THIS REALLY DIFFICULT JOB.
I'M SURE 1500 DOESN'T SOUND LIKE
A LOT TO ME AND THEY HAVE A LOT 
OF TERRITORY TO COVER AND A LOT 
OF DIFFERENT GROUPS SO THERE YOU
GO.
>> THANK YOU, I APPRECIATE THE 
QUESTION.
SO IN TERMS OF THE TRAINING, 
THEY GET TRAINING FROM THE 
HEADQUARTERS PERSPECTIVE AND THE
CPEP PROGRAM IS ONE I OVERSEE.
WE HAVE A CPEP TEAM HERE IN 
HEADQUARTERS THAT DEVELOPS 
TRAINING AND WE'RE COMMUNICATING
THAT ACROSS THE SIX REGIONS.
THEY'RE ALSO CONNECTING WITH 
EACH OTHER.
WHAT I'M FINDING IS MANY OF 
THESE PEOPLE ARE PARTNERSHIP 
SPECIALIST COMING BACK TO THE 
CENSUS.
THIS IS THEIR MULTIPLE TURN AT 
DOING THIS AND THEY'RE VERY 
KNOWLEDGEABLE AND UNDERSTAND 
WHAT THE JOB BRINGS BUT ALL 
THROUGH THE PROCESS WE ARE 
GIVING THEM TRAINING AND 
PROVIDING TOOLS.
THEY ARE CONNECTING WITH EACH 
OTHER THROUGH THE SHIRT YOU'LL 
CONFERENCE CALLS AND THINGS OF 
THAT COMMUNICATION STAYS OPEN 
THROUGH THE CENSUS.
YOU ALSO ASKED ABOUT THEM 
SETTING THEIR OWN GOALS.
WE CERTAINLY PROVIDE THEM WITH 
OUR OBJECT ITCHES AND OUR GOALS 
-- OBJECTIVES AND OUR GOALS AND 
IT'S IN THE TRAINING AND 
UNDERSTANDING OF WHAT THOSE LOOK
LIKE.
AND THE FACT THAT AS WE TALKED 
ABOUT THE INTEGRATEDNESS OF THE 
NATIONAL AND COMMUNICATION PLAN
IKE.
AND THE FACT THAT AS WE TALKED 
ABOUT THE INTEGRATEDNESS OF THE 
NATIONAL AND COMMUNICATION PLAN 
AND SO WE'RE CONSTANTLY 
COMMUNICATING THE MESSAGE TO 
THEM.
I'M NOT SURE I'M GETTING TO 
THEIR POINT BUT AS FAR AS THE 
TRAINING WE CONTINUE TO DO THE 
COMMUNICATIONS ACROSS THE 
REGION.
WE'RE CONSTANTLY MEETING AND 
HAVING THE CONVERSATIONS AND 
TALKING ABOUT BEST PRACTICES AND
WHAT'S WORKING HERE IN THIS 
PARTICULAR COMMUNITY AND IF IT
WOULD WORK.
I'VE BEEN PRESSED YOU'RE USING A
GEOSPATIAL TOOL FOR YOUR 
ANALYSIS WITH MY BACKGROUND 
THANK YOU FOR DOING THAT.
THIS MAY SEEM CRAZY BUT IT'S AN 
ACRONYM WITH THE TOOL THE ROAM, 
THE ACRONYM IS KIND OF PASSIVE 
AND I WANT TO PUT OUT THAT MAYBE
A MORE ASSERTIVE ACRONYM, CALL 
IT ROAR, REACH OUT AND RECRUIT.
JUST A COMMENT.
IT'S A GOOD TOOL AND WHEN I 
THINK OF ROAM IT SEEMS LIKE IT'S
ABOUT DIRECTION.
>> THANK YOU FOR THE COMMENT.
>> THIS IS MARIO MARATZI.
THANK YOU FOR YOUR PRESENTATION.
IT DOVETAILS AND COMPLEMENTS 
WELL WITH THE PRESENTATION WE 
GOT YESTERDAY ON THE INTEGRATED 
PARTNERSHIPS AND COMMUNICATION 
OPERATION.
SO I THINK WHAT YOU'RE DOING IS 
IMMENSELY IMPORTANT.
I HAVE BEEN ON THE OTHER SIDE OF
THIS AS A PARTNER THAT SIGNS ON 
WHEN I WORKED AT A LOCAL 
ORGANIZATION.
I BELIEVE ALL CENSUSS ARE LOCAL.
SO WHAT YOU ARE DOING IS REALLY,
REALLY IMPORTANT.
AND SOMETHING FROM WASHINGTON, 
D.C. PERSPECTIVE WE CAN 
SOMETIMES FORGET.
ONE THING THAT'S DIFFERENT THIS 
TIME AROUND, THIS DECADE IS THE 
WAY PEOPLE GET INFORMATION HAS 
DRAMATICALLY CHANGED, 
INTENSIFIED THE FRAGMENTATION 
THROUGH WHICH THE CHANNELS OF 
PEOPLE GET INFORMATION AND WE 
ALL KNOW THE SOCIAL MEDIA 
REVOLUTION I'M REFERRING TO.
MAYBE I'M WRONG BUT I THINK I 
HEARD IN THE PREVIOUS 
PRESENTATION THAT THE BUREAU IS 
HIRING ONE COMPANY THAT WILL BE 
MANAGING THE SOCIAL MEDIA FOR 
THE 2020 CENSUS.
THAT STRUCK
ME AS PERHAPS ONE GOOD WAY OF 
THINKING ABOUT IT AT THE 
BEGINNING AND PERHAPS SOMETHING 
THAT THE CENSUS BUREAU SHOULD 
THINK MORE ABOUT.
AND I'M GOING TO TRY TO CONNECT 
THAT PRECISELY WITH THE LOCAL 
PARTNERSHIP PROGRAM YOU ARE
MENTIONING.
MY CONCERN IS BY HAVING ONE 
COMPANY AND AN ARMY OF LOCAL 
PARTNERSHIP SPECIALISTS, WHAT IS
THE ENGAGEMENT BETWEEN THE LOCAL
PARTNERSHIP SPECIALISTS AND THE 
COMPANY WORK THE SOCIAL MEDIA?
MY CONCERN IS THAT THIS MAY BE A
MISSED OPPORTUNITY TO USE THE 
LOCAL KNOWLEDGE OF PARTNERSHIP 
SPECIALISTS TO BE MORE EFFECTIVE
WITH THE MESSAGING AT THE LOCAL 
LEVEL.
THERE IS NOT A LOT OF 
INTERACTION BETWEEN THE ARMY OF 
LOCAL PARTNERSHIP SPECIALISTS 
AND THE LOCAL MEDIA STRATEGY 
THAT MAY BE A HITCHED 
OPPORTUNITY.
WHAT'S MORE OF A CONCERN AND I 
HAVE BEEN SPEAKING TO SEVERAL 
COMMITTEE MEMBERS I GET THE 
SENSE SEVERAL ARE ALSO CONCERNED
IS THIS MAY OPEN UP THE 2020 
CENSUS TO THE LOCAL COMMUNITY 
CRISES OVER SOCIAL MEDIA FOR 
WHICH THE BUREAU WON'T BE ABLE 
TO RESPOND QUICKLY BECAUSE IT'S 
NOT TAKING ADVANTAGE OF ITS ARMY
OF LOCAL PARTNERSHIP 
SPECIALISTS.
IT GOES BACK TO THE RELATIONSHIP
BETWEEN THE LOCAL PARTNERSHIP 
SPECIALISTS AN SOCIAL MEDIA 
STRATEGY.
>> THANK YOU, MARIA.
>> GOOD MORNING, MARIO.
FOR SOCIAL MEDIA, WELL, WE HAVE 
A COMBINATION OF EFFORTS HERE.
WE HAVE A SOCIAL MEDIA STAFF AT 
THE CENSUS BUREAU HEADQUARTER 
COORDINATES CLOSELY WITH THE
CAMPAIGN SO THEY ARE VERY WELL 
SUPPORTED BY OUR TEAM AND 
SUBCONTRACTORS OR MULTIPLE
PARTNER IT IS NOT ONLY A 
SUBCONTRACTOR TRYING TO COME 
WITH THE COMMUNICATION
EFFORTS AND PARTICULARLY SOCIAL 
MEDIA.
AND THE VENDOR WE HAVE SELECTED 
FOR SOCIAL MEDIA
MONITORING AND WE HAVE A 
COMPLEMENTARY SERVICE YNR IS 
USING TO SUPPORT THE SOCIAL 
MEDIA EFFORTS AT THE 
HEADQUARTERS AND TO THE YNR 
POINT OF VIEW.
HOWEVER, SOMETHING WE'RE TRYING 
TO BE CAREFUL OF THIS TIME 
AROUND IS INDIVIDUAL SOCIAL 
MEDIA ACCOUNTS BY REGIONAL 
OFFICES AND BY PARTNERSHIP 
SPECIALISTS.
LAST
CENSUS 10 YEARS AGO WHEN SOCIAL 
MEDIA WAS KIND OF EXPLODING WE 
HAD SEVERAL FACEBOOK ACCOUNTS 
AND IT WAS INEFFECTIVE.
WE HAD DIFFERENT MESSAGES.
WE HAVE PEOPLE FOLLOWING ONE AND
WE'RE TRYING TO HAVE ONE VOICE 
THIS TIME.
AND WITH THE IDEA OF USING OUR 
MULTIPLE COMPONENT INCLUDING THE
PARTNERSHIP SPECIALISTS TO FEED 
THE MAIN ACCOUNT AND MAKE USE OF
THE MAIN ACCOUNT.
FOR EXAMPLE, TODAY WITH FACEBOOK
WE CAN USE THE HASH TAGS AND USE
EVENTS AND THEY DON'T 
NECESSARILY NEED THE INDIVIDUAL 
ACCOUNT THEY CAN USE THE MAIN 
ACCOUNT TO SUPPORT WHATEVER 
EFFORT THEY'RE DOG LOCALLY AND 
WE CAN TARGET EFFORTS AND THAT'S
WHAT WE CAN DO BUT OUR 
RECOMMENDATION IS NOT HAVING 
INDIVIDUAL ACCOUNTS OR MULTIPLE 
EFFORTS BECAUSE IT CAN GET OUT 
OF CONTROL AND AT THE END OF THE
DAY IT'S NOT EFFECTIVE.
YOU END UP HAVING 3,000 OR 4,000
ACCOUNTS BETWEEN HALF COURTS, 
SPECIALISTS AN PARTNERS WE LOSE 
THE IDEA OF THE ONE VOICE AND WE
NEED TO KEEP
IT ONE VOICE.
>> THANK YOU, I THINK IT CLEARLY
EXPLAINED MY QUESTION.
I WOULD SUGGEST YOUR ABSOLUTELY 
RIGHT.
IT MAY GET A LITTLE BIT
DISORGANIZED IF EVERY SPECIALIST
STARTED USING THEIR OWN ACCOUNT 
IT MAY NOT BE WISE TO DO.
>> AND I UNDERSTAND WHEN THEY DO
OUTREACH EFFORT THEY COMMUNICATE
WITH FOLKS THROUGH THEIR 
PERSONAL ACCOUNTS.
I CANNOT PREVENT
THAT.
I MYSELF HAVE USED MY CENSUS 
BUREAU ADDRESS VAND PEOPLE 
CONTACTING ME ON MY PERSONAL 
ACCOUNTS BECAUSE KNOW WHO I AM 
AND I UNDERSTAND THAT'S A 
NATURAL COMMUNICATIONS EFFORTS 
BUT FROM A MESSAGING PERSPECTIVE
WE'RE TRYING TO KEEP ONE VOICE 
THROUGH THE SOCIAL MEDIA 
PLATFORM.
>> I UNDERSTAND IT'S IMPORTANT 
TO COORDINATE THE MESSAGE.
BUT I ALSO THINK THERE'S 
SOMETHING ELSE I WANT TO PUSH 
BACK ON.
THE CONCEPT OF ONE VOICE, IT'S 
VERY ALLURING.
IT MAKES THINGS SIMPLE BUT THE 
CENSUS IS A LOCAL OPERATION AS 
WELL.
PERHAPS FORCING ONE VOICE MAY 
NOT BE AS EFFECTIVE FROM A 
MESSAGING POINT OF VIEW.
>> THE IDEA OF ONE VOICE IS 
PARTICULARLY IMPORTANT WHEN YOU 
MAKE AUTHORITATIVE STATEMENTS ON
FACTS AND SOMETHING WE DISCUSSED
YESTERDAY AND WE'LL DISCUSS 
MORE.
SORRY, THIS IS LEON THE 
ASSOCIATE DIRECTOR OF 
COMMUNICATIONS, GOING INTO THE 
CENSUS IS HOW WE'LL COMBAT 
MISINFORMATION AND 
DISINFORMATION AND MAKE SURE 
PEOPLE UNDERSTAND THE BASIC 
FACTS OF HOW TO RESPONSE AND 
WHAT THEY GET FROM THE CENSUS 
BUREAU AND WHAT IS NOT FROM A 
CENSUS BUREAU AND WHAT'S FROM A 
BAD ACTOR.
THERE'S AN ASPECT OF THIS THAT'S
FOUNDATIONAL IN OUR 
COMMUNICATION STRATEGY WHEN WE 
LOOK AT OFFICIAL COUNTS AND 
VOICES.
I'LL LET JAMIE AND GAIL CHIME IN
AND ONE THING THAT'S IMPORTANT 
HOW PARTNERSHIPS ARE RECRUITED 
AND BROUGHT IN IS WE EXPECT A 
LOT OF TAILORED MESSAGING TO 
EMERGE FROM OUR PARTNERSHIP 
NETWORKS TO SMALL
COMMUNITIES.
I FULLY EXPECT YOU'LL SEE 
DIFFERENT CREATIVE SOCIAL 
CAMPAIGNS AND TARGETED MESSAGING
EMERGE FROM OUTSIDE THE CENSUS 
BUREAU AS A PART OF THE LARGER 
CAMPAIGN THAT WE'RE SUPPORTING 
THROUGH OUR NATIONAL PARTNERSHIP
EFFORTS AND INTEGRATED 
PARTNERSHIP EXPERTS TOO AND 
THERE'S A MIDDLE GROUND WHEN THE
POINTS YOU'RE RAISING AND MARIA 
IS RAISING WHERE ANY NATIONAL 
CAMPAIGN HAS TO LIVE AND IT IS 
EVERYTHING IS A NATIONAL 
STRATEGY IMPLEMENTED LOCALLY
ABOUT THIS CENSUS.
>> THANK YOU, SO DO LOCAL 
PARTNERSHIP SPECIALISTS HAVE A 
WAY, IF LOCAL PARTNER OR LOCAL 
PARTNER SPECIALISTS EMERGE 
SOMETHING EMERGING IN THE SOCIAL
MEDIA, WILL THE CENSUS BUREAU 
PROVIDE A WAY TO TAKE UP TO 
NATIONAL LEVELS WEEKLY?
>> ABSOLUTELY.
>> THIS IS JAMIE
CHRISTY.
>> WE LISTED A BLOCK OF PEOPLE 
ALL DOING THE SAME THING.
EMBEDDED IN THE NUMBERS ARE 
PEOPLE WITH CERTAIN FOCUSES ON
MEDIA FOR EXAMPLE.
A IS  -- TASK IS TO MONITOR 
LOCALLY AND IT'S NOT JUST 
REACTING BUT IT'S BEING 
PROACTIVE ON THAT.
THEY COMMUNICATION WITH THE 
CELLS AROUND AND THE PARTNERSHIP
TEAM AROUND THEM AROUND EVENTS 
AND ACTIVITIES GOING ON.
WE'LL ALSO HAVE PARTNERSHIP 
SPECIALISTS DEVOTED TO THE 
NATIONAL PARTNERSHIP INITIATIVE.
IF A MAJOR CORPORATION WANTS TO 
DO THAT ON A NATIONAL LEVEL 
WE'LL DO IT ON THE GROUND AND 
WE'LL HAVE PEOPLE DEPLOYED ON 
THE GROUND.
I THINK THERE'S
SYNERGY WITH THE LOCAL MESSAGE 
AND THE LOCAL TAILORING WITH THE
CENSUS IS WHAT MAKES IT SO COOL.
I REMEMBER THE GIANT T-SHIRTS 
THAT CAME OUT IN THE 2010 
CENSUS, SKID ROW COUNTS IN
LOS ANGELES.
YOU SAW THEM IN L.A. 
A LOCAL COMMUNITY GROUP SAID 
THEY HAD TO DO A GOOD JOB AND 
THEY PASSED OUT THE T-SHIRTS AND
IT'S AWESOME TO SEE THAT.
IT'S SOMETHING WE WOULD HAVE 
NEVER COME UP WITH BUT THEY DID 
AND THAT'S COOL AND THAT IS 
REPEATED DOZENS OF TIMES.
>> JACK.
>> JACK LEVIS.
THIS IS PARTLY TO DALE AND 
PARTLY TO AL AND I'M AN 
OPERATIONS PERSON.
YOU'RE ALL PROFESSIONALS, 
OBVIOUSLY, YOU KNOW WHAT YOU'RE 
DOING AND HAVE LOTS OF HISTORY 
AND SO YOU HAVE PATTERNS OF HOW 
THE CENSUS WILL GO JUST LIKE MY 
BUSINESS, WE HAVE PATTERNS OF 
HOW TO EXECUTE.
BUT THERE'S CHANGES THIS CENSUS.
YOU HAVE NEW TECHNOLOGY WITH 
MOJO AND YOU HAVE INTERNET 
RESPONSE AND WE HEARD THE CBAM 
STUFF WHICH IS SOMEWHAT 
SOBERING, THE RISK IS IF THE 
PATTERN CHANGES.
SIMILAR TO MY BUSINESS, THAT'S 
WHY I'M REACTING E-COMMERCE 
CHANGE THE PATTERN OF DELIVERY 
AT CHRISTMAS AND WHEN A PATTERN 
CHANGES, DETECTING THE CHANGE 
AND REACTING TO IT IS IMPORTANT 
TO BECOMING
SUCCESSFUL.
WHAT ARE YOU DOING TO DETECT THE
PATTERN CHANGES AND I'M GUESSING
NERFU IS SHOWING URN YOU DIDN'T 
EXPECT AND HOW DO YOUURN YOU 
DIDN'T EXPECT AND HOW DO YOUPURN
YOU DIDN'T EXPECT AND HOW DO 
YOURN YOU DIDN'T EXPECT AND HOW 
DO YOUN YOU DIDN'T EXPECT AND 
HOW DO YOU YOU DIDN'T EXPECT AND
HOW DO YOU REACT.
YOU ARE LOOKING FOR A CHALLENGE 
AND YOU'RE SEEING NERFU IN 
HIGHER AREAS THAN EXPECTED AND 
WILL YOU DETECT THAT AND WILL 
YOU USE PARTNERS TO HELP YOU 
REDUCE THAT.
>> IF WE WAIT UNTIL THAT WE 
WAITED TOO LONG TO DETECT A 
CHANGE.
WE START DETECTING A CHANGE IF 
WE SEE LOWER SELF-RESPONSE.
SO WE'RE MONITORING 
SELF-RESPONSE FROM THE 
BEGINNING.
AS WE LOOK AT THE INTERNET 
SELF-RESPONSE IN THE EARLY DAYS 
WHEN WE STARTED INVITING PEOPLE 
IN MARCH, THE FIRST TWO WEEKS 
FOR THE TYPES OF RESPONSE GIVE 
US INDICATIONS IF WE'RE SEEING 
CHANGE IN TIME.
WE'RE TIGHTLY SYNCED WITH 
COMMUNICATION AND THEIR ABILITY 
TO USE DIGITAL MEDIA TODAY TO 
MOVE IT AND FOCUS IT WHERE WE 
SEE PATTERNS OF RESPONSE THAT 
ARE TOO LOW AS WE'RE IN THE 
EARLY STAGES OF THE OPERATION.
IF WE START TO SEE THAT IT'S 
GOING CAUSE US TO HAVE A BIGGER 
CUT OVER TO NON-RESPONSE 
FOLLOW-UP, THAN THE REGIONS ARE 
AWARE OF THAT.
IT'S A LITTLE TOO LATE TO START 
DOING HIRING BUT THEY START TO 
BE AWARE IF THEY'LL GET A BIGGER
WORK LOAD AND PREPARE
AND A CALM STANDPOINT IS WHEN WE
RAMP UP THE MESSAGING WHILE 
WE'RE STILL OUT WITH INTERNET 
SELF-RESPONSE.
ONE REASON WE ARE LEAVING THE 
INTERNET OPEN TO THE END OF THE 
OPERATION IS TO GIVE PEOPLE A 
CHANCE TO CONTINUE TO RESPOND 
THROUGHOUT THE RESPOND ON THE 
INTERNET.
WE CAN DO ACTIVITIES WHERE WE'LL
SAY, OUR COMMUNITY ORGANIZATIONS
GOES IN WITH iPADS AND RALLIES 
PEOPLE AROUND RESPONDING DUE TO 
SELF-RESPONSE TOOLS BUT WE'RE 
MONITORING THAT FROM DAY ONE.
>> PERFECT ANSWER.
TRUST ME THE CHANGE IN PATTERN 
CAN GET YOU ON YOUR HEELS.
PERFECT ANSWER, THANK YOU.
>> I JUST HAD A QUICK QUESTION 
AS TO WHETHER THERE'S ANY 
OUTREACH TO GROUPS THAT CAN BE 
OVER COUNTED TO PREVENT THAT 
FROM HAPPENING.
>> SO DO WE HAVE A SPECIFIC 
EFFORT TO ADDRESS THE 
OVER COUNT.
THE CLOSEST IS AN OUTREACH WITH 
UNIVERSITIES.
AND I MEAN STUDENTS GOING 
BETWEEN TO TRY TO EDUCATE THEM 
ON HOW TO BE COUNTED AND WHERE 
TO BE COUNTED.
SO WE DO AN EARLY ACTIVITY TO 
CAPTURE STUDENTS BEFORE THEY GO 
TO SPRING
BREAK.
I DON'T KNOW QUE FOCUS ON THE
OVERCOUNT.
>> I DON'T KNOW WE PREPARE BUT 
THE MESSAGING SHOULD BE DON'T 
PUT THESE PEOPLE ON YOUR CENSUS 
FORM AS YOU DO ON YOUR TAX FORM.
THAT'S A BIG CONCERN AND THE 
COLLEGE STUDENTS ARE A BIG
CONCERN.
THE REAL ANSWER IS COMING.
>> I DON'T KNOW IF IT'S THE REAL
ANSWER BUT WE'RE AWARE OF THE 
PROBLEM.
IT'S SOMETHING THAT WE HAVE 
WORKED HARD TO ADDRESS 
OPERATIONALLY.
THROUGH THE RESIDENTS CRITERIA 
WE'RE DOING THINGS IN 
COMMUNICATION TO GET AS CLEAR AS
WE CAN AND WE HELP IDENTIFY 
PEOPLE THAT MAY BE IN TWO PLACES
OR COUNTED IN TWO PLACES.
THE PROBLEM EXISTS NOT JUST WITH
COLLEGE STUDENTS BUT PEOPLE WHO 
HAVE TWO VACATION HOMES.
IN THE WINTERTIME THE FORM WILL 
GO OR THE MAILING PACKAGE WILL 
GO TO EVERY HOUSEHOLD.
WE DO TRY TO REACH OUT TO PEOPLE
TO HELP THEM UNDERSTAND IF 
THEY'RE IN TRANSIT FROM VERMONT 
TO FLORIDA DURING THE
SPRING, THEY NEED TO REACH OUT 
TO ORGANIZATIONS TO HELP US GET 
THE MESSAGE I THINK THAT'S AN 
INTERESTING IDEA WE HADN'T 
THOUGHT OF BEFORE AND IT'S 
SOMETHING WE LOOK AT CLOSELY AND
IN INCREASING SOPHISTICATION 
FROM AN OPERATIONAL PERSPECTIVE 
AND QUESTION OR
CONTENT PERSPECTIVE.
AT 
>> AT THE BACK END, THERE'S 
EFFORTS TO MAKE SURE WE DON'T 
DUPLICATE THE RESPONSE.
THERE'S SYSTEM
THINGS TO PREVENT MY RESPONSE 
AND I WIFE RESPOND FROM THE SAME
ADDRESS.
WE HAVE DUPLICATION PROCESSES 
WITHIN THE SYSTEM BUILT INTO THE
MEASURE TO TRY TO REDUCE 
OVERCOUNT RESULT FROM THAT.
>> AND WE'RE BETTER AT THAT THAN
EVER BEFORE WITH OUR USE OF 
ADMINISTRATIVE RECORDS, FOR 
EXAMPLE, AND THE FACT WE CAN DO 
MORE AND HAVE STRONGER ABILITY 
TO IDENTIFY DUPLICATION WHICH IS
IMPORTANT WITH FRAUD AS WELL AND
OUR ABILITY TO IDENTIFY WHERE 
MULTIPLE RESPONSE
COMING IN.
>> LEON, THE ASSOCIATE DIRECTOR 
OF COMMUNICATION.
I ALSO THINK IT'S NOT CULLED OUT
IN THAT WAY EXACT WAY BUT IT'S 
AN INTERESTING LOOK AT THE 
EDUCATION COMPONENT OF OUR 
OVERALL COMMUNICATION CAMPAIGN 
INCLUDING EVEN IN PAID MEDIA.
WHEN  EVEN WHEN I THINK ABOUT 
COMPLEX HOUSEHOLDS AND WHO IS 
SUPPOSED TO BE COUNTED WHERE IS 
HAPPENING ALL THE TIME.
I LIKE TO BRING UP THE EXAMPLE 
OF WHEN MY WIFE WAS IN LAW 
SCHOOL IN 2010, IT WAS COMPLEX 
AS TO WHETHER MAKING SURE SHE'S 
COUNTIED IN THE -- COUNTED IN 
THE APARTMENT SHE WAS IN OR 
WHERE I WAS.
SOMETHING I KEEP IN MIND WHEN I 
THINK OF HOW WE'RE COMMUNICATING
TO
PEOPLE.SOMETHING I KEEP IN MIND 
WHEN I THINK OF HOW WE'RE 
COMMUNICATING TO PEOPLE.
>> CATHY.
>> I WOULD CAUTION AGAINST 
COMPLETE RELIANCE ON THE A.C.S.
DATA WHICH FIVE YEARS AND LAGGED
AND HAS VERY WIDE MARGINS
OF ERROR.
I WOULD ENCOURAGE THEM TO LOOK 
AND LOOK AT LOCAL DATA FROM 
THEIR CHIEF DATA OFFICERS OR 
CITIES OR OUR BALTIMORE PARTNER 
IS LOOKING AT THE BURSTS IN THE 
LAST FIVE YEARS IN BALTIMORE AND
LOOKING WHERE FOSTER
KIDS ARE.
KNOWING HOW SQUISHY THE DATA IS 
AT THE TRACK LEVEL AND I 
WOULDN'T WANT THEM TO MISS A NEW
CROP OF PEOPLE MOVING TO 
SUBURBAN JURISDICTION BECAUSE 
THEY'RE GETTING GENTRIFIED OUT 
OF SOME PLACE IN L.A.
OR WHATEVER.
>> THANK YOU FOR THAT AND THAT'S
A VERY GOOD POINT AND WHY ONE OF
THE REASONS WHY OUR PARTNER IN 
THESE COMMUNITIES ARE SO 
IMPORTANT.
THEY'RE DEALING WITH THE 
INDIVIDUALS AND THE MOVEMENT OF 
INDIVIDUALS.
THANK YOU.
>> I HAVE A QUICK QUESTION AND 
THEN A COMMENT.
YOU MENTIONED, I THINK YOU 
MENTIONED A GOAL OF 300,000 
PARTNERS BY MARCH 1.
HOW DO YOU KNOW YOU HAVE
A PARTNER?
WE ARE CAPTURING THAT 
INFORMATION IN OUR
C.R.M., CUSTOMER RESPONSE 
MANAGEMENT SYSTEM AND IT'S WHEN 
A PARTNER PLEDGE TO HELP US WITH
THE CENSUS.
>> THANK YOU,
THAT'S GREAT.
>> DO THEY HAVE TO USE THE TERM?
>> NO.
>> IT SOUNDED 1960s TO ME.
>> NO.
IT COULD BE ANY EFFORT.
>> CAN I MAKE A COMMENT.
A PARTNER SOMETIMES IS SOMEONE 
AS SIMPLE AS A HAIR DRESSER SHOP
OR BEARD SHOP THAT POSTS SIGNS
AND THEIR MAKING PEOPLE AWARE OF
THE CENSUS IN THEIR COMMUNITY.
THOSE ACTIVITIES AT THE LOCAL 
LEVEL MAKE A LOT OF DIFFERENCE.
A CHURCH ACTIVITY IS A PARTNER 
SOMETIMES WHILE THE PASTOR 
DISCUSSES THE VOICE AND WHILE 
THE RABBI IS A TRUSTED VOICE 
THEY CAN TALK ABOUT THIS COUNTS 
FOR US AND OUR COMMUNITY AND BE 
AWARE OF IT.
HAVE YOU A RANGE OF THE WAYS 
PARTNER PARTICIPATE AND HELP US.
>> THAT'S SO GOOD.
I'M SO GLAD TO HEAR THAT, THANK 
YOU.
THAT MAKES ME FEEL BETTER.
THAT'S WHAT I WAS SEEING AS
WELL.
AND 
>> IN NEW ORLEANS FOLKS HAVE 
ASKED IF THEY DECIDE TO PARTNER 
HOW THEY WOULD MEASURE THEIR 
EFFECTIVENESS.
WE WERE KIND OF PONDERING THIS 
AND WE KNOW YOU ALL WILL BE 
PUBLISHING THEM WHICH IS GREAT.
I KNOW DIFFERENT PLACES ARE 
DIFFERENT.
AND IN NEW ORLEANS BECAUSE NOW 
ALL OF OUR SCHOOLS ARE CHARTERED
AND EVERYTHING IS DIFFUSED.
A SCHOOL DOESN'T SERVE A CERTAIN
CENSUS TRACK.
IT SERVES THE WHOLE CITY AND 
LOTS OF PEOPLE GO ALL OVER THE 
CITY TO GET ANYTHING DONE.
IT'S HARD FOR ONE ORGANIZATION 
TO TRACK THEIR EFFECTIVENESS BY 
CENSUS TRACK.
WE ALL TALKED A LITTLE BIT ABOUT
THE POSSIBILITY OF 2030 BEING A 
CENSUS OF PEOPLE INSTEAD OF 
HOUSEHOLDS.
AND THE FACT THAT EVEN THE 
DEFINITION OF A HOUSEHOLD IS 
GETTING MORE AND MORE AND
MORE DIFFICULT.
I THOUGHT IN AN IDEAL WORLD IF 
WE WERE TRACKING PEOPLE YOU'D BE
TRACKING BY PEOPLE AND THE 
ORGANIZATIONS AND THE 
BARBERSHOPS AND WHATNOT WOULD BE
ABLE TO MEASURE THEIR 
EFFECTIVENESS.
I THOUGHT I'D MENTION THAT AS 
FOOD FOR FUTURE THOUGHT IN TERMS
OF BECAUSE I THINK THE QUESTION 
OF HOW TO MEASURE THE 
EFFECTIVENESS OF THE PARTNERSHIP
IS IMPORTANT.
THE CENSUS WANTS TO MEASURE ITS 
EFFECTIVENESS IN ALL WAYS AND 
THERE MAY BE MORE POSSIBILITIES 
IN THE FUTURE IF RESPONSE IS NOT
MEASURED.
SO TIDE HOUSEHOLDS IN A -- TIED 
TO HOUSEHOLDS
IN A GEOGRAPHIC FASHION.
>> BASED ON THE MEASUREMENT, 
EMPLOYEES, ARE THEY INCENTIVIZED
ON SOME MEASURE?
>> THEY ARE EVALUATED ON THEIR 
PERFORMANCE BUT THERE'S NO 
DIRECT INCENTIVE TO DO MORE OR 
LESS.
.
>> WE ACTUALLY HAVE LOOKED AT 
DOING SOME DIFFERENT KINDS OF 
INCENTIVES IN THE PAST THE 
CHALLENGE GOES BACK TO TRYING TO
FIND A CONSISTENT WAY OF DOING
ININCENTIVES LIKE AL MENTIONED 
PATH FLYER UP IN A -- PUTTING A
FLYER UP IN A BARBERSHOP AND YOU
GET RECRUITS, IT GOES BACK TO 
WHAT YOU'RE ASKING THEM TO DO 
AND ARE THEY DOING IT.
THAT'S GENERALLY HOW WE MEASURE 
HOW WELL THEY'RE DOING WHAT WE 
ASK THEM TO DO.
AND THAT'S GENERALLY A JUDGMENT 
LIKE MOST OF US ARE EVALUATED IN
TERMS OF
OUR PERFORMANCE.
>> I THINK WE'RE READY FOR THE 
NEXT SESSION.
>> JONATHAN 
ROTHBAUM AND EDWARD BERCHICK 
WILL DISCUSS THE CURRENT 
POPULATION SURVEY ANNUAL SOCIAL 
AND ECONOMIC
SUPPLEMENT.
JEFF LOWER.
>> WE'LL TALK ABOUT THE REDESIGN
WE'VE BEEN WORKING ON FOR THE 
LAST FEW YEARS.
SO JUST TO GIVE YOU A SENSE OF 
WHAT WE'RE TALKING ABOUT I, I 
WANT TO SHOW THE INCOME AREA AND
WE'LL TALK ABOUT HEALTH 
INSURANCE IN 2014 WE REDESIGNED 
THE QUESTIONNAIRE SO THIS IS 
INCOME YEAR 2013.
CAN SEE FOR EXAMPLE IN OUR 
HISTORICAL SERIES THERE'S A
BREAK IN SERIES WHERE WE WERE 
USING THE NEW QUESTIONS AND OLD 
PROCESSING SYSTEM.
IN THE INTERIM WE'VE BEEN 
WORKING ON THE DATA PROCESSING 
SYSTEM TO GET FULL VALUE FROM 
THE DATA WE'VE BEEN COLLECTING 
AND FROM 2018
INCOME YEAR FORWARD IT GOES INTO
OUR ESTIMATES FOR INCOME POVERTY
AND HEALTH INSURANCE.
AND THEN WE REPROCESSED BACK AND
WE HAVE ONE WHERE WE RELEASED 
THE PUBLIC USE FILE AND IN THE 
NEXT FEW WEEKS WE'LL PUT A FILE 
FOR INSURANCE INCOME AND THOUGH 
THERE'S AN EVERY LAP AND THE 
INCOME COVERS THE OFFICIAL 
ESTIMATES WE PUT OUT.
THAT'S WHAT WE'RE TALKING ABOUT 
HERE.
AND SO NOW TO GO THROUGH MORE 
BACKGROUND OF THAT AND TALK 
ABOUT THE SURVEY CHANGES 
THEMSELVES ON THE INCOME SIDE 
WITH HEALTH INSURANCE AND THE 
PROCESSING CHANGES WE'RE MAKING.
A BACKGROUND IT'S THE LONGEST 
RUNNING SURVEY CONDUCTED BY THE 
CENSUS BUREAU.
IT'S THE SOURCE OF OUR NATIONAL 
POVERTY STATISTICS AND LOOK AT 
MEDIAN HOUSEHOLD INCOME AND THE 
UNINSURED RATE.
THERE'S BEEN GROWING EVIDENCE 
OVER MISCLASSIFICATION ON 
REPORTING OF INCOME AND CONCERNS
OF OVER ESTIMATES OF THE INSURED
RATE AND WHY IT WAS
IMPLEMENTED.
AND IN 2014 WE HAD A SPLIT PANEL
WHERE THERE WERE TWO SETS OF 
RESPOND ENTS RANDOMLY SELECTED 
TO GIVE AN OLD AND NEW 
QUESTIONNAIRE AND OLD 
RESPONDENTS GOT NEW 
QUESTIONNAIRE AND THAT WAS PUT 
INTO PRODUCTION IN 2015 AND 
WE'VE BEEN PROCESSING THE DATA 
WITH THE PROCESSING SYSTEM WHILE
WE'VE BEEN CATCHING UP WITH THE 
HE HAD ITS AND NOW FROM 2019 
FORWARD WE'LL BE USING UPDATED 
PROCESSES WE'VE BEEN WORKING ON 
AND WHY DID WE DO THE REDESIGN?
IMPROVING THE DATA QUALITY.
A BIG FOCUS OR INCOME WAS THE 
CHANGING NATURAL OF RETIREMENT.
WORLD'S BEEN CHANGE FROM THE 
LAST 40, 50 YEAR FROM DEFINED 
BENEFIT PENSION TO 401(k)s AND 
NOW THAT'S BEING REFLECTED MORE 
AND MORE IN THE INCOME OF 
RETIREE.
WE NEEDED TO REDESIGN THAT TO 
BETTER CAPTURE THAT INCOME AND 
REFLECT THE CHANGING LANDSCAPE 
FOR HEALTH INSURANCE.
WHAT DID WE DO?
ONE OF THE THINGS WE'RE 
TARGETING IS NON-RESPONSES GOING
UP.
IF SOMEONE IS UNWILLING TO GIVE 
US THE RESPONSE OF HOW MANY 
DOLLARS THEY HAVE IN EARNINGS, 
WE IS THEM IS IT $0 TO $50,000.
WE HAVE MORE DETAILS TO OUR 
REQUIREMENT INTEREST QUESTIONS 
AND CHANGES TO HOW PEOPLE REPORT
DISABILITY AND ELIMINATE 
CONFUSION WE WERE SEEING AND 
VARIOUS OTHER CHANGES.
WHEN WE ANALYZE THE DATA WE SAW 
3.2% HIGHER MEDIAN HOUSEHOLD 
INCOME.
THIS IS THE DIFFERENCE BETWEEN 
THE TWO QUESTIONNAIRES OVER THE 
TWO PERIODS.
WE SAW A DIFFERENCE BUT NOT 
STATISTICALLY SIGNIFICANT IN 
POVERTY.
WHEN WE PROCESS THE OLD 
QUESTIONS AND THE NEW QUESTIONS 
AND BY INCOME TYPE YOU SEE 4% 
OVERALL AND YOU SEE MORE INCOME 
IN THE CATEGORIES WE'RE 
TARGETING AND MORE INCOME IN THE
CATEGORIES WE WERE SPECIFICALLY
ASKING.
TWO SETS OF RESPONDENTS OVER
THE SAME PERIOD.
WE'VE BEEN LOOKING AT THE DATA.
WE'RE USING RANGING IN OUR 
AMPUTATION IF YOU SAID YOU WERE 
IN $0 TO $50,000 WE'LL LOOK AT 
THE RANGE.
WE OVERHAULED HOW WE VIEWED 
OTHER INCOME AND WE
HAD VARIOUS OTHERS AS WE MADE 
VARIOUS OTHER ADVANCES.
THE MOST IMPORTANT OF WHICH 
WHICH YOU'LL SEE LATER IS THE 
TOP CODE FOR A LOT OF INCOMES 
WERE FIXED AND
NOMINAL TERMS.
WE THEM IN THE  -- INCREASED OUR
DATA AND WE'LL REVISIT THEM MORE
FREQUENTLY SO THERE WON'T BE A 
DECLINE IN THE TOP CODE.
TO GIVE YOU A SENSE FOR RANKS, 
ABOUT 20% OF RESPONDENTS ARE 
ITEM NON-RESPONDENTS TO 
EARNINGS.
WHEN YOU GET TO HOW MUCH DID YOU
EARN, THEY'LL SAY I DON'T KNOW 
OR UNWILLING TO RESPOND AND 75% 
OF THOSE PEOPLE GAVE ACE RANGE  
-- US A RANGE TO USE AND A LOT 
OF PEOPLE WERE WILLING TO GIVE 
US THAT DATA SO THAT'S A BIG 
IMPROVEMENT AND ABOUT HALF THE 
ITEMS HAVE A RANGE ATTACHED TO 
THEM SO THIS IS GIVING US A LOT 
MORE INFORMATION WITH WHICH TO 
CAN DO BETTER ESTIMATES FOR 
INCOME.
FOR ALLOCATIONS FLAGS FOR DATA 
USERS, THIS IS SOMETHING I'VE 
SEEN ANECDOTALLY A LOT.
THERE WERE TWO FLAGS DATA USERS 
HAD TO CHECK ONE IS THE 
AMPUTATION FLAG FOR THE ITEM AND
THE OTHER WAS A CRYPTICALLY 
NAMED VARIABLE.
THEY DIDN'T RESPOND TO ENOUGH OF
THE INCOME PORTION FOR THE DATA 
TO BE USED IT'S A WHOLE 
SUPPLEMENT SO ALL THE DATA ITEMS
ARE IMPUTED.
AND WE CHANGED IT SO IF THERE'S 
ONE CODE YOU HAVE TO CHECK AND 
THAT INFORMATION OF HOW IT WAS 
IMPUTED IS THERE.
AND IT ALSO INCLUDES INFORMATION
ON THE QUALITY AND WHETHER A 
RANGE WAS USED IN THAT 
ALLOCATION.
HAVE YOU MORE INFORMATION IN HOW
MUCH TO TRUST A
PARTICULAR ALLOCATION.
WE DON'T HAVE A LOT OF TIME TO 
GO THROUGH ALL THE CHANGES BUT 
THAT'S A QUICK LOOK AT THEM.
I WANT TO SHOW YOU THE RESULTS 
NOW COMPARING THE MORE RECENT 
YEARS WITH THE NEW QUESTIONS, 
PROCESSED TWO DIFFERENT WAYS.
THIS IS THE PERSON LEVEL AND WE 
SEE 1.4% MORE DOLLARS FOR ONE 
PERSON AND FOR SOME PROGRAMS YOU
SEE LESS INCOME AND POTENTIALLY 
MORE OVERALL.
THE BIG CHANGES FOR THOSE ARE 
HOW WE DO ALLOCATIONS AN USING 
THE RANGE RESPONDENTS REPORTED, 
NON-RESPONDENTS REPORTED.
THOSE ARE THE CHANGES THERE.
FOR INTEREST IN DIVIDES A BIG 
CHANGE IN THE -- DIVIDENDS IN 
THE TOTAL THERE'S A CHANGE IN 
TOP INCREASE AND THEY HAVE THE 
SAME RANGE IN ALLOCATION 
CHANGES.
IN TERMS OF HOUSEHOLD INCOME AT 
THE MEDIAN, YOU DON'T SEE VERY 
MANY CHANGES SO THIS IS MEDIAN 
HOUSEHOLD INCOME OVERALL AND BY 
SUBGROUPS.
FOR MOST THEY'RE NOT 
STATISTICALLY DIFFERENT OR 
ECONOMICALLY MEANINGFUL BUT YOU 
SEE A HANDFUL OF GROUP WITH 
STATISTICALLY SIGNIFICANT 
DIFFERENCES AT THE 90% LEVEL 
HISPANIC AND TWO AGE GROUPS.
AT THE TOP OF THE DISTRIBUTION, 
YOU SEE MORE INCOME.
THIS IS PRIMARILY ABOUT 
INCREASING THE TOP CODE YOU SEE 
ACROSS THE BOARD INCREASES.
I'LL HAND THIS OVER TO EDWARD TO
TALK ABOUT
HEALTH INSURANCE.
THERE WAS A REDESIGNED 
QUESTIONNAIRE TO CAPTURE 
INFORMATION ON HEALTH INSURANCE 
STARTING IN 2013.
THE CHANGES WE EXTEND THE 
REFERENCE PERIOD AND GATHERED 
INFORMATION ABOUT TYPES OF 
HEALTH INSURANCE COVERAGE THAT 
HAD NOT PREVIOUSLY EXISTED AND 
DID A HOUSEHOLD DESIGN.
THE REASON WAS TO REDUCE 
RESPONDENT BURDEN AND THINK 
THROUGH THE TYPES OF COVERAGE 
THEY HAD.
THE SECOND WAS TO INCREASE THE 
RATE OF COVERAGE BECAUSE IT 
TENDED TO CAPTURE LESS COVERAGE 
AND THE IN INSURED RATE TENDED 
TO BE HIGHER AND THE DETAIL OF 
THESE TYPES THAT WERE ENTERING 
THE HEALTH INSURANCE LANDSCAPE.
THE NEW QUESTIONNAIRE MOVED FROM
THE BROAD QUESTIONS AND ASKED 
MORE TAILORED SPECIFIC 
QUESTIONS.
SO PERSONS COULD REPORT THEIR 
COVERAGE THROUGH 600 DIFFERENT
PATHS.
THE OLD TRADITIONAL PROCESSING 
SYSTEM WITH THE NEW DATA MEANT 
WE COULD NOT ALWAYS PRESERVE THE
MORE DETAILED INFORMATION.
THE NEW UPDATED PROCESSING 
SYSTEM INCLUDES MORE DETAIL ON 
THE NEW TYPES OF COVERAGE AND 
MARKETPLACE COVERAGE AND WHETHER
IT WAS SUBSIDIZED.
WE USED SUB-ANNUAL HEALTH 
INFORMATION AT THE MONTHLY LEVEL
AND IMPLEMENTED A NEW PROCESS 
THAT USES HEALTH INSURANCE UNITS
I'LL TALK ABOUT IN A COUPLE 
SLIDES.
THE OTHER THING THE 
QUESTIONNAIRE CHANGED AND WE 
WERE ABLE TO IMPLEMENT IS 
SEPARATE TRI CARE FROM OTHER 
MILITARY COVERAGE.
THAT'S FOR ACTIVE DUTY MILITARY 
AND OTHER TYPES OF MILITARY 
COVERAGE ARE TYPES OF PUBLIC 
COVERAGE.
BEFORE WE HAD THEM TOGETHER AND 
NOW WE CAN SEPARATE THEM AND PUT
TRI CARE IN THE CATEGORY OF 
PRIVATE WHICH MEANS OUR 
DEFINITIONS OF PUBLIC AND 
PRIVATE HAVE CHANGED WITH THE 
UPDATED
PROCESSING SYSTEM.
JUST TO GO OVER RESULTS.
I WANT TO SAY WE'RE GOING 
COMPARE THE RESULTS FROM THE 
RESEARCH FILE WHICH USES THE 
UPDATED PROCESSING SYSTEM AND 
PRODUCTION FILE WHICH USES THE 
TRADITIONAL SYSTEM AND WE URGE 
CAUTION IN MAKING THE COMPARISON
BUT WE'RE DOING THIS TO YOU WILL
STRAIGHT THE -- TO ILLUSTRATE 
THE CHANGES.
YOU CAN SEE WITH THE NEW 
PROCESSING SYSTEM ON THE GREEN 
LINE THE OVERALL COVERAGE RATE 
IS ABOUT
9/10s HIGHER.
THE
IN
UNINSURED RATE IS DIFFERENT AND 
WE HAVE A WEBSITE THAT GOES 
THROUGH THE DIFFERENT REASONS 
WHY THE CHANGE OCCUR.
TWO I WANT TO HIGHLIGHT IS WE 
UPDATE THE IMPUTATION PROCEDURE 
IN WHICH NO HOUSEHOLD MEMBER
REPORTS COVERAGE.
WITH THE TRADITIONAL SYSTEM WE 
DIDN'T TAKE INTO ACCOUNT THE 
OTHER TYPES OF COVERAGE THE 
PERSON IMPUTED OR THE COVERAGE 
STATUS OF OTHER PEOPLE'S 
HOUSEHOLD.
NOW WE START AT A HEALTH 
INSURANCE UNIT WHICH SAY CONCEPT
FROM THE UNIVERSITY OF MINNESOTA
THAT LOOKS AT PEOPLE WITHIN A 
HOUSEHOLD WHO ARE ELIGIBLE TO 
SHARE COVERAGE AND WE DO 
IMPUTATION BASED ON THAT 
CONSTRUCT.
AND WE'LL HAVE A WORKING PAPER 
SPECIFICALLY ON THAT COMING OUT 
IN THE NEXT FEW WEEKS.
WE ALSO REFINED HOW WE CONSTRUCT
ESTIMATES OF ANNUAL COVERAGE.
WE BUILT UP THE ANNUAL LEVEL TO 
THE ANNUAL LEVEL LIKE INCOME OUR
MAIN COVERAGE ESTIMATE IS FOR 
THE PREVIOUS CALENDAR YEAR.
AND AGAIN I WANT TO EMPHASIZE 
WITH THE UPDATED PROCESSING 
SYSTEM, THE DEFINITIONS OF 
PUBLIC AND PRIVATE HAVE CHANGED.
SO IF YOU LOOK ON THE SLIDE YOU 
CAN SEE THAT WHAT IT FALLS INTO 
EACH BUCKET AND THE MAIN CHANGES
TRICARE IS MOVING FROM THE 
PUBLIC LINE UP TO THE PRIVATE 
LINE.
SO YOU CAN SEE WITH THE NEW 
UPDATED PROCESSING SYSTEM, 
PRIVATE COVERAGE IS 
SIGNIFICANTLY HIGHER AND PUBLIC 
COVERAGE IS SIGNIFICANTLY LOWER.
IF YOU LOOK AT SPECIFIC COVERAGE
TYPES YOU SEE SIGNIFICANT 
CHANGES BETWEEN THE RESEARCH AND
PRODUCTION FILE AND UPDATE AND 
TRADITIONAL PROCESSING SYSTEMS 
FOR ALL TYPES OF COVERAGE EXCEPT
FOR MEDICARE.
ONE THE AIMS IS TO CAPTURE 
CHANGING INSURANCE LANDSCAPE.
WE LOOKED AT WHAT GROUPS HAVE 
THE LARGEST CHANGES AND 
CONSISTENT WE FOUND THE LARGEST 
CHANGES FOR ADULTS AGED 19 TO 64
AND FOR PERSONS INCOME TO 
POVERTY RATIOS BELOW 400% WHICH 
IS CONSISTENT WITH CHANGES HAVE 
IDENTIFIED IN THE HEALTH POLICY 
LITERATURE.
YOU CAN SEE THAT HERE FOR THE 
SAKE OF TIME I'M NOT GOING TO GO
THROUGH ALL
THE ESTIMATES.
WE ALSO HAVE HEALTH INSURANCE 
MEASURES AND WHETHER DIRECT 
COVERAGE WAS THROUGH A 
MARKETPLACE SO HEALTHCARE.gov 
AND WHETHER THAT PERSON RECEIVED
A SUBSIDY TO PARTNER WITH THE 
HEALTH INSURANCE PREMIUMS.
WE ALSO HAVE MEASURES OF 
COVERAGE AND WHETHER A PERSON 
HAD COVERAGE NON OF THE YEAR, 
PART OF THE YEAR OR ALL THE 
YEAR, WE HAVE REFINED MILITARY 
COVERAGE.
TRYCARE IS
SEPARATED.
AND PREVIOUSLY WE ONLY HAD 
WHETHER A PERSON WAS COVERED 
DURING FEBRUARY, MARCH OR APRIL 
WHEN THE INTERVIEW OCCUR AND NOW
WE HAVE INFORMATION ON THE TYPE 
OF COVERAGE THEY HELD AT THE 
TIME OF
INTERVIEW.
IN TERMS OF OUTREACH, WE HAVE A 
LIST OF WORK
PAPERS.
SOME ARE COMING PAPERS AND SOME 
WILL BE AVAILABLE IN THE NEXT 
COMING WEEKS AND MONTHS AND WE 
HAVE THE UPDATED PROCESSING 
SYSTEM.
IN APRIL WE'LL RELEASE THE 
BRIDGE FILE TO UTILIZE THE 
UPDATEDUPDATED PROCESSING SYSTEM
AND USER NOTES AND TECHNICAL 
DOCUMENTATION AND THE LIKE.
WE'RE ALSO DOING OUTREACH AT 
PROFESSIONAL ORGANIZATIONS, 
ACADEMIC ORGANIZATIONS.
YOU CAN SEE A LIST OF 
CONFERENCES UP THERE AT WHEN WE 
PRESENTED IN THE FALL OR HAVE 
PAPERS ACCEPTED IN THE COMING 
MONTHS AND P.A.s THE WEEK 
AFTERWARDS.
WE'LL BE
HOLDING I MEETING TO REACH OUT 
TO THOSE IN THE GOVERNMENT AND 
OUTSIDE
THE GOVERNMENT.
IN TERMS OF IMPLEMENTATION, WE 
WILL RELEASE THE ONE FILE AND 
RELEASE THE SECOND FILE APRIL 
2019 AND THEN USE THAT IN THE 
RELEASE FOR THE REPORTS THIS 
YEAR.
STARTING IN SEPTEMBER GOING 
FORWARD WE'LL SWITCH TO THE 
UPDATED PROCESSING SYSTEM.
WE WON'T PROCESS USING THE 
TRADITIONAL PROCESSING SYSTEM 
GOING FORWARD.
THIS IS THE LAST SLIDE.
HERE'S A QUESTION FOR YOU.
DO YOU HAVE ANY ADDITIONAL 
SUGGESTIONS FOR OUTREACH?
DO YOU HAVE AN IDEA OF GROUPS WE
SHOULD BE REACHING OUT TO TO 
DISCUSS THE CHANGES?
AND
IF WE DO SO, HOW SHOULD WE TALK 
ABOUT THE SLIT OFF OF TRICARE 
FOR OTHERS MILITARY INSURANCE 
AND FOR INCOME AND POVERTY, 
SHOULD WE CONSIDER THESE CHANGES
TO BE A BREAK IN THE SERIES?
THANK YOU VERY MUCH FOR YOUR 
TIME.
>> THANK YOU.
I'LL TURN IT OVER TO JEFF.
>> MY COMMENTS ARE SHORT.
I ONLY HAVE TWO
SLIDES.
THE FIRST SLIDE I ESSENTIALLY 
RESTATED YOUR QUESTION.
THANK YOU AND THE REASON I PUT 
THIS UP IS TO GO BACK TO THE 
SLIDE TO GET THE COMMITTEE INPUT
AND I REALLY DID WANT TO LEAVE A
LOT OF TIME FOR THE COMMITTEE 
INPUT.
IN TERMS OF OUTREACH, I'M NOT A 
STATISTICIAN.
IT'S NOT REALLY MY AREA OF 
EXPERTISE.
I'M LOOKING FOR THE COMMITTEE TO
PROVIDE GOOD INPUT ON THAT.
THE QUESTION I WOULD HAVE 
RELATED TO OUTREACH IS YOU 
LISTED YOUR PEER PAPERS WHICH I 
READ WHICH WERE GOOD.
AND I DIDN'T UNDERSTAND SOME OF 
THEM.
YOU ALSO LISTED SOME CONFERENCES
THAT YOU'LL OUTREACH WILL ATTEND
AND MY QUESTION RELATED TO THAT 
IS ARE THE USERS OF REPRESENTED 
AT THE CONFERENCES?
IS THAT THE ENDPOINT OF THE 
OUTREACH OR DO YOU HAVE TO GO 
ONE LEVEL DEEPER TO GET TO THE 
USERS OF THE DATA?
THE QUESTION I WAS MOST 
INTRIGUED ABOUT WAS YOUR 
QUESTION ABOUT WHETHER OR NOT 
THE CHANGES IN THE IMPROVEMENTS 
AND THE PROCESS FOR BOTH INCOME 
AND HEALTH REPRESENT A TIME
SERIES BREAK.
SO IN MY OPINION, IT SOUNDS LIKE
AND THIS IS SOMETHING ELSE YOU 
COULD STAY TOO BUT IT SOUNDS 
LIKE FROM BOTH YOUR PERSPECTIVES
YOU'RE CONSIDERING IN A TIME 
SERIES BREAK UP TERMS OF MOVING 
FORWARD WITH THE NEW PROCESS, I 
DO THINK IT DEPENDS ON THE ICE 
OF THE DATA OR THE URGS OF THE 
DATA AND WHETHER OR NOT THEY 
UNDERSTAND THE CHANGES.
IT GOES BACK TO WHAT YOU PUT IN 
YOUR QUESTION, HOW DO YOU CONVEY
THE CHANGES AND COMMUNICATE THE 
CHANGES TO THE END USERS OF THE 
DATA SO THEY UNDERSTAND THE 
CONSTRAINTS OF LOOKING AT LEGACY
DATA VERSUS
DATA MOVING FORWARD.
I THINK THE MESSAGE HAS TO BE 
100% POSITIVE.
EVERYTHING YOU'RE DOING IS 
GREAT.
YOU'RE IMPROVING THE DATA AND 
MAKING IT MORE ACCURATE.
AS THE END USER OF THE DATA I 
DON'T SEE HOW ANYBODY CAN BE 
OFFENDED THE PROCESS HAS 
IMPROVED.
I THINK THAT'S YOUR TAGLINE OR 
MESSAGE MOVING FORWARD, HEY, WE 
HAVE THIS GREAT DATA NOW AND 
WE'RE GOING TO DO EVERYTHING WE 
CAN TO MAKE IT USABLE FOR YOU 
EVEN IF YOU HAVE TO COMPARE IT 
TO LEGACY DATA.
MY QUESTION IS HOW FAR BACK CAN 
YOU GO?
DOES IT GO BACK TO WHERE THE 
QUESTIONS CHANGED WHICH I GUESS 
IS 2015 OR CAN YOU IMPLEMENT THE
NEW PROCESSES ON LEGACY DATA 
WHERE THE QUESTIONS HAD NOT 
CHANGED?
AND WITH THAT,
CAN YOU SOME CONFIDENCE INTERVAL
FOR EVEN THE LEGACY DATA BASED 
ON WHAT OUR DISCUSSION WAS
WITH DISCLOSURE AVOIDANCE.
THOSE ARE THE QUESTIONS I HAVE.
I BELIEVE WE HAVE CHRISTIAN ON 
THE LINE AND I BELIEVE HE HAS 
INPUT AS WELL AS THE REST
OF THE COMMITTEE.
I'LL GO BACK TO THE SLIDES YOU 
SHOWED AND OPEN IT UP FOR 
COMMITTEE DISCUSSION.
>> AND IF YOU WANT TO ANSWER 
WHAT JEFF JUST ASKED.
>> WE HAVE SOME OF THE 
EXPERIENCE WITH THE TIME BREAK 
BECAUSE THE DIVISION HAS AFFECT 
THE INCOME ESTIMATES AND WE CAN 
USE THE GAP AND UNCERTAINTY TO 
WORK BACKWARDS TO ADJUST THE 
PRE-REDESIGNED ESTIMATES TO 
MATCH THE CURRENT ONES THOUGH 
THE FURTHER YOU GET AWAY FROM 
THE REDESIGN THE STRONGER THE 
ASSUMPTIONS.
THIS IS A LONG-RUNNING SERIES.
YOU CAN GO BACK TO THE 
'60s.
IT'S NOT THE FIRST REDESIGN.
IN THE PAST, FOR EXAMPLE, YOU 
HAVE A MEDIAN HOUSEHOLD INCOME 
AND THE NEW EDIT IS TO TREAT IT 
AS A SERIES BUT THAT'S NOT 
ALWAYS TRUE FOR ANY STATISTICS 
OF INTEREST FOR INCOME.
IT CAN BE A CHALLENGE IF 
PARTICULAR SUBGROUPS WERE 
AFFECTED FROM THE REDESIGN MORE 
THAN THE AVERAGE OVERALL 
POPULATION.
>> AND WITH HEALTH INSURANCE 
DATA THE QUESTIONNAIRE CAPTURES 
SUCH DIFFERENT CONTENT.
IT GOES ABOUT CAPTURING CONTENT 
WE DIDN'T
GO BACK.
>> I DON'T KNOW IF KRISHNA 
CALLED IN.
>> I DON'T HAVE THEM ON THE 
LINE, ALLISON.
>> IT'S EARLY ON THE WEST COAST.
>> KEN SIMONSON.
I'M INTERESTED WHETHER THE 
MEASUREMENT OF INCOME 
PARTICULARLY AT THE HIGH END HAS
CHANGED IN A WAY YOU CAN CAPTURE
AND IT'S CONCERNED ME HAVE YOU 
SOMEBODY OVER
$200,000 SIN THAT RANGE AND MANY
-- IS IN THAT RANGE AND MANY 
PEOPLE WOULD GO OVER $100 
MILLION THAN YEARS AGO AND IF WE
GO TO THE INCOME INEQUALITY AND 
SOURCES
OF INCOME. 0 MILLION THAN YEARS 
AGO AND IF WE GO TO THE INCOME 
INEQUALITY AND SOURCES OF 
INCOME. MILLION THAN YEARS AGO 
AND IF WE GO TO THE INCOME 
INEQUALITY AND SOURCES OF 
INCOME.MILLION THAN YEARS AGO 
AND IF WE GO TO THE INCOME 
INEQUALITY AND SOURCES OF 
INCOME.MILLION THAN YEARS AGO 
AND IF WE GO TO THE INCOME 
INEQUALITY AND SOURCES OF 
INCOME. MILLION THAN YEARS AGO 
AND IF WE GO TO THE INCOME 
INEQUALITY AND SOURCES OF 
INCOME.
AND DO YOU HAVE A PLAN AS PEOPLE
MOVE INTO HIGHER INCOME BRACKET 
OR OTHER CHARACTERISTICS CHANGES
YOU'RE
ASKING ABOUT?
>> THAT'S VALID AS THE INCOME 
BECOMES MORE SKEW.
TO CAPTURE IN THE SURVEY BUT I 
THINK THE CONCERN I THINK SAY 
VALID ONE.
IT'S A CHALLENGE FOR HOW WE DO 
TOP CODING.
THE FURTHER YOU GET IN THE TAIL 
THE HIGHER CHANCE FOR 
MISREPORTING OR AN EXTRA ZERO 
HITS AND THAT PRESENTS A 
CHALLENGE FOR HOW WE LOOK AT TOP
CODING.
IT'S SOMETHING WE HAVE THOUGHT 
ABOUT IN ADMINISTRATIVE RECORDS 
AS A WAY TO GET AT WHAT MIGHT WE
BE MISSING IN THE FAR RIGHT TAIL
OF DISTRIBUTION.
>> CATHY.
>> I'M FASCINATED BY HOW TO 
EDUCATE USERS TO ALL OF THIS AND
WHO CAN COME TO CONFERENCES OR 
WHO WE
PASSIVELY REVIEW PEER REVIEW 
JOURNALS AND I'M TRYING TO THINK
OF OTHER WAYS WHETHER IT'S A 
NEWSLETTER OF THE AMERICAN 
STATISTICAL ASSOCIATION OR A 
BLOG LIKE A PLAIN LANGUAGE LIKE 
A PEOPLE BLOG IN ONE OF THE 
CENSUS BLOGS ABOUT HOW INCOME IS
-- WHAT YOU SAID WILL MAKE SENSE
TO REGULAR PEOPLE, RIGHT?
RETIREMENT INCOME IS CHANGING 
AND IT'S HARD TO UNDERSTAND 
HEALTH INSURANCE THINGS.
I'M TRYING TO THINK OF MORE 
DIFFUSE MECHANISMS TO GET IT 
OUT.
THE OTHER GROUP I THOUGHT OF IS 
GRADUATE STUDENTS.
PEOPLE THAT MIGHT BE -- I DON'T 
KNOW HOW TO GET TO THE GRADUATE 
PROGRAMS OR STUDENT ASSOCIATIONS
OR PROFESSORS OR OTHER PEOPLE 
THAT WOULD MISUSE THE DATA.
THIS SEEMS TO ME TOTALLY CLEARLY
A
BREAK IN SERIES.
AND IF PEOPLE -- IF PEOPLE 
DECIDE TO USE IT CONTINUOUSLY 
FOR WHATEVER PURPOSE THEY HAVE, 
THEY'LL AT LEAST MAKE THAT 
DELIBERATELY KNOWING THE
ISSUES.
I WAS THINKING WHO ARE THE 
MISSED USERS OF THE DATA.
 THEY MAY NOT BE GETTING YOUR 
MESSAGE ABOUT THE PIECES.
AND THEN I WAS ALSO WONDERING IF
YOU WERE WORKING ON -- WE WENT 
THROUGH THE HOME MORTGAGE 
DISCLOSURE ACTED DISCOULDN'T
--
DISCONTINUITY AND LABELLING AND 
IS IT MISLABELLING OR INCOME AND
R.E.V. METHOD?
I DON'T KNOW, AT LEAST TO SIGNAL
AS PEOPLE
LOOK TO HISTORIC BECAUSE SOME 
PEOPLE WON'T GO INTO THE FILES 
BUT PIECES OR A STANDARD NOTES 
THAT YOU ENCOURAGE NEW 
RESEARCHERS TO USE?
I DON'T KNOW.
I'M TRYING TO THINK ABOUT ALL 
THE COMMUNICATION WAYS.
THESE ARE SUCH CRITICAL NUMBERS 
EVERYONE KNOWS AND USES AND ARE 
REPORTED IN THE MEDIA AND EVERY 
DAY LIFE.
THE WORK I AGREE, IT'S AMAZING 
THAT WE'RE GETTING
IT RIGHT BUT THERE'S MORE WORK 
TO DO THAN JUST THE PEOPLE 
CRUNCHING THE NUMBERS AND I'M 
EXCITED TO SEE HOW IT ROLLS OUT.
I'M HAPPY TO GO BACK TO MY 
COLLEAGUES AT THE URBAN 
INSTITUTE TO GET OTHER IDEAS 
FROM THEM WHO I KNOW ARE AVID 
USERS OF THIS DATA AND PROBABLY 
HAVE A LOT OF OPINIONS TOO.
>> THANK YOU FOR THOSE COMMENTS.
WE'RE INVITING PEOPLE FROM
URBAN TO MAY 13.
I THINK YOU HAD GREAT IDEAS WITH
THE AMERICAN COUNTS AND THE MORE
PEDESTRIAN WAY OF EXPRESSING OF 
WHAT WE'RE DOING AND REACHING 
INTO IMPUTATION.
I THINK THAT'S
A GREAT WAY.
IN TERMS OF GRADUATE STUDENTS I 
MENTIONED WE'LL GO TO THE 
POPULATION ASSOCIATION OF 
AMERICA AND WE'LL HAVE PAPERS IN
THE SESSION AND TALK ABOUT USING
OUR DATA AND ASK A SUBSTANTIVE 
QUESTION AND PRIOR THEY HAVE A 
PRE-CONFERENCE WORKSHOP AND WE 
HAVE A HALF DAY SESSION.
I DON'T KNOW WHAT THE LAST 
NUMBER OF ENROLLEES IS BUT 
GRADUATE STUDENTS WILL COME AND 
FIND OUT MORE ABOUT USING THE 
DATA.
I THINK THE LAST POINT ABOUT 
LABELLING IS INCREDIBLY 
IMPORTANT AND SOMETHING WE 
THOUGHT A LOT OF ABOUT ON THE 
HEALTH INSURANCE SIDE WHICH I'M 
MORE FAMILIAR WITH AND ONE OF 
THE REASONS WE CHANGED ALMOST 
ALL THE VARIABLES.
YOU CAN'T JUST RERUN THE SAME 
CODE USING THE FILE.
YOU'LL GET A BUNCH OF ERROR 
MESSAGES AND THAT'S BY DESIGN.
SO CONCEPT TO THINK ABOUT BEFORE
USING THE OLD CODE.
EVEN IN REPORTS, I MENTIONED 
CATEGORIES OF PUBLIC AND PRIVATE
AND WE HISTORICALLY USED 
GOVERNMENT AND PRIVATE AND NOW 
WE'RE USING PUBLIC AND PRIVATE 
TO SIGNAL THIS IS NOT THE SAME 
CATEGORIES YOU'VE SEEN IN 
PREVIOUS REPORTS AND THERE'S
A DIFFERENCE IN WHAT THOSE
CONTAIN.
>> JAY WRIGHT.
FIRST I HAD A QUESTION.
SORRY, YOU CHANGE
THE SLIDE.
SHOULD THE SYSTEM BE CONSIDERED 
BREAKING SERIES AND IN LAY TERMS
THERE'S A BREAK IN THE SERIES 
BUT DOES IT HAVE A NORMAL SERIES
AND IF IT'S CONSIDERED A BREAK 
IN SERIES, DOES THE PROCESS JUMP
UP OR JUST MEAN THERE'S A
BREAK IN THE SERIES?
I DON'T KNOW IF THERE'S AN 
OFFICIAL DEFINITION.
I KNOW FOR US WHEN WE CAME 
ACROSS THE INCOME BREAK WE HAD 
TWO COMPARISONS AND ONE IS THE 
NAIVE COMPARISON AND THE OTHER 
IS CORRECTING FOR THE DIFFERENCE
WE SEE IN THE BREAK AND THE 
UNCERTAINTY OF THAT DIFFERENCE 
WHEN WE'RE TRYING TO MAKE 
COMPARISONS BECAUSE PEOPLE ARE 
VERY INTERESTED BECAUSE PEOPLE 
ARE VERY INTERESTED IN THE 
DIFFERENCE FROM THE LAST HANDFUL
OF YEARS.
>> AND THE LAST QUESTION OR 
COMMENT AND THERE'S A CHANGE IN
THE METHODOLOGY AND BECAUSE OF 
THE DISCONTINUITY PEOPLE MAY 
WANT TO BE ABLE DURING A 
TRANSITION PERIOD TO BE ABLE TO 
HAVE A SMOOTHER TRANSITION WHERE
THEY CAN GO BACK AND
LOOK AT ESTIMATES IN THE OLD 
UNIT AND IT SEEMS HAVE YOU THE 
ABILITY TO DO THAT GOING 
FORWARD.
YOU CAN PRODUCE THE OLDEST MATS.
YOU CAN TOP CODE IN THE OLD WAY 
OR IMPUTE IN THE OLD WAY AND DO 
THAT FOR SOME WINDOW OF TIME 
OVER WHICH PEOPLE CAN ADAPT TO 
THE METHODOLOGY.
IS THAT OF USE?
IT SOUNDS LIKE YEAR DOING THAT
ALREADY?
>> WE HAD A RELEASE BOTH WAYS 
AND LAST YEAR'S DATA WILL BE 
RELIEVED IN THE
NEXT COUPLE WEEKS.
GIVEN ON THE DATA AVAILABLE 
WE'RE NOT PLANNING TO
PROCESS BOTH WAYS.
GOING BACK IN TIME IT SEEMS 
YOU'VE BUILT A CAL GRATION TO 
GET THE OLDEST
OLD ESTIMATES AND UNTIL YOU 
CAN'T DO IT FURTHER BUT THAT'S 
SORT OF AVAILABLE GOING BACK A 
WAYS?
MAYBE I 
MISUNDERSTOOD?
>> WE HAD TWO YEARS OF OVERLAP.
>> AND I THINK THE LAST 
QUESTION, WHEN YOU GO BACK TO 
THE CHANGING QUESTIONNAIRE, WAS 
THERE A CHANGE IN FRAME AT ABOUT
THE SAME TIME OR IS THAT WHEN 
YOU WENT OVER?
>> I'M NOT AWARE OF THE CHANGE 
IN FRAME AT THAT TIME.
>> IT'S
NOT THAT IMPORTANT.
YOU WERE TALKING ABOUT THE 
HEALTH INSURANCE UNIT OF PEOPLE 
THAT COULD BE SHARING A PLAN FOR
SOMETHING LIKE THAT.
THERE WAS SOME IMPUTATION RULE 
WHEN NO ONE REPORTED COVERAGE.
WHAT DO YOU DO THEN?
>> YOU GET CONCEPTS WHEN NO ONE 
REPORTS COVERAGE IN THAT 
HOUSEHOLD.
SO WE'RE TALKING ABOUT THE WAY 
WE CONSIDER HEALTH INSURANCE 
UNITUNITS AND BEFORE IT MATCHED 
A PERSON TOWARDS THE 
CHARACTERISTICS.
NOW WE CONSTRUCT A HEALTH 
INSURANCE UNIT BASED ON SHARING 
YOUR PLAN WITH YOUR PARENTS IF 
YOU'RE UNDER 26 BUT NOT WITH 
YOUR SIBLING IF YOU'RE 40.
AND WE MATCH ON THE 
CHARACTERISTICS.
INSTEAD OF THINKING ABOUT THE 
PERSON, WE THINK WITH THE H.I.E.
IN THE HOT DECK.
>> KEN SIMONSON.
I HAVE A NUMBER OF QUESTIONS 
ABOUT LESSONS LEARNED AND HOW TO
IMPART LESSONS
LEARNED.
WAS THERE A PROCESS TO LOOKING 
AT ALTERNATIVES FOR CHANGES YOU 
MADE IN WHAT WAS BEING ASKED AND
HOW IT WAS PROCESSED AND
PRESENTED?
HAVE YOU LEARNED SOME THINGS 
THAT WOULD BE USEFUL TO THE 
COUNTER PARTS IN THE CENSUS 
BUREAU AND HOW DO YOU 
COMMUNICATE WHAT WENT RIGHT OR 
WHAT YOU SHOULDN'T BE
DOING AND THIRD, WERE THERE 
THINGS YOU CONSIDERED OR 
DROPPED, ETCETERA, YOU'D STILL 
WANT TO KEEP AVAILABLE FOR 
CONSIDERING THE NEXT TIME YOU'RE
GOING TO DO 
REVISIONS IN THIS?
>> FOR LESSONS LEARNS THE BEST 
MEANS OF COMMUNICATING THAT IS 
WE PUT OUT BOTH AT THE TIME OF 
THE INITIAL REDESIGN AND NOW 
PUTTING OUT PAPERS ABOUT WHAT 
WE'VE DONE AND WHY.
IN TERMS OF THINGS CONSIDERED 
AND THERE'S LOTS OF AVENUES WE 
CAN EXPLORE BUT LIMITED RESOURCE
TO EXPLORE THEM SO BIGGER HAUL 
OF THE IMPUTATION SYSTEM AND 
THINGS I'D LIKE TO PURSUE BUT 
WE'RE STILL DOING ACTIVE 
RESEARCH TRYING TO FIGURE OUT 
AND WE HAVE WORKING PAPERS
RELATED TO OTHER WAYS TO IMPROVE
THE DATA THAT'S ONGOING TO THE 
WORK WE'RE DOING.
>> AND BEFORE THE QUESTIONNAIRE 
WAS CHANGED IT WAS BASED ON A 
DECADE OF RESEARCH.
THERE WAS FIELD TESTING, 
COGNITIVE TESTING.
THE USUAL SET OF RIGOROUS 
DECISION MAKING.
THROUGHOUT THE PROCESS WE TRIED 
TO ENGAGE STAKEHOLDERS TO GET 
FEEDBACK AND ALSO HAVE BEEN 
DOING EVALUATION.
I CAN SPEAK TO IN THINKING ABOUT
THE MONTHLY LEVEL HEALTH 
INSURANCE USING TO CONSTRUCT 
ESTIMATES AND I DID BENCHMARKED 
AGAINST THE
SURVEY WHICH IS RUN BY H.H.S., 
HEALTH AND HUMAN
SERVICES.
WE'RE PLANNING ADDITIONAL 
PROCEDURES TO MAKE SURE WE CAN 
EXPRESS WHAT WE'VE DONE IN A WAY
THAT'S CLEAR AND BENCHMARKED 
AGAINST OTHERS' WORK.
>> IN TERMS OF SHARING 
INFORMATION, LESSONS LEARNED 
WITH COLLEAGUES, A WORKING PAPER
IS A FAIRLY FORMAL WAY OF DOING 
IT.
I HOPE YOU'VE HAD INFORMAL 
DISCUSSIONS ALSO.
AND HAVING CONSENSUS OPERATE 
THROUGH SILOS BUT THERE'S NOT 
BEEN AS MUCH AS 
CROSS-FERTILIZATION OF IDEAS 
WE'VE BEEN ABLE TO BENEFIT FROM 
SO I HOPE YOU'VE DONE THAT IN AN
IN FORMAL WAY.
>> I CAN'T THINK OF THE NAME OFF
THE TOP OF MY HEAD BUT THERE WAS
AN A GROUP I PRESENTED AT FROM
FORMAL WAY.
>> I CAN'T THINK OF THE NAME OFF
THE TOP OF MY HEAD BUT THERE WAS
AN A GROUP I PRESENTED AT FROM 
EARLIER WORK AND WE'VE DONE MORE
INFORMAL BROWN BAGGING.
>> AND IN THE STATISTICS 
DIVISION WHICH OUR BRANCH 
REALIZE ON SUBJECT MATTER NOT 
BASED ON SURVEY.
IT'S NOT JUST C.P.S. FOLKS 
WORKING ON HEALTH INSURANCE WE 
WORK ON HEALTH INSURANCE
CONTENT.
THERE'S INTERNAL CROSS 
FERTILIZATION BASED ON CONTENT.
>> GREAT.
>> THIS COMES WITH PRESS 
RELEASES, DOESN'T IT?
IN THE PRESS RELEASES DON'T WE 
TRY TO DESCRIBE THIS?
>> I KNOW WHEN WE RELEASE THE 
RESEARCH FILE IN JANUARY, IT WAS
PUT ON THE P.I.O. TIP SHE'D AND 
THERE WAS AN ANNOUNCEMENT OUR 
DIVISION CHIEF SENT OUT TO THE 
MEDIA.
I THINK THAT HAS BEEN PART OF 
THE OUTREACH
AS FAR AS I KNOW.
>> WHEN THE REDESIGN INITIALLY 
WAS DONE WAS IN THE PRESENTATION
OF THE PRESS AND THIS YEAR'S 
RELEASE IN SEPTEMBER ALSO SO 
THAT'S ANOTHER WAY THAT'S MORE 
PUBLIC COMMUNICATION OF
THESE CHANGES.
>> BASED ON THE CONVERSATION 
YESTERDAY WE WERE TALKING ABOUT 
THE A.C.S. USER GUIDES, WHICH 
ARE FANTASTIC, BY THE WAY, AND 
PREVIOUSLY WE TALKED ABOUT 
CHANGES IN HOW QUESTIONS GET 
ASKED TO MEASURE BUSINESS'S USE 
OF TECHNOLOGY.
THINGS ARE CHANGING QUICKLY IN 
OUR COUNTRY AND YOU MAY NEED TO 
MAKE MORE CHANGES TO THE SURVEY.
THE CENSUS MAY WANT A DEFINITION
FOR WHAT A BREAK IN SERIES IS 
AND PROTOCOLS FOR IDENTIFYING 
USERS AND IDENTIFYING 
APPROPRIATE COMMUNICATIONS WITH 
THOSE USERS BECAUSE IT MIGHT 
HAPPEN A LOT IN THE FUTURE.
>> A QUICK SUGGESTION IS TO 
REACH OUT TO STATE AND LOCAL 
HEALTH OFFICIAL.
 THERE MAY BE USERS THAT DON'T 
GO TO
CONFERENCES.
>> IS THIS MARIO MARATZI AND A 
COUPLE THOUGHTS NO THINK ABOUT.
STARTING WITH ALLISON'S POINT, I
WAS THINKING THE SAME THING.
THIS IS NOT SOMETHING THAT JUST 
MIGHT COME ALONG BUT IT COMES 
ALONG ALL THE TIME AND IT'S HARD
TO ANSWER THE QUESTION IF WE 
DON'T KNOW WHAT WE'RE REFERRING 
TO AS A BREAK IN THE SERIES.
DO WE MEAN THE CENSUS BUREAU 
WILL NOT PUT UP A CHART WITH A 
LINE CHART CONNECTING DOTS.
AND ARE THERE SEPARATE 
DISCONNECTED THOUGHTS.
WILL WE DESCRIBE THE CHANGES IN 
METHODOLOGY AND WE'LL USE THE 
WORD, THERE'S A BREAK.
I DON'T THINK ANYONE WOULD 
DISAGREE WITH PUTTING 
DOCUMENTATION ON
THE CHANGES MADE.
AND I'M AFRAID I DON'T HAVE 
ENOUGH INFORMATION TO HELP YOU 
ANSWER IT.
I WANT TO HEAR YOU SAY IT OUT 
LOUD.
FIRST, I THINK IT'S CLEAR 
HEARING YOU BOTH THAT ONE SIZE 
DOES NOT FIT ALL.
PERHAPS HAVE YOU A BREAK IN 
HEALTH INSURANCE BUT NOT A BREAK
IN INCOME.
I THINK IT'S GOING TO DEPEND ON 
THE PARTICULAR CHARACTERISTICS 
ON THE SORTS OF QUESTIONS I'LL 
ASK NOW.
WHAT SORT OF CHANGES DID YOU DO 
THE METHODOLOGY.
YOU'VE BEEN GOOD ABOUT ANSWERING
THAT.
ONE QUESTION THAT'S NEEDED AND 
TAKEN INTO ACCOUNT.
SECOND, HOW FAR BACK DO YOU HAVE
CONSISTENT TIME SERIES?
I DON'T HAVE IT CLEAR, THE 
SURVEY STARTED IN THE '60s.
I KNOW THE INCOME MEASURES ARE 
VERY IMPORTANT.
I THINK THEY ALSO HAVE AN 
IMPLICATION FOR POVERTY RATES 
WHICH ARE MORE IMPORTANT.
FROM A USER PERSPECTIVE, BREAKS 
IN THE OFFICIAL POVERTY RATE 
WOULD BE A CONCERN.
TO THE EXTENT THAT WOULD BE 
MINIMIZED THE HOOPLA WE CREATE 
BY SAYING THINGS ARE DIFFERENT, 
THAT MIGHT BE A GOOD THING TO DO
FOR THE USER WITHOUT LIMITING 
THE DOCUMENTATION WE HAVE TO 
PROVIDE.
SOMETHING THE B.L.S. DOES QUITE 
A BIT ESPECIALLY WITH THE C.P.I.
IS TO CREATE THE RESEARCH SERIES
WHERE YOU USE THE NEW 
METHODOLOGY AND TRY TO IMPOSE IT
ON THE OLD DATA TO TRY TO CREATE
A COMPARABLE TIME SERIES AND HOW
FAR BACK DOES THAT STRATEGY WORK
FOR YOU AND MY FAVORITE, LET'S 
PUBLIC TWO NUMBERS FOR THE SAME 
TIME PERIOD AND LET THE USER 
CREATE THE FIRST
DIFFERENCES APPROACH WHICH IS 
NEVER PERFECT BUT LET'S THE 
USERS HAVE A WAY OUT.
I'D NEED ANSWER TO BE ABLE TO 
ANSWER YOUR QUESTION
ABOUT BREAKS.
>> AND NEITHER THE REDESIGNED 
QUESTIONNAIRE OR THE NEW EDITS 
IS THERE A STATISTICALLY 
DIFFERENCE ACROSS TWO
SAYS OF GROUPS.
IT'S NOT THE FIRST TIME THE 
SURVEY'S BEEN REDESIGNED WHERE 
IN THE PAST WE HAVE NOT TREATED 
IT AS A BREAK IN SERIES.
IT DOESN'T MEAN THERE'S NO 
SUBGROUPS FOR WHICH THERE WASN'T
A SIGNIFICANT DIFFERENCE.
WE'RE TESTING AT THE 90% 
CONFIDENCE LEVEL SO YOU'LL GET 
SOME SIGNIFICANT DIFFERENCES 
WHEN THERE MAY NOT
HAVE BEEN.
WHAT WE HAVE AN EFFECTIVE SERIES
AND DOING
AN ADJUSTMENT ON THE TIME 
DIFFERENCE AND WE'RE MAKE 
ASSUMPTIONS ABOUT THE DIFFERENCE
BETWEEN THE OLD AND NEW METHOD 
IN THE YEARS WE ANALYZED BUT IT 
DOESN'T MEAN IT WOULD HAVE BEEN 
TRUE IN THE PAST.
THE ASSUMPTION GETS STRONGER THE
FURTHER YOU GET FROM THE DATA 
YOU HAVE TO EVALUATE BUT THEY'RE
ALL PERFECT WAYS TO BRIDGE THE 
CHANGES IN SURVEYS.
WE TRY TO PUT OUT AS MUCH AS 
INFORMATION AS WE
CAN AND LET USERS KNOW ABOUT THE
ASSUMPTIONS BUT IN PART
IT'S WHAT PEOPLE COME TO US FOR 
THE DATA TO DO.
>> I THINK YOU MAKE A GOOD 
POINT.
FOR HEALTH INSURANCE THERE'S A
BREAK IN SERIES.
IT WON'T BE BEFORE ESTIMATES IN 
2014C.P.S.
>> WONDERFUL.
MARIO MARATZI.
ALLISON, AS WE HEAR THE 
DISCUSSION IT SEEMS CLEAR MAYBE 
THIS SAY TOPIC FOR
CSAC TO THINK OF PROTOCOLS FOR 
BIG BREAKS.
IT'S A BIG DEAL IN THE BUILD SOG
I'D GET THEIR INPUT BECAUSE IT'S
A HUGE UNDERTAKING AND I'M SURE 
I'M NOT THE FIRST TO
PROPOSE IT.
DID YOU GUYS SAY THERE WOULD BE 
STATISTICALLY SIGNIFICANT CHANGE
IN THE
NATIONAL POVERTY RATE?
>> IT'S NOT STATISTICALLY 
DIFFERENT IF YOU LOOK AT 2016 
AND '17 WITH THE EDITING CHANGE 
THE DIFFERENCE IS NOT 
STATISTICALLY DIFFERENT EITHER.
>> THANK YOU VERY MUCH FOR THAT.
JUST WANTED TO
MAKE SURE SOME TECHNICAL POINTS 
ON HEALTH INSURANCE.
THERE'S SEASONAL PATTERNS IN 
HEALTH INSURANCE COVERAGE.
YOU MENTIONED NOW YOU HAVE 
SUBANNUAL COVERAGE MEASURES.
ONE QUESTION IS CAN YOU PROVIDE 
AN EXAMPLE FOR WHAT YOU MEAN SUB
ANNUAL COVERAGE MEASURE?
>> WE COLLECT INFORMATION IN THE
QUESTIONNAIRE ON THE MONTHLY 
LEVEL YOU INDICATE THE LEVEL AND
YOU CHECK ALL THE MONTHS THAT 
APPLY.
RIGHT NOW WE'RE ONLY RELEASING 
TO THE PUBLIC A VERSION THAT 
SAID 
NONE, SOME, ALL.
WE STILL NEED TO LOOK AT A 
MEANINGFUL DIFFERENCE IN SEEING 
IF SOMEONE IS COVERED AND
CAN WE PROTECT CONFIDENTIALITY 
BECAUSE THERE'S TERRITORY WHERE 
WE WORRY ABOUT EXPOSURE RISK.
WE COLLECT IT AT THE MONTHLY 
LEVEL AND USE
MONTH ESTIMATES.
IN TERMS OF RELEASE.
>> SO YOU WON'T RELEASE MONTHLY 
DATA?
>> AND IT'S WEIGHTED TO THE 
POPULATION OF
THE COLLECTION YEAR.
IT WOULD TAKE WORK TO THINK 
ABOUT WHAT
THAT MEANS.
THOSE ARE MY QUESTIONS, THANK 
YOU.
>> THAT'S A GREAT CONVERSATION.
I THINK WE FINISHED 10 MINUTES 
EARLY.
>> YES, WE 
MUCH JONATHAN AND EDWARD AND THE
DISCUSSION AND EVERYONE.
SHOULD WE BREAK NOW AND COME 
BACK AT 10:30?
WE THAT CLOCK.
NOT THAT CLOCK, THIS CLOCK.
>> 10:40.
>> SO PEOPLE COULD START WRITING
UP THEIR RECOMMENDATIONS BASED 
ON THE TWO CONVERSATIONS WOULD 
THAT WORK?
WE HAVE A LITTLE TIME?
YES.
>> 20 MINUTES.
>> ALLISON DO YOU WANT TO GIVE 
PEOPLE STYLE
GUIDANCE ON RECOMMENDATIONS.
IF YOU WOULD, TRY TO AVOID 
SAYING WE RECOMMEND AND SAY
CCAC RECOMMENDS.
I THINK THAT IS ENOUGH.
THAT'S
HELPFUL.
THANKS.
>> TOMMY WRIGHT.
THE COMMITTEE IS BACK IN SESSION
NEAR 10:40.
WE WILL NOW HAVE PRESENTATIONS 
FROM LISA
DONALDSON AND SHELLY KARLSSON ON
INTERNET AND SELF-RESPONSE 
EXPERIENCE.
I CAN REMIND YOU THAT WE WILL 
LIKELY HAVE THE POLLS FOR THE 
PUBLIC COMMENT DURING THIS 
SESSION.
I THINK 
SHEILA'S PRESENTING.
>> FIRST OF ALL, THANK YOU FOR 
HAVING US HERE TODAY.
MY NAME IS SHELLY KARLSSON WE'RE
RESPONSIBLE FOR INTERNET 
ACTIVITIES IN THE CENSUS BUREAU 
AND I PLAN TO GIVE YOU AN 
OVERVIEW OF THE DATA COLLECTION 
SYSTEM WE'LL USE FOR THE 
ECONOMIC CONSENSUS.
IT'S THE BIGGEST PROGRAM IN OUR
DIRECTDIRECTORATE AND HAS 
175,000 MULTI-LOCATION 
BUSINESSES.
I MEAN THEY HAVE TWO
OR MORE LOCATIONS.
IT'S THE MOST COMPREHENSIVE 
MEASUREMENT OF THE ECONOMIC 
PROVIDINGPROVIDING STATISTICS ON
MEASUREMENTS CONSISTENT AND 
COMPREHENSIBLE AND ACROSS 
GEOGRAPHIC AREAS.
WE CONDUCT THE CENSUS EVERY 
YEARS IN YEARS ENDING IN TWO AND
SEVEN AND WE DID PROVIDE A PAPER
OPTION TO OUR ISLAND AREAS 
HOWEVER, ALL THE STATESIDE 
LOCATIONS WERE COLLECTED
ELECTRONICALLY.
THE FOUR SYSTEMS USED FOR THE 
ECON CENSUS WERE THE RESPONDENT 
PORTAL AND C.R.N. TOOL, THE 
CONTENT METADATA SYSTEM COMET 
AND THE PROGRAM CENTURION.
FIRST I'LL TALK ABOUT THE 
RESPONDENT PORTAL.
IN EARLY 2017 WE INTRODUCED THIS
AS A CENTRAL PORTAL TO MANAGE 
SURVEYS IN ONE PLACE.
WE USED ONE WEB ADDRESS FOR ALL 
SURVEYS WHEREAS IN THE PAST WE 
HAD MULTIPLE URLs FOR DIFFERENT
SURVEY INSTRUMENTS.
IT CAN ADD MULTIPLE SURVEYS TO 
THIS COUNTY AND CAN COMMUNICATE 
TO SECURE MESSAGING.
IN THE PAST WE HAD MULTIPLE 
SYSTEMS TO PERFORM THE 
FUNCTIONALITY.
AND THEY CAN GO THROUGH THE 
RESPONDENT PORTAL WITHOUT ADDING
ADDITIONAL
CREDENTIALS.
IN ADDITION TO THE ECON CENSUS 
USING THE TOOL, IDEALLY ONCE WE 
MIGRATE OUR SURVEYS IT WILL BE A
ONE-STOP SURE HAVE A FOR ALL 
ECONOMIC RESPONDENTS.
AND WE OFFER A UNIQUE 12 DIGIT 
CODE.
A RESPONDENT WILL GET ONE FOR 
EACH SURVEY THEY'RE ASKED TO 
PARTICIPATE IN.
THIS IS THE RESPONDENT PORTAL.
RESPONDENTS HAVE THE OPTION TO 
SIGN IN OR REGISTER FOR A NEW 
ACCOUNT IF THEY DON'T HAVE ONE 
YET.
IN ORDER TO
REGISTER, WE ASK FOR THEIR FIRST
NAME, LAST NAME AND TELEPHONE 
NUMBER AND RESPONDENTS ARE 
REQUIRED TO ANSWER FIVE SECURITY
QUESTIONS THEY'LL USE IF THEY 
FORGET THEIR PASSWORD.
IF THEY ARE UNABLE TO ANSWER THE
SECURITY QUESTIONS UPON PASSWORD
RESET WE PROVIDE AN OPTION TO 
GET AN E-MAIL LINK TO RESET THE 
PASSWORD.
THE PASSWORDS EXPIRE NEVER 90 
DAYS AND ONCE THEY COMPLETE THE 
REGISTRATION THEY'LL GET A 
CONFIRMATION TO THE E-MAIL 
ADDRESS THEY USED TO REGISTER 
THEM.
WE'VE HAD HALF A MILLION 
ACCOUNTS REGISTER THROUGH THIS 
PORTAL INCLUDING ALL 12 SURVEYS 
PLUS THE ECON CONSENSUS.
I WILL NOTE WE'RE
SEEING SOME RESPONDENTS 
STRUGGLING WITH THE SECURITY 
REQUIREMENTS THE COMPLEXITY OF 
THE PASS WORDS THE FACT THEY 
EXPIRE EVERY 90 DAYS AND THE 
PROCESS SURROUNDING COMPLETING 
AND USING THE SECURITY QUESTIONS
TO RESET
THEIR PASS WORDS.
ONCE THEY SIGN IN, THEY'LL HAVE 
SURVEY CARDS.
THEY'LL SHOW UP AFTER EVERY 
AUTHENTICATION CODE THAT GETS 
ENTERED.
OVER ON THE RIGHT YOU'LL SEE 
THEY HAVE THE OPTION TO ENTER A 
NEW AUTHENTICATION CODE WHEN 
THEY RECEIVE A NEW
SURVEY PARTICIPATION LETTER AND 
ACCOUNTANTS MAY HAVE THE SAME 
SURVEY CARD BUT FOR DIFFERENT 
BUSINESS.
WHEN THE COLLECTION PERIOD 
CLOSES, WE HAVE A HISTORY TAB 
AND THE RESPONDENT WILL BE ABLE 
TO SEE THEY WERE ABLE TO PROVIDE
INFORMATION FOR A PRIOR SURVEY 
HOWEVER THE RESPONSES WOULD NOT 
BE SAVED IN THE SYSTEM.
THEY'D HAVE TO REQUEST THAT 
THROUGH A SECURE MESSAGE ALSO 
THROUGH THE PORTAL THE SURVEY 
CARD HAS A SURVEY NAME AND DUE 
DATE, THE COMPANY NAME AND I.D.
THIS REPORT NOW WHICH IS THE 
SINGLE ACCESS TO THE CENTURION 
REPORTING TOOLS AND THEY CAN 
REQUEST A TIME EXTENSION IF THE 
SURVEY ALLOWS FOR TIME EXTENSION
AND CHECK THEIR FILING STATUS, 
USE SURVEY F.A.Q.s, SEND FOR 
SURVEY SUPPORT AND WE HAVE AN 
800 NUMBER IF THEY FEEL THEY 
NEED TO CALL AND THE BUTTON IS A
LINK TO THE SERVICE WEBSITE TO 
PROVIDE MORE INFORMATION ABOUT 
THE SURVEYS THEY'RE BEING ASKED 
TO COMPLETE.
I'D MENTIONED THE REPORT NOW 
FUNCTIONALITY WHICH IS THE 
SINGLE SIGN-ON TO SEN TOUR ON.
-- CENTURION.
THIS SHOWS THE LANDING PAGE 
THEY'LL END UP ON AT CENTURION 
ONCE THEY HIT REPORT NOW.
THE SHARE SURVEY ACCESS 
FUNCTIONALITY ALLOWS USERS TO 
SHARE TO DELEGATE TO OTHERS 
WITHIN THEIR COMPANY.
THIS IS THE ONLY WAY USERS CAN 
SHARE ACCESS SINCE THE 
AUTHENTICATION CODE WE PROVIDE 
THEM IS ONE-TIME USE ONLY.
AFTER THEY
ENTER THE E-MAIL ADDRESS THEY 
CAN ADD A NOTE, PLEASE HELP ME 
ON ONE THROUGH 10 AND THEY'LL 
GET INSTRUCTIONS ON HOW TO 
CREATE AN ACCOUNT OR LOG INTO 
THEIR ALREADY EXISTING ACCOUNT.
THE FUNCTIONALITY ALLOWS THEM TO
PASS THIS TO THE NEXT PERSON 
RATHER THAN CREATING A NEW 
ACCOUNT FOR A COMPANY.
ONE THING I WANTED TO MENTION, 
THE DELEGATES HAVE FULL ACCESS 
TO THE SURVEY.
THEY CAN ALSO ADD ADDITIONAL 
DELEGATES IF THEY NEED TO.
THEY HAVE THE SAME ACCESS AS THE
PERSON WHO DELEGATED TO THEM.
RESPONDENTS CAN NOW COMMUNICATE 
WITH CENSUS REPRESENTATIVES AND 
IF THEY WANT TO SEND A MESSAGE 
OR CHOOSE TO ADD ATTACHMENTS.
WE ALSO ASK THEM TO SELECT FROM 
PREDEFINED TOPICS.
THIS ALLOWS US TO PROPERLY ROUTE
THE MESSAGE FROM THE CENSUS 
BUREAU AND PRESENT AN FAQ ON THE
SPOT TO ANSWER THEIR MESSAGE 
BEFORE THEY HAVE TO SEND IT.
SO NOW I'LL TRANSITION TO THE 
INTERNAL APPLICATION THAT 
SUPPORTS THE PORTAL WHICH IS OUR
MANAGEMENT TOOL.
THIS TOOL WAS BUILT WITH A FOCUS
ON CUSTOMER SERVICE AND DATA 
COLLECTION WHERE IN THE PAST A 
LOT OF THE TOOLS USED BY 
CUSTOMER SUPPORT AREAS WERE 
SHARED WITH DATA ANALYSIS AND 
PROCESSING.
THE TOOL WAS BUILT SPECIFICALLY 
FOR THE CUSTOMER SUPPORT AREAS.
IT'S USED BY INTERVIEWERS AND 
ANALYSTS AT HEADQUARTERS AN IN 
ADDITION TO THE ECON CENSUS WE 
HAVE OTHER SURVEYS CURRENTLY 
SUPPORTED THROUGH THIS TOOL.
SOME HIGHLIGHTS THAT I'LL TALK 
ABOUT, ORGANIZATIONAL SEARCH 
WHICH IS A 360 VIEW OF THE 
COMPANY.
SECURE MESSAGING FUNCTIONALITY I
MENTIONED AND INBOUND AND 
OUTBOUND CALLS AND THE ABILITY 
TO HAVE
ECON PROGRAMS.
AND THERE'LL BE ONE TOOL TO USE.
THE TOOL IS ALSO BEING USED 
ACROSS THEENT  ENTERPRISE 
THE ENTERPRISE AND THE CENSUS 
PROGRAM YOU HEARD ABOUT THIS 
MORNING.
I MENTIONED THE ORG SEARCH.
WE HAVE A
CONTEXT TAB.
AND THERE'S OTHER ORGANIZATIONAL
CONTACTS SUCH AS FROM 
CONFERENCES, COMPANY VISITS AS 
WELL AS PHONE CALL.
A DROP DOWN ALLOWS TO YOU SELECT
CONTACTS FOR OTHER SURVEY WHICH 
IS IS HELPFUL IF YOU'RE TRYING 
TO FIND A CONTACT FOR YOUR 
PARTICULAR SURVEY.
WE HAVE ALL THE INTERACTIONS 
STORED IN THIS TOOL AND AUDIT 
TRAIL OF ALL INTERACTIONS 
INCLUDING INBOUND AND OUTBOUND 
PHONE CALLS AND REQUESTS AN SXUR
MESSAGES.
IT'S ALL INTERACTIONS IN ONE 
SINGLE TOOL WHICH IS SOMETHING 
WE DO NOT HAVE BEFORE.
AND WE HAVE INSTRUCTIONS, 
QUESTION, CONTENT, RESPONSE 
VARIABLES AND ATTRIBUTE AND THE 
LAYOUTS OF QUESTIONS BASED ON 
PRE DEFINED TEMPLATES
AND PATTERNS.
BENEFITS OF THE CENTURION 
SOLUTION.
IT'S WIDELY USED ACROSS THE 
CENSUS BUREAU RIGHT NOW BUT MOST
THE INSTRUMENT HARD CODED.
>> THIS IS TARA DUNLAP JACKSON.
FOLKS ON THE LINE PLEASE
MUTE YOUR PHONE.
>> I WAS SAYING A LOT OF THE 
APPLICATIONS TO THE CENSUS 
BUREAU RIGHT NOW ARE HARD CODED 
BUT THE SOLUTION OFFERS TO 
DYNAMICALLY RENDER THE SURVEY 
CONTENT WHICH IS GREAT FOR EN 
DURING BETWEEN PATHS AND FOR THE
ECON CENSUS WE HAD INDUSTRY 
SPECIFIC PATHS AND MANY HAD 
QUESTIONS AND THE ANALYST COULD 
ENTER ONCE AND SHARE IT BETWEEN 
PATHS.
IT ALSO ALLOWS FOR 
RESPONSE-DRIVEN INSTRUMENT.
WE CAN PUT BRANCHING AND SKIP 
PATTERNS AND THE CHANGES ARE 
RENDERED NIGHTLY.
AN ANALYST CAN MAKE A CHANGE AND
SPECIFY IT BE RENDERED FOR THE 
NEXT MORNING AND THE CHANGES ARE
THERE FOR THEM THE NEXT DAY.
THE SOLUTION ALSO PROVIDED A 
FULLY ONLINE ELECTRONIC 
INSTRUMENT OPPOSED TO THE 
DOWNLOADABLE SOFTWARE WE USED IN
PAST CENSUSS.
 -- CENSUSES.
AND THEY'RE TAKING TO THE 
REPORTING DASHBOARD TO VIEW THE 
SURVEYS THEY'RE ASKED TO 
COMPLETE.
THIS SPECIFIC EXAMPLE IS A 
MULTILOCATION COMPANY AND 
THERE'S MULTIPLE FORMS WE ASK 
THEM TO COMPLETE.
THE NAVIGATION BAR ACROSS THE 
TOP SHOWS THE RESPOND
JECT -- 
RESPONDENT WHERE THEY ARE AND 
THEY CAN VIEW A PDF OF THEIR 
SURVEY AND GO WITH A SURVEY VIEW
OPTION AND MULTILOCATION
OPTIONS AND WE HAVE LINK TO HELP
AND TUTORIALS TO SHOW DIFFERENT 
FUNCTIONALITY IN THE SYSTEM.
WE KNOW RESPONDENTS WANT TO KNOW
WHAT THEY'RE GOING TO BE ASKED 
AND HAVE A WORK SHEET.
WHAT WE WANT TO PREVENT IS 
RESPONDENTS PUTTING THE DATA ON 
IT AND USING IT AS A PAPER FORM 
TO SEND BACK TO US.
SO THIS IS THE SURVEY VIEW IN 
SEN TOUR ONAND THE RESPONSE -- 
CENTURION AND THIS TAKE THE 
RESPONDENT TO A PARTICULAR 
LOCATION.
AND THIS ALLOWS FOR RESPONDENTS 
TO JUMP BACK AND FORTH BETWEEN 
QUESTIONS THEY ANSWERED AND THE 
LAYOUT IS EN DERRED  RENDERED 
FROM THE COMMENT SYSTEM.RENDERED
FROM THE 
COMMENT SYSTEM.
WE HAVE WARNINGS AND WHAT THE 
TEXT OF THAT WERE OR WARNING 
SHOULD BE.
THE TEXT AT THE TOP SHOWS AN 
EXAMPLE OF AN ERROR DUE TO A 
FAILED EDIT.
THE BOTTOM SHOWS AN EXAMPLE OF A
WARNING.
THE DIFFERENCE BETWEEN THE TWO 
IS ULTIMATELY AT SUBMISSION, THE
RESPONDENT WILL NOT BE ABLE TO 
SUBMIT IF THEY HAVE ERRORS BUT 
WILL IF THEY ARE WARNINGS.
THEY'LL BE ABLE TO SEE THE 
REVIEW SCREEN WHERE THEY'LL BE 
HELD UP
DUE TO ERRORS.
SO I MENTIONED THE SPREAD SHEET 
REPORTING POPULATION THIS IS 
AVAILABLE FOR USERS WITH 
MULTIPLE LOCATIONS AN THEY CAN 
REPORT FROM MULTIPLE LOCATIONS 
AT ONE TIME AND USERS CAN TAKE 
IMPORTANT DATA FROM THEIR 
DATABASE TO OUR SPREAD SHEETS 
AND UPLOAD TO CENTURION TO SAVE 
TIME AND SOME ARE LARGE AND 
COMPLEX.
WE HAVE SOME WITH OVER 15,000 
LOCATIONS.
OBVIOUSLY THEY NEED A TOOL LIKE 
THIS TO REPORT RATHER THAN IT'S 
NOT FEASIBLE TO GO THROUGH THE 
SURVEY FORM BY FORM.
SO WE DO HAVE SOME EDITS THAT 
RUN UPON UPLOAD.
THE POP UP WILL NOTIFY THE USER 
IF WE HAVE VALUES WE NEEDED TO 
CHANGE OR NOT UPLOADED DUE TO 
ERRORS.
SO I MENTIONED BEFORE THE REVIEW
SCREEN, RESPONDENTS WILL BE 
SHOWED OUTSTANDING ERRORS OR 
WARNINGS THEY HAVE.
THE GREEN FIX BUTTON ON THE LEFT
ALLOWS THEM TO JUMP BACK TO THE 
SCREEN WHERE THE ERROR OR 
WARNING SO THEY CAN FIX THAT 
INFORMATION PRIOR TO SUBMISSION.
THIS IS THE SUBMISSION SCREEN.
IT PRE SELECTS SURVEYS COMPLETED
WITH NO ERRORS.
THE RESPONDENT CAN COMPLETE 
SURVEYS INDIVIDUALLY OR AT ONCE 
OR SUBMIT MULTIPLE TIMES IF 
CHANGES ARE NEEDED.
ONCE THE MISSION IS COMPLETE THE
RESPONDENT WILL GET SHOWN WHAT 
HAS BEEN SUBMITTED AND WHAT 
STILL NEEDS TO BE SUBMITTED AND 
THEY CAN BRING UP A PDF OF THEIR
RESPONSES AND THERE'S A LINK TO 
THE SURVEY WEBSITE.
IT SHOWS THEM TO THE WEBSITE 
WITH PREVIOUSLY RELEASED 
STATISTIC AND OTHER INFORMATION 
ABOUT CENSUS BUREAU STATISTICS.
WE'RE CLOSING OUT OUR ECON 
CENSUS OPERATIONS TODAY AND WE 
HAD A LITTLE OVER 2.7 MILLION 
RESPONSES THROUGH THIS TOOL FOR 
THE 2017 ECON CENSUS.
I MENTION THE RESPONSE PDF 
AVAILABLE TO USERS AFTER THEY 
REPORTED.
IT ALLOWS THEM TO PRINT OR SAVE 
ELECTRONICALLY FOR THEIR 
RECORDS.
THESE ARE THE QUESTIONS WE HAVE 
FOR THE COMMITTEE I THINK WE'LL 
TALK ABOUT IN A MOMENT.
THANK YOU VERY MUCH.
>> GREAT.
>> SO I KNOW WE'RE GOING HAVE TO
STOP IN A COUPLE MINUTES
FOR THE -- SO, FIRST I WANTED TO
THANK SHELLY AND LISA.
THIS WAS A LOT OF MATERIAL TO 
COVER IN A SHORT AMOUNT OF TIME 
AND THANK YOU FOR BEING CONCISE 
AND VERY INFORMATIVE.
TO REITERATE THE CONTEXT, WE'RE 
TALKING ABOUT A SWITCH IN THE 
MODE IN WHICH PEOPLE RESPOND AND
WHENEVER HAVE YOU A CHANGE IN 
THE WAY PEOPLE DO THINGS WHETHER
IT'S TECHNOLOGY OR PAPER, 
THERE'S ALWAYS GOING TO BE
RESISTANCE.
I SEE IT IN STUDENTS WHEN 
SNAPCHAT CHANGES THEIR INTERFACE
THERE'LL BE A RESPONSE.
TIME WILL MAKE THINGS BETTER AS 
PEOPLE BECOME USED TO THE NEW
MEDIUM.
THAT'S NATURAL.
WE'LL GET IN THE POSITIVES IN A 
SEC BUT IT'S NOT JUST ABOUT THE 
ECONOMIC CENSUS THERE'S OTHER 
SURVEYS BEING DELIVERED AS WELL.
I THINK IT'S AN IMPORTANT MOVE 
IN TERMS OF PROVIDING ONE 
LOCATION FOR EVERYTHING I'LL 
TALK ABOUT WHY THAT'S A VERY 
STRONG POSITIVE.
THERE'S A LETTER RECEIVED 
REQUESTING INFORMATION IN THE 
SURVEY.
THAT COULD BE HELPFUL IN TERMS 
OF SECURITY.
I THINK THAT'S ANOTHER GOOD 
FEATURE OF THE DESIGN.
AND OVERALL IT'S A GREAT 
OPPORTUNITY FOR SAVINGS AND 
GREATER GREATER SPEED ACCURACY 
AND RESPOND ENT
-- RESPONDENT INTERACTION.
>> IT'S NOW TIME FOR PUBLIC 
COMMENT.
FORGIVE ME FOR INTERRUPTING.
WE TAKE PUBLIC COMMENT IN 
WRITING AND BY PHONE AND THEY'RE
IN TWO MINUTES ANYTHING OVER 
THAT MAY BE SUBMITTED IN WRITING
FOR THE RECORD.
IF YOU'RE FOLLOWING VIRTUALLY 
AND WOULD LIKE TO MAKE A 
COMMENT, PLEASE DIAL, 
1-800-369-3137.
THAT'S 1-800-369-3137.
AND THE CODE OR PASSWORD IS
5000542.
LET ME REPEAT 
THAT, 5000542 FOLLOWED BY THE 
NUMBER SIGN.
>> MY APOLOGIES, TOMMY, IT COULD
BE MY TYPO.
>> IT'S 5000542 FOLLOWED BY THE 
NUMBER SIGN.
AND I'LL GIVE YOU TIME TO DIAL 
IN AND ASK FOR THOSE LAST.
WE HAVE
RECEIVED FIVE WRITE-INS.
WRITTEN SUBMISSIONS WERE 
RECEIVED FROM GEORGE WASHINGTON 
INSTITUTE OF PUBLIC POLICY.
STEVE PEARSON, NO AFFILIATION, 
AMANDA PEREZ, THE ORGANIZATION 
IS ZERO TO THREE.
NOW, DO WE HAVE ANYONE WHO WOULD
LIKE TO MAKE A COMMENT IN THE 
ROOM PRESENT?
IF SO, PLEASE PROCEED TO THE 
TABLE THERE ON THE SIDE OF THE 
ROOM NEAREST THE DOORS LABELLED 
PUBLIC COMMENT.
I UNDERSTAND THERE'S ONE PERSON 
AT LEAST WHO IS THERE AND
COMING FORWARD.
BEFORE MAKING YOUR COMMENT, 
PLEASE STATE YOUR NAME AND 
AFFILIATION CLEARLY.
>> HI, MY NAME IS AMANDA PEREZ 
AND I'M HERE FROM ZERO TO THREE 
A NATIONAL NONPROFIT WHO'S 
MISSION IS TO ENSURE ALL BABIES 
AND TODDLERS GET A STRONG START 
IN LIFE.
FOR AN ACTIVE MEMBER OF THE 
COUNT ALL KIDS COMMITTEE THE 
NATIONAL COMPLETE COUNT 
COMMITTEE FOR YOUNG CHILDREN.
THE CONSENSUS IS NOT ONLY A 
CRUCIAL DATA SOURCE FOR OUR WORK
IT DEFINES THE ALLOCATION AND 
AVAILABILITY OF A CENTRAL 
RESOURCES FOR VERY YOUNG 
CHILDREN AND THEIR FAMILIES 
ACROSS THE COUNTRY.
AS YOU KNOW IN 2010, THE YOUNG 
CHILDREN HAVE A HIGHER NET 
UNDERCOUNT THAN ANY OTHER 
DEMOGRAPHIC GROUP WITH 
SIGNIFICANT IMPLICATIONS FOR 
INFANT AND TODDLERS ACROSS THE 
COUNTRY.
EVEN WORSE, BECAUSE THE CHILDREN
MISSED MOST OFTEN WERE CHILDREN 
OF COLOR, CHILDREN WHO ARE 
ALREADY DISPROPORTIONATELY POOR 
AND UNDER RESOURCED WERE LIKELY 
TO GET LESS THAN THEIR SHARE OF 
DOLLARS AND SERVICE.
THE RISK OF A SIGNIFICANT CHILD 
UNDER COUNT IN 2020 IS GREATER 
NOW THAT THOUSANDS OF IMMIGRANT 
FAMILIES WILL BE AFRAID TO 
RESPONSE TO THE CENSUS BECAUSE 
IT WILL INCLUDE THE CITIZENSHIP 
QUESTION.
TODAY'S BABIES WILL BE 
TOMORROW'S CENSUS TAKES AND CSAC
MEMBERS TO LET'S USE THE TOOLS 
WE HAVE TO GIVE THEM THEIR NEXT 
BEGINNING.
WE URGE THE CSAC TO ADDRESS THE 
CHALLENGES HISTORIC UNDER COUNT 
OF YOUNG CHILDREN AND URGE STAFF
TO MEET THOSE CHALLENGES.
ESPECIALLY IN TWO WAYS.
FIRST, IN THE 2010 CENSUS THE 
RESULTS OF THE DUAL SYSTEM 
ESTIMATES METHOD GREATLY 
UNDERESTIMATE THE COUNT OF YOUNG
CHILDREN.
WE HOPE TO SEE THIS ISSUE 
BROUGHT FOR ADVICE AS WE BELIEVE
MEMBERS OF THIS COMMITTEE BRING 
KEY EXPERTISE TO MAKE SURE IT'S 
ADDRESSED IN
2020.
SECOND, THE DEMOGRAPHIC DATA WAS
NOT RECEIVED UNTIL 2018 FOR THE 
2010 CENSUS.
HAVING THIS DATA AVAILABLE IN A 
MORE TIMELY FASHION WOULD HELP 
ADVOCATESADVOCATES LIKE ME 
BETTER INTERPRET THE NUMBERS.
CSAC CAN PLAY AN ESSENTIAL ROLE.
THANK YOU SO MUCH FOR GIVING ME 
THE OPPORTUNITY AND MORE 
IMPORTANTLY FOR THE RECOGNITION 
THAT AMERICA'S BABIES ARE 
AMERICA'S POTENTIAL AND MORE 
THAN JUST NUMBERS
IN A DATA SET.
>> TOMMY WRIGHT.
THANK YOU, ARE THERE OTHER 
MEMBERS IN THE ROOM TO GIVE 
COMMENT?
SEEING NONE, THANK YOU.
NOW, ARE THERE ANY PUBLIC 
COMMENTERS ON THE PHONE?
>> THERE ARE NONE.
>> THANK YOU VERY MUCH.
WE WILL NOW PROCEED WITH JUAN 
PABLO DISCUSSING THE ECONOMIC 
INTERNET SELF-RESPONSE 
EXPERIENCE.
JUAN PABLO.
>> SO WE'RE GETTING TO MANY OF 
THE POSITIVES WITH THE NEW 
APPROACH.
SOME OF THEM ARE THE SAME REASON
WHY WE'RE DOING INTERNET 
SELF-RESPONSE FOR THE DECENNIAL 
CENSUS AND THERE'S SAVINGS IN 
NOT MANAGING PAPER AND MORE 
CONVENIENT FOR IN RESPONDENTS 
ESPECIALLY FOR THOSE WHO HAVE 
DATA ELECTRONICALLY ALREADY AND 
JUST COPY IT OVER AND HAVING 
SPREAD SHEETS MAY MAKE THINGS 
SIMPLER FOR MANY RESPONDENTS.
HAVING ONE PLACE TO MANAGE ALL 
SURVEYS, THAT IS AN ACCIDENT 
FEATURE OF THIS
APPROACH.
ONE WAY IT'S HELPFUL IS TO BRING
CONSISTENCY TO THE RESPONDENT 
EXPERIENCE THROUGHOUT ALL THE 
SURVEYS.
THEY'LL KNOW WHAT TO EXPECT AS 
THEY MOVE FROM ONE SURVEY TO 
ANOTHER WHAT TO LOOK FOR.
THEY'LL BE USED TO THE USER 
INTERFACE.
IT'S ALSO AN IMPROVEMENT IN 
SECURITY.
YOU'RE MAKING IT MORE LIKELY FOR
PEOPLE TO KNOW WHERE TO GO TO 
FILL OUT SURVEYS.
IT'S A
DOUBLE WIN THERE.
A RELATIONSHIP MANAGEMENT TOOL, 
HAVING CONSISTENCY AND THIS 
SHOULD ENABLE YOU TO DO THAT.
FINALLY, THE COMBINATION OF 
CENTURION SHOULD ALSO HELP 
IMPROVE AND MAKE IT EASIER TO 
IMPROVE USER EXPERIENCE OVER 
TIME AND ALSO REDUCE THE TIME TO
PRODUCE NEW SURVEYS OR
MAKE CHANGES.
THE ADVANTAGE IS THERE IF YOU 
IDENTIFY CHALLENGE THE SURVEY OR
THE WAY YOU WERE DELIVERING 
SURVEYS YOU CAN FIX IT IN ONE 
PLACE INSTEAD OF HAVING TO FIX 
IT IN 10 PLACES.
IT SHOULD MAKE IT LESS EXPENSIVE
TO MAKE THOSE CHANGES AND MORE
EFFECTIVE.
NOW TO ANSWER YOUR QUESTIONS.
THE FIRST QUESTIONS
WERE ABOUT SECURITY.
AND I'LL GIVE  -- I'M NOT A 
SECURITY RESEARCHER BUT MORE 
AWARE OF SECURITY THAN OTHER 
FOLKS AS A COMPUTER SCIENTIST.
THE WAY I TRY TO EXPLAIN IT TO 
FOLKS WHO DON'T DO SECURITY OR 
COMPUTER SCIENCE IS IT'S BASED 
TYPICALLY ON SOMETHING YOU KNOW 
OR SOMETHING YOU HAVE OR 
SOMETHING YOU ARE.
SO SOMETHING YOU KNOW WOULD BE 
TYPICALLY PASS WORDS OR THE 
ANSWERS TO THOSE SECURITY 
QUESTIONS.
SOMETHING HAVE YOU MAY BE YOUR 
PHONE OR COULD BE ACTUALLY THE 
LETTER WITH THE CODE WE GET
FROM THE CENSUS BUREAU.
SOMETHING THAT'S BIOMED -- 
BIOMETRIC.
AND THAT'S NOT SOMETHING THE 
CENSUS WILL BE DOING SOON SO 
WE'LL TAKE THAT OUT.AND THAT'S 
NOT SOMETHING THE CENSUS WILL BE
DOING SOON SO WE'LL TAKE THAT 
OUT.
THAT'S WHAT SECURITY IS BASED ON
AND E-MAIL AS A USER NAME IS A 
GOOD IDEA AND YOU MAY SUGGEST 
PEOPLE USE THEIR E-MAIL ADDRESS 
AND SOME PEOPLE MAY NOT DO THAT.
SECURITY QUESTIONS ARE TRICKY 
JUST FROM PERSONAL EXPERIENCE 
AND FROM WHAT A HEAR FROM FAMILY
AND FRIENDS IT'S HARD TO FIND 
SECURITY QUESTIONS ONE ANSWER IS
USING PART OF YOUR SECURITY 
QUESTIONS BECAUSE THEY SHOULD 
KNOW THAT OR CAN LOOK IT UP AT 
LEAST.
THAT'S COULD
BE A POSSIBILITY.
I KNOW YOU DIDN'T TALK ABOUT IT 
SO MAYBE IT'S THERE, BUT IF IT'S
NOT IMPLEMENTED I WOULD 
ENCOURAGE AT LEAST IMPLEMENTING 
THE TWO-FACTOR AUTHENTICATION IN
LIEU OF UPDATING PASSWORDS 
PERIODICALLY WHERE IF SOMEONE 
OBTAINS A PASSWORD THEY STILL 
WON'T BE ABLE TO GET IN IF 
YOU'RE SUPPOSED TO GET A TEXT ON
YOUR PHONE OR SOMETHING LIKE 
THAT.
THAT'S A
RECOMMENDATION.
IN TERMS OF PASSWORD EXPIRATION,
I LOOKED UP THE LATEST
GUIDELINES AND THAT'S WHAT THEY 
SAY I JUST COPIED AND PASTED 
FROM THEIR RECOMMENDATIONS AND 
PROVIDED A LINK THERE VERIFIERS 
SHOULD REQUIRE THEM TO BE CHANGE
ARBITRARILY BUT THERE COULD BE 
EVIDENCE OF THE COMPROMISE OF 
THE AUTHENTICATOR.
PLAIN LANGUAGE DOESN'T 
NECESSARILY GIVE YOU MORE 
SECURITY TO ASK PEOPLE TO CHANGE
THEIR PASSWORD EVERY 90 DAYS BUT
IF THERE'S SIGNS OF COMPROMISE 
THEY SHOULD BE FORCED TO CHANGE 
IT IMMEDIATELY.
SO YOU HAVE TO REQUIRE STRONG 
PASS WORDS INITIALLY.
PASSWORDS NOT USED ELSEWHERE.
SOME THINGS SOME PLACE DOING AND
I DON'T KNOW IF IT'S WITHIN THE 
BUDGET OF THE CENSUS BUREAU OR 
THE ABILITY TO DO IT IS TO DO 
DARK WEB SEARCHS FOR PASSWORDS 
ASSOCIATED WITH THE E-MAIL 
ADDRESSES IN THE ACCOUNTS AND 
SEE IF ANY
OF THOSE BREAK INTO THE SYSTEM 
AND THAT MAKES THE ACCOUNT TO BE
RESET.
I DON'T KNOW IF THAT'S WITHIN 
THE REALM OF POSSIBILITIES BUT I
KNOW THAT'S SOMEWHAT OF PEOPLE 
ARE TRYING TO DO RIGHT NOW TO 
INCREASE PASSWORD SECURITY.
AGAIN, YOU IF YOU HAVE TWO 
FACTOR AUTHENTICATION IT GIVES 
AN EXTRA
LAYER OF SECURITY PASSWORDS 
ALONE CAN'T PROVIDE.
YOU HAVE THE UNIQUE CODE IN THE 
LETTER BECAUSE IT ALSO TELLS YOU
THEY DID RECEIVE THIS.
AND IT MAKES IT MORE LIKELY 
YOU'RE INTERACT 
THE RIGHT PERSON.
ONE THING I DIDN'T MENTION IN 
THE SLIDE AS YOU SEND OUT THE 
LETTERS, IT'S A GREAT 
OPPORTUNITY TO EDUCATE 
RESPONDENTS ON FISHING RISKS.
I DON'T KNOW THERE'S A BROCHURE 
OR SOMETHING IN THERE THAT SAYS 
WE'LL ONLY ASK YOU ENTER SURVEY 
RESPONSES AT
PORTAL.CENSUS.gov SO IF YOU GO 
THERE AND THEY GET ANY OTHER 
KIND OF REQUEST TO PROVIDE 
INFORMATION SOME WHERE ELSE, 
HOPEFULLY
THEY'LL BE SKEPTICAL.
RISK OF DECLINE AND RESPONSE WAS
ANOTHER
AREA.
AND SO I HAVE A FEW IDEAS HERE.
ONE WOULD BE TO TRY TO IDENTIFY 
ANY PROFILE OF BUSINESSES THAT 
ARE HAVING A MORE DIFFICULT TIME
RESPONDING OR WHERE RESPONSE 
RATES ARE LOWER AND THERE'LL BE 
AN OPPORTUNITY TO ENGAGE WITH 
THOSE COMMUNITYES AND UNDERSTAND
HOW TO REDESIGN THE PROCESS OR 
DO MORE OUTREACH TO
THOSE COMMUNITIES.
I KNOW YOU DIDN'T HAVE TIME TO 
TALK ABOUT THIS BUT OPTIMIZING 
USER EXPERIENCES IN MOBILE 
DEVICES MAY HELP SOME FOLKS WHO 
MAY NOT HAVE AS MANY COMPUTER 
RESOURCES IN THEIR BUSINESS OR 
MAY NOT BE AS COMPUTER LITERAL.
THEY'RE MORE LIKELY TO HAVE 
MOBILE DEVICES THEY CAN USE TO 
FILL THINGS OUT.
THIS IS MORE OF A PIE IN THE SKY
IDEA BUT MAYBE CONSIDER 
PROVIDING SOME KIND OF IMMEDIATE
REWARD FOR PEOPLE AFTER FILLING 
OUT THE SURVEY.
I KNOW NOW THERE'S A LINK TO THE
REPORT AT THE
BUREAU AND IT MAY BE POSSIBLE TO
REACH OUT TO THEIR BUSINESS 
SECTOR AND HAVE IT AVAILABLE IN 
THE SAME PORTAL.
MAYBE IT CAN PROVIDE A QUICK 
VALUE OR SOME IMMEDIATE WAY OF 
SEEING HOW THEIR DATA RESULTS IN
SOMETHING THAT MIGHT BE
USEFUL TO THEM.
THERE MAY BE A NUMBER OF 
STRATEGIES FOR ADDRESSING GROUPS
OF BUSINESSES THAT MAY HAVE A 
DIFFICULT TIME RESPONDING.
AND SO YOU MIGHT CONSIDER VIDEO 
TUTORIALS IF WE'RE TALKING ABOUT
LOW CONSIDER LITERACY 
POPULATIONS, FOR EXAMPLE.
ONE MORE THING, I SHOULD HAVE 
SAID THIS FIRST.
I THINK THE KEY ASPECT IN 
GETTING RESPONSES AND GETTING
PEOPLE TO CONTRIBUTE IS TO 
EMPHASIZE USER EXPERIENCE 
USABILITY.
IT'S GOING TO BE CRUCIAL FOR THE
WAY THEY PERCEIVE THE CENSUS 
BUREAU AND FOR THE LIKELIHOOD TO
MOVE ON AND PROVIDE INFORMATION.
WE TALKED ABOUT EFFICIENCY AND 
BE ABLE TO USE TECHNOLOGY AND A 
COMPANY TOLD ME EVERY ADDITIONAL
WEB PAGE PEOPLE HAVE TO GO 
THROUGH BEFORE THEY PURCHASE THE
SERVICE COSTS THEM MORE THAN A 
QUARTER OF THE PEOPLE
WHO WOULD VISIT THE WEBSITE.
NOT HAVING TO GO TO THE SHOPPING
CART TO MAKE THE DECISION TO BUY
GIVES THEM MORE
BUY.
EVERY CLICK YOU SAVE GETS YOU 
MORE RESPONSES.
EFFICIENCY,
EFFECTIVENESS AND LEARNABILITY 
IS WHERE YOU CAN MAKE A 
DIFFERENCE IN THE LONG TERM.
THE GREAT THING IS YOU NOW HAVE 
ONE PLATFORM.
IF YOU FIX IT IN THE PLATFORM 
YOU'LL IMPROVE THINGS FOR ALL 
YOUR SURVEYS.
SO THAT'S A BIG PLUS WITH THIS
NEW APPROACH.
AND WE'LL HAVE A GOOD POLICY FOR
THE BUREAU NOT JUST FOR THE 
ECONOMIC CENSUS SURVEYS.
AND THINK ABOUT AND WAYS OF 
THINK ABOUT IMMEDIATE REWARDS TO
RESPONDING AND WE MAY NOT SEE A 
REWARD OR PAYOFF IN RESPONDING 
TO THE SURVEYS.
AND I HAD MORE QUESTIONS BUT I 
KNOW YOU HAD A CHANCE TO SEE 
THEM BEFORE SO YOU ANSWERED THEM
ALL.
WE WON'T GO INTO THAT SLIDE.
I'LL STOP HERE AND OPEN IT UP 
FOR ANY RESPONSES
OR DISCUSSION.
>> THANK YOU, I APPRECIATE IT.
ONE THING WE'RE REALLY LOOKING 
INTO IS REWARDS.
THE MOTIVATION AND RESPONSE IN 
USING THE DATA AND THE OUTREACH 
EFFORTS HAVE BEEN FOCUSSED.
IT BECOMES POWERFUL HAVING THE 
E-MAIL ADDRESSES OF SURVEY 
RESPONDENTS WE THAT WE COULD 
IMMEDIATELY AS SOON AS THEY 
AUTHENTICATE AND KNOW WHAT 
PROGRAM THEY'RE IN, SEND THEM 
THAT NUGGET OR FACTOID THAT 
WOULD BE SOMETHING THAT MIGHT 
VOTE VATE THEM TO GET IN -- 
MOTIVATE AND GET IN AND RESPOND 
TO THE PROGRAM.
THAT'S SOMETHING WE'RE LOOKING 
INTO AND APPRECIATE THE REUP 
FORCEMENTFORCEMENT  -- 
REENFORCEMENT
WITH THAT.REENFORCEMENT WITH 
THAT.
>> KEN SIMONSON CSAC.
DID THE FEDERAL GOVERNMENT 
SHUTDOWN EFFECT RESPONSE OR 
PROCESSING AT ALL ON THIS CENSUS
SURVEY?
>> WE ACTUALLY WERE ABLE TO KEEP
OUR TOOL OPEN DURING THE 
SHUTDOWN I THINK WE GOT ABOUT 2%
RESPONSE OVER THAT TIME.
WE WERE NOT ABLE TO DO ANY 
FOLLOW-UP OPERATIONS.
THE CENTERS WERE NOT STAFFED.
WE HAVE ACCOUNT MANAGERS THAT 
SUPPORT OUR LARGEST COMPANIES 
AND THEY WERE NOT AVAILABLE TO 
HANDLE PHONE CALLS.
WE DID END UP
PUSHING OUT BECAUSE OF THE
SHUTDOWN.
WE'VE BEEN ABLE TO IN THE LAST 
FIVE WEEKS PUT EXTRA EFFORTS IN 
THE AREAS TO TRY TO
GET RESPONSE IN.
>>
OF RESPONSE TO PREVIOUS
CENSUSES AND RESPONSE?
>> FOR RESPONSE WE FINISHED WITH
A 75%
WHICH WAS OUR GOAL.
WE HAD THE SHUTDOWN AND DUE TO 
BUDGET WE E-MAILED SIX MONTHS 
LATER THAN NORMAL.
WE HAD TO REPLAN A LOT OF THINGS
DUE
TO COST CUTS.
IT'S ALL ELECTRONIC.
THERE WERE A LOT OF FACTORS THAT
COULD HAVE IMPACTED THAT.
IN TERMS OF DATA QUALITY, WE'RE 
STILL LOOKING INTO THAT.
IMMEDIATELY THERE'S THE OBVIOUS 
THINGS COLLECTED ELECTRONICALLY.
LAST TIME I THINK WE GOT 53% 
ELECTRONIC RESPONSE SO LOTS OF 
FOLKS STILL USED PAPER.
SOMETIMES WE'D GET BLANK FORMS 
OR THINGS MISSING AND WE WERE 
ABLE TO BUILD THAT IN.
THE ERRORS WE TALKED ABOUT 
THEY'RE NOT ALLOWED TO SUBMIT IF
THEY DON'T GIVE OPERATIONAL 
STATUS IN THEIR RECEIPT.
THE FACT WE HAVE AUTO SUMS BUILT
KNEE  -- INTO THE TOOL HELP WITH
US THE DATA QUALITY BECAUSE 
THEY'RE NOT ABLE TO JUST PUT 
JUNK ON PAPER AND
SEND IT TO US.
I DON'T KNOW HOW MUCH IT'S HELP.
>> TOMMY WRIGHT.
WE'RE GIVE THE INTERRUPTION.
WE HAVE LEARNED THERE WAS ONE 
PERSON ON THE LINE AND WE'RE 
GOING GIVE THEM AN OPPORTUNITY 
TO MAKE A PUBLIC COMMENT.
IF YOU'RE ON THE LINE, STATE 
YOUR NAME AND AFFILIATION.
>> ANDREW REAMER RESEARCH 
PROFESSOR AT GEORGE WASHINGTON 
INSTITUTE OF PUBLIC POLICY AT 
GEORGE WASHINGTON UNIVERSITY.
SHALL I GO AHEAD AND MAKE MY 
COMMENT?
>> YES, PLEASE.
>> SO I DID SEND AN E-MAIL 
YESTERDAY WHICH PERHAPS YOU HAVE
THE CONTENTS IN FRONT OF YOU AND
THANK YOU, TARA, FOR POSTING 
THAT ONLINE.
IN SUMMARY, THE CENSUS BUREAU 
SUBMITTED TO THE OFFICE OF 
MANAGEMENT AND BUDGET AN 
INFORMATION COLLECTION REQUEST 
FOR THE 2020 CENSUS WHICH IS THE
NORM OMB HAS TO APPROVE THE 
CENSUS REQUEST SO THE FORM CAN 
GO IN THE FIELD.
IN THE SUPPORTING STATEMENT FOR 
THAT INFORMATION COLLECTION 
REQUEST IS THE PARAGRAPH 
JUSTIFYING THE INCLUSION OF THE 
CITIZENSHIP QUESTION.
SO IN THE PARAGRAPH I HOPE HAVE 
YOU BEFORE YOU, THERE'S A 
SENTENCE THAT SAYS THE CENSUS 
BUREAU HAS IDENTIFIED NO 
CREDIBLE QUANTITATIVE EVIDENCE 
THAT THE ADDITIONAL OF A CITIZEN
QUESTION WOULD UNDER CUT THE 
CENSUS AND THIS IS JUSTIFICATION
FOR THE INCLUSION OF THE 
QUESTION IT WON'T CAUSE A 
PROBLEM.
I NOTICE THAT LANGUAGE IS 
SIMILAR TO LANGUAGE IN THE 
SECRETARY'S LETTER OF A YEAR AGO
MAKING THE DECISION TO INCLUDE 
THE CITIZENSHIP QUESTION.
SO SEEING THAT IN THE SUPPORTING
STATEMENT AND SEEING THE 
PARALLELS IN LANGUAGE WITH THE 
SECRETARY'S LETTER LET ME TO A 
FEW CONCLUSION.
I HAVE A REQUEST FOR THE 
COMMITTEE.
ONE IS WOULD THE COMMITTEE 
PROVIDE AN OPINION TO THE CENSUS
BUREAU REGARDING ITS SENSE.
IS THAT BOLDED STATEMENT 
CONSISTENT WITH SCIENTIFIC 
PRINCIPLES IN GENERAL AND WITH 
THE CENSUS BUREAU'S INFORMATION 
STATISTICAL QUALITY STANDARDS IN
PARTICULAR?
THE O.M.B. GUIDELINES DESIGNATE 
THE CENSUS BUREAU'S CHIEF 
INFORMATION OFFICER WHO I 
BELIEVE IS KEVIN SMITH TO 
ADDRESS ISSUES LIKE THIS.
I THOUGHT IT WOULD BE USEFUL TO 
GET A WRITTEN STATEMENT FROM HIM
REGARDING THE CONSISTENCY 
BETWEEN THAT STATEMENT IN THE 
CENSUS BUREAU'S SUBMISSION TO 
O.M.B. AND THE INFORMATION 
QUALITY GUIDELINES CENSUS BUREAU
USES.
AND THEN THE OTHER OBSERVATION 
IS THAT BECAUSE AT LEAST IN MY 
EXPERIENCE, THAT KIND OF 
STATEMENT FROM THE CENSUS BUREAU
TO O.M.B. JUSTIFYING THE DESIGN 
OF A SURVEY IS NOT THE NORM AND 
I CAN'T IMAGINE WHICH 
PROFESSIONAL STAFF WROTE THAT.
IT OCCURRED TO ME IT'S PROBABLY 
LIKELY SOMEONE ON THE POLITICAL 
STAFF AT THE CONGRESS DEPARTMENT
WROTE THAT.
IT WOULD BE A QUESTION FOR THE 
COMMITTEE TO ASK THE CENSUS 
BUREAU TO IDENTIFY THE AUTHOR OF
THAT PARTICULAR PARAGRAPH.
IT MAY BE SOMEONE ON THE 
PROFESSIONAL SIDE OF THE CENSUS 
BUREAU.
AGAIN, IT'S A QUESTION, IS THAT 
CONSISTENT WITH CENSUS BUREAU 
PRINCIPLES AND PRACTICES BUT IF 
IT IS SOMEONE OUTSIDE THE CENSUS
BUREAU I RAISE THE LAST 
OBSERVATION WHICH IS WHAT IS 
THIS COMMITTEE'S SENSE OF THE 
CONSISTENT OR ADHERENCE OF THE 
CENSUS BUREAU TO PRESENCE
PRINCIPLES AND PRACTICE 
INSTITUTIONS OF POLITICAL 
INDEPENDENCE AND REGARDING 
COMMITMENT TO SCIENTIFIC 
INTEGRITY.
THAT IS MY STATEMENT TO THE 
COMMITTEE.
IF HAVE YOU QUESTIONS FOR ME, 
I'M HAPPY TO ANSWER THEM
BUT I'LL STOP HERE.
>> YOUR FULL STATEMENT IS ON THE
COMMITTEE'S WEBSITE THANK YOU 
VERY MUCH.
>>
THANK YOU FOR THE OPPORTUNITY.
>> THANKS FOR THE INTERRUPTION.
>>  KEN.
I GO BACK TO THE LESSONS LEARNED
TO BE SHARED OR SHARED.
WHERE THERE THINGS YOU FEEL 
SHOULD HAVE BEEN DONE 
DIFFERENTLY?
THINGS YOU DIDN'T GET TO BECAUSE
OF FUNDING TIME OR OTHER REASONS
YOU WANT TO INCORPORATE NOW.
AND ARE THERE THINGS THAT YOU 
CAN SHARE WITH YOUR COLLEAGUES 
DOING OTHER SURVEYS OR OTHER
PROCESSING OR
SECURITY MEASURES.
>> SO JUST TO START, ONE OF THE 
THINGS WE HAVE AS LESSONS 
LEARNED IS LOOKING AT THE DATA.
WE'RE JUST GETTING INTO SOME OF 
THE DETAILS FROM THE 2017 
ECONOMIC CENSUS.
WE'RE SEEING THAT RESPONDENTS 
DID HAVE DIFFICULTIES WITH SOME 
OF THE PASSWORD RESETS.
WE HAD AN INFLUX OF CALLS TO THE
CALL CENTER AND MANY WERE NOT 
SUBJECT MATTER RELATED.
THEY WERE RELATED TO THE 
TECHNOLOGY AND ISSUES PEOPLE 
WERE ACTUALLY HAVING GETTING 
INTO THE SYSTEM.
I THINK WE HAVE LESSONS LEARNED 
THERE.
THAT'S WHY WE WERE PARTICULARLY 
INTERESTED IN THE COMMITTEE'S 
GUIDANCE ON SECURITY OR ANY 
RECOMMENDATIONS WE HAD THERE.
WE WORK CLOSELY WITH OUR OFFICE 
OF INFORMATION SECURITY TO 
IMPLEMENT AND INTERPRET THE 
GUIDELINES AS APPROPRIATE.
I THINK WE DEFINITELY SAW SOME 
OBSTACLES AND BARRIERS 
PARTICULARLY AROUND THE LOGGING 
IN PROCESS.
THE RESET OF THEIR PASSWORD.
THE USE OF THEIR SECURITY 
QUESTIONS.
MANY RESPONDENTS OPTED TO GO 
DOWN THE PATH WHERE THE E-MAIL 
RESET WAS SENT TO THEM DIRECTLY 
AND THEY REAUTHENTICATED AND 
RESET IT RATHER THAN USING THE
SECURITY QUESTIONS.- 
AUTHENTICATED AND RESET IT 
RATHER THAN USING THE SECURITY 
QUESTIONS.AUTHENTICATED AND 
RESET IT RATHER THAN USING THE 
SECURITY QUESTIONS.
THEY HAVE TO BE MORE THAN FOUR 
CHARACTERS AND THERE NEEDS TO BE
CAPITALS AND IT SEEMS 
STRAIGHTFORWARDFUL YOU GO
-- 
STRAIGHTFORWARD UNTIL YOU HAVE 
TO GO BACK AND REMEMBER THE 
DOG'S NAME.
WE JUST SHARED DATA WITH OUR 
SENIOR LEADERSHIP AND 
DIRECTORATE AND WE'LL BE USING 
THAT.
I THINK THE USER EXPERIENCE IS 
THE DIRECTION WE
WANT TO HEAD.
WE KNOW WHERE IT PROVIDES 
BARRIERS THERE'S LIMITED 
RESPONSE AND WE'RE
SENSITIVE TO THAT.
>> YOUR EXPERIENCE -- I'M CATHY 
PETIT.
SORRY.
YOUR EXPERIENCE WITH THE 
TURNOVER ISSUE BECAUSE WE 
IMPLEMENTED SALES FORCE TOO SO 
KEEPING THAT UP TO DATE AND 
HAVING THE CONTACT E-MAIL IF THE
PERSON IS NO LONGER THERE, HOW 
IS THAT IDENTIFIED?
DISABLED?
AND WEN  -- WHEN YOU GET BOUNCE 
BACKS?
YOUR PROCEDURES AND HOW THIS HAS
AFFECTED THOSE PIECES
AS PEOPLE TURNOVER OR LEAVE 
COMPANIES WHICH I ASSUME HAPPENS
ALL THE TIME.
>> I'LL START AND SHELLY 
CONDITION FINISH.
THE DELEGATES ARE ALLOWED TO 
MANAGE.
IF I DELEGATE TO YOU AND THEN 
YOU LEAVE, I'M ABLE TO DISABLE 
ACCOUNTS.
IT'S BUSINESS MAINTAINING.
THEY CAN SEE WHO STILL HAS AN 
ACTIVE ACCOUNT AND WHO HASN'T 
ACTUALLY WENT IN AND VALIDATED 
THEIR E-MAIL AND ESTABLISHED 
THEMSELVES SO THEY CAN
PING THEIR COLLEAGUES.
I THINK THAT'S THE MAIN WAY.
>> IF WE HAVE SITUATIONS WHERE 
SOMEBODY LEAVES THE COMPANY OR 
ON AN EXTENDED LEAVE, WE HAVE 
WAYS TO GET SOMEBODY ELSE WITHIN
THAT COMPANY ACCESS TO THE TOOL.
WE CAN DELEGATE FOR THEM.
DELEGATE THAT SURVEY SO IT'S NOT
LIKE THEY'RE LOST SINCE THAT 
CODE HAS EXPIRED.
>> DO YOU ENCOURAGE COMPANIES TO
HAVE A DELEGATE?
HAVE YOU TWO CONTACT FOR EACH 
COMPANY?
>> WE ENCOURAGE THEM TO USE THE 
DELEGATION RATHER THAN LIKE 
SHARING ACCOUNTS AND
THINGS LIKE THAT.
ONE THING WE HAVE LEARNED IS WE 
NEED TO DO A BETTER JOB OF 
SHOWING THEM THAT TOOL IN OUR 
DEBRIEFINGS AND STUFF.
IT WAS OBVIOUS SOME COMPANIES 
DIDN'T KNOW THEY HAD ACCESS TO 
DOING THAT AND THAT'S ONE THING 
WE WANT TO IMPLEMENT IN THE 
FUTURE BECAUSE IT'S A POWERFUL 
THING THEY CAN SHARE BETWEEN 
OTHERS AND THEIR COMPANY WHEREAS
BEFORE THEY DIDN'T
HAVE THAT OPTION.
WE DEFINITELY WANT TO MAKE FOLKS
AWARE THAT'S SOMETHING THEY 
SHOULD BE USING.
MY COMPANY FILLED THAT OUT AND 
WE HAD A GREAT
TIME DOING THAT.
>> JUST A COUPLE QUICK 
QUESTIONS.
OF THE 25 PERSON THAT DID NOT 
RESPOND DID YOU HAVE DATA ON HOW
MANY STARTED ON THE PROCESS BUT 
THEN GAVE UP AND DO YOU HAVE 
DATA ON WHETHER THERE WERE 
BIASES AND WHAT TYPES OF 
BUSINESSES RESPONDED AND NOT 
RESPONDED.
WAS IT SMALLER BUSINESSES HAD A 
HIGHER RATE OF NON RESPONSE
AND THINGS LIKE THAT?
>> YOUR FIRST QUESTION ABOUT 
FOLKS THAT STARTED AND THEN 
DIDN'T, WE DID SEND E-MAILS 
THROUGHOUT THE PROCESS TO FOLKS 
WHO HAD BURNED THAT 
AUTHENTICATION CODE MEANING THEY
START THE PROCESS BUT NEVER 
COMPLETED IT.
THE LAST E-MAIL WE SENT THERE 
WERE ABOUT 130,000 OUT THERE 
THAT HAD GOTTEN INTO THE SURVEY 
BUT NEVER COMPLETED IT.
WE DO HOPE TO USE E-MAIL FURTHER
IN THE FUTURE.
RIGHT NOW WE'RE LIMITED TO ONLY 
USING IT SINCE IT WAS THE FIRST 
TIME WE DID THE CENSUS WITH THE 
SYSTEM.
WE ONLY HAD E-MAIL ADDRESSES FOR
FOLKS THAT HAD ACTUALLY STARTED 
IT.
SO THAT'S HOW WE USED THE E-MAIL
BUT IN THE FUTURE WE'D LIKE TO 
USE IT MORE WIDELY.
AND I'M SORRY, WHAT WAS THE 
SECOND QUESTION?
>> WERE THERE SPECIFIC -- 
>> WE
ACTUALLY SAW PART COULD BE THE 
COLLECTION CYCLE WAS SHORTER IN 
2012 BECAUSE OF THE MAIL OUT.
THE LARGE COMPANIES AND SMALL 
COMPANIES ARE DOWN ACROSS THE 
BOARD.
IT WASN'T ALL -- EVEN THE 
LARGEST COMPANIES ARE DOWN ABOUT
10% AND THOSE ARE THE ONES THAT 
HAVE THE HAND HOLDING ACCOUNT 
MANAGER SUPPORT FROM
ANALYSTS.
MISSION
-- ANYTHING ELSE?
>> THANK YOU, THAT CONCLUDES
THAT SESSION.
WE ARE RIGHT NEAR 11:30 AND 
COMMITTEE MEMBERS, I GUESS WE'LL
GET LUNCHES AS WE DID YESTERDAY 
AND RETURN HERE.
>> YES.
>> WE CAN GO GET LUNCH AND 
JESSICA IS WRITING UP 
RECOMMENDATIONS ON PARTNERSHIP 
SO IF HAVE YOU ANYTHING FOR HER 
GIVE IT TO HER AND JEFF IS 
WRITING UP INFORMATION ON THE 
INCOME AND HEALTH INSURANCE 
MEASURES AND THEN JUAN PABLO IS 
WRITING UP RECOMMENDATIONS ON 
THE SESSION WE JUST HEARD SO 
GIVE ANYTHING YOU HAVE TO HIM AS
WE'RE EATING LUNCH AND AS SOON 
AS YOU ALL CAN GET THOSE TO ME 
WE'LL COMPILE IT AND DISCUSS IT.
>> DO YOU WANT TO SET A TARGET 
TIME FOR COMING BACK FOR 
DISCUSSION?
>> YEAH.
WE SHOULD START DISCUSSION BY 
10:00 BUT LET'S AIM FOR 12:30 IF
POSSIBLE.
WE HAVE TO GET OUT OF HERE AT 
2:00.
DOES ANYBODY HAVE TO LEAVE 
EARLY?
NO?
YOU GUYS ARE THE BEST.
IT'S A GREAT COMMITTEE.
SO LET'S AIM FOR 12:30.
THANK YOU.
I'LL CALL IN AT 12:30 FOR 
DISCUSSION IF THAT WORKS.
>> GREAT.
THANK YOU.
WE SEE YOU'RE IN THE ROOM 
VIRTUALLY.
THE MEMBERS ARE STILL 
DELIBERATING AND THE DISCUSSIONS
HAVE NOT BEGUN SO WE'LL TRY TO 
GET THE PROBLEM FIXED SO YOU CAN
TAKE PART.
THANK YOU.
>> YES.
>> CAN YOU GIVE AN AUDIO TEST.
IT SOUNDS LIKE OF LOW TO ME.
>> I'M HERE IN CALIFORNIA.
>> THANK YOU, THEY CAN HEAR YOU.
EVERYONE'S JUST READING THE
DOCUMENTS.
>> EVERYBODY READY?
WE'LL JUMP IN.
PETER JUST BLURT IN IF YOU HAVE 
SOMETHING TO SAY.
HOW ABOUT THE FIRST SECTION.
IT LOOKS LIKE CATHY'S CAUGHT A 
COUPLE TYPOS WHICH IS GREAT.
I WANTED TO SAY WAS THE 
ASSESSMENT AND ANALYSIS 
RECOMMENDED OR THE ISSUES RAISED
-- SORRY, IN THE FIRST SENTNESS 
I HAVE IT HIGHLIGHTED I DON'T 
THINK THE 
VERB'S QUITE RIGHT.
SO IN RESPONSE TO THE CONCERNS 
RAISED BY CSAC.
I WASN'T SURE WHAT YOU MEANT.
PETER, THAT'S YOUR SENTENCE.
>> SO THIS WAS REPRESENTING THE 
FACT A NUMBER OF THE ISSUES I 
RAISED WITH REGARD TO RISK 
ASSESSMENT AND MITIGATION HAD 
ALREADY BEEN DONE
BY THE CENSUS.
SO MANY
OF THE ISSUES I WAS TRYING TO 
RAISE WERE THINGS THE CENSUS WAS
ALREADY THINKING
THROUGH.
>> GREAT.
THERE'S ONE THING AND YOU DID A 
GREAT RE-ORGANIZING THE MATERIAL
I SENT AND THERE'S ONE POINT I'D
LIKE TO SUGGEST A CHANGE THAT 
HAS TO DO WITH IF YOU LOOK AT 
THE THIRD TO LAST BULLET UNDER 
THE POSSIBLE EDITION OF THE
CITIZENSHIP QUESTION THERE'S A 
SENTENCE THERE CSAC WOULD LIKE 
THE BRIEFING IN THE PROTOCOL TO 
BE USED AND IT STARTS WITH THE 
DISCUSSION OF THE VOLATILITY OF 
OVERALL NON RESPONSE.
WE CAN SEE THE THIRD
TO LAST BULLET UNDER CITIZENSHIP
QUESTION.
>> OKAY, WHAT WOULD YOU LIKE TO 
BE CHANGED?
>> THAT BULLET WAS MOSTLY
A COMMENT IN THE ORIGINAL 
VERSION I SENT TO YOU 
REFERENCING TO THE PROTOCOL 
RELATES MORE TO THE LAST BULLET 
MAINLY UNDERSTANDING EXACTLY 
WHAT THE NON-RESPONSE FOLLOW-UP 
PROTOCOL WILL BE IN THE EVENT OF
SIGNIFICANTLY HIGHER NON 
RESPONSE AND THE POSSIBILITY THE
CENSUS WOULD THEN POTENTIALLY 
CHANGE IT'S PROTOCOL.
SO -- 
>> IF I CUT THE LAST
PART AND
LIKE THAT?
>> THE CUT IT FROM THE THIRD 
BULLET AND ADDED.
>> I CAN'T SEE THAT BECAUSE I'M 
60 SECONDS BEHIND.
>> I SAID WE WOULD LIKE A 
BRIEFING TO BE USED
IN THE PARAGRAPH IN THE QUESTION
WITH 
THE CITIZENSHIP QUESTION.
>> TOMMY WRIGHT, A POINT OF
INFORMATION.
>> I WAS
CURIOUS AND THERE'S AMETHODOLOGY
WHICH HAS BEEN ESTABLISHED AND 
TO
ADAPT.
>> THAT'S A QUESTION FOR PETER.
>> PETER, I WAS LOOKING AT THE 
BULLET WHERE THE BUREAU EXPECT 
TO DATA DURING THE 2020 CENSUS 
THAT WOULD BE USEFUL IN 
DETERMINING HOW TO ADAPT THE 
REAPPORTIONMENT METHODOLOGY, 
THAT SAID, I'M NOT SURE WHAT 
THAT MEANS.
>> THIS RELATE TO HOW THE CENSUS
WAS GOING DEAL WITH ISSUES 
RELATED TO POTENTIALLY MUCH 
HIGHER NON-RESPONSE AND THE 
DEGREE TO WHICH THAT 
NON-RESPONSIVENESS MAY REFLECT 
ITSELF IN A DIFFERENTIAL WAY 
ACROSS THE DIFFERENT STATES.
I'M NOT AWARE WHAT THE 1941 
REAPPORTIONMENT METHODOLOGY IS 
AND WHETHER IT REFLECTS 
STATISTICAL ADJUSTMENTS, FOR 
EXAMPLE, TO TAKE INTO ACCOUNT 
NON-RESPONSIVENESS THAT'S 
DIFFERENTLY MANIFESTED ACROSS 
THE STATES.
>> MY UNDERSTANDING IS THAT THE 
BUREAU'S GOING TO COME UP WITH 
50 NUMBERS THE BEST THAT WE CAN 
AND THOSE NUMBERS ARE GOING INTO
A FORMULA FOR DETERMINING 
APPORTIONMENT.
BUT WE'RE NOT GOING TO CHANGE 
THE PORTION METHODOLOGY.
MAYBE YOU'LL TALK ABOUT THE DATA
THAT GOES INTO THE METHOD AND 
EDITING AND THINGS WE DO.
BUT THE RE-APPORTIONMENT 
METHODOLOGY ITSELF WILL NOT 
CHANGE I'M AWARE OF.
>> SO IT'S REFERENCING THE 15 
MEMBERS THE CENSUS WILL PROVIDE?
>> YES.
A LOT GOES INTO THAT EDITING AND
AMPUTATION AND THINGS LIKE THAT.
>> THAT'S THE ISSUE IS BEING 
REFERRED TO THERE WITH THE OTHER
THINGS THAT GET
DONE?
>> WE MAY LOOK AT SOME WORDING 
THAT WAY.
>> ARE YOU RECOMMENDING THAT 
THEY EXPLORE?
IT'S NOT THE PORTIONMENT
TT METHODOLOGY.
>> THE METHOD FOR GETTING THE 50
NUMBERS.
>> CORRECT.
>> SO ADAPT THE PROCESSING 
PROTOCOLS OR SOMETHING LIKE THAT
>> Caller: OR IMPUTATION 
METHODOLOGY.
[OFF MIC]
.
>> TOM
THREE WRIGHT.
-- TOMMY WRIGHT.
WE DO DO SOME IMPUTATION AND THE
SUPREME COURT SAID IT WAS OKAY 
FOR US TO DO.
>> PLEASE SAY YOUR NAME.
>> THIS IS ALLISON.
I THINK TOMMY WAS THE ONLY ONE 
WHO SAID HIS NAME.
[OFF MIC]
>> THIS IS CATHY PETIT.
PETER, IF THE
SENTENCE SAYS THE BUREAU EXPECT 
TO GATHER DATA THROUGH THE 2020 
CENSUS THAT WOULD BE HELPFUL IN 
ADAPTING OTHER PROTOCOLS USED 
POST PROCESSING TO REFLECT THE 
ETCETERA.
>> I THINK WHAT'S MISSING THERE 
IS IT'S NOT APPORTIONMENT 
METHODOLOGY BUT ALL THE 
PROCESSES TO GO INTO 
APPORTIONMENT.
SO WE NEED TO INCLUDE ACROSS THE
DIFFERENT STATES A FORM OF 
APPORTIONMENT.
>> Caller: THIS IS PETER.
THAT'S WHAT I INTENDED.
IT'S NOT THE MANDATED ISSUE, 
IT'S WHAT THE CENSUS DOES TO 
INFORM CONGRESS.
THE
RE-APPORTIONMENT.
>> CATHY, WHY DON'T YOU PUT IT 
AT THE END OF THE SENTENCE 
INSTEAD OF IN THE MIDDLE THERE.
>> TO PRODUCE -- SORRY, WHERE DO
YOU WANT ME TO PUT IT?
>> DIFFERENT STATES TO INFORM 
APPORTIONMENT.
>> 
RE-APPORTIONMENT?
>> TOMMY WRIGHT, I ASSUME THAT'S
WHAT YOU MEANT, PETER.
>> Caller: THIS IS PETER.
YES, THAT'S EXACTLY WHAT I 
INTENDED.
>> THIS IS ALLISON, THANK YOU, 
GUYS, THESE ARE IMPORTANT 
CLARIFICATIONS SO OUR 
RECOMMENDATIONS ARE UNDERSTOOD.
>> COMING BACK TO THE FIRST 
SENTENCE IN THE SECTION THE 
SUPREME COURT WILL DECIDE THE 
ISSUE THAT SEEMS MORE CERTAIN 
THAN I IMAGINE IS EXPECTED TO 
DECIDE THE ISSUE?
>> AND THIS IS ALLISON.
ON THE THIRD BULLET WHERE WE 
REMOVED THE REQUEST FOR THE 
BRIEFING, I WANT TO MAKE SURE 
THERE'S AN ACTION ITEM THERE.
>> Caller: THIS IS PETER.
I DON'T THINK THERE'S ANY ACTION
ITEM GIVEN AND THE SENTENCE HAS 
BEEN TAKEN OUT.
IT'S MORE IN THE DOMAIN OF A 
COMMENT OR SOMETHING ALONG THOSE
LINES NOT REALLY A REQUEST FOR 
ADDITIONAL BRIEFING.
>> YEAH.
>> THIS IS ALLISON.
OKAY.
>> PETER, MAYBE IT SAYS THE 
CENSUS NEEDS TO FULLY PREPARE TO
PIVOT WHICH I THINK IS THE 
INTENT?
>> Caller: THIS IS PETER.
THAT WOULD BE FINE WITH ME
THAT CHANGE.
>> HOW'S THIS SECTION LOOK TO 
EVERYBODY?
>> DO YOU WANT ME TO GO IN 
ORDER?
>> THIS IS CATHY PETIT.
THEY RAN -- RAN READ -- THEY CAN
READ IT.
DOES EVERYBODY KNOW HOW TO GET 
BACK TO WHERE I WAS?
ESCAPE?
THAT'S A GOOD ONE.
SAYS THE TECH GUY
IN THE ROOM.
>> WE HAVE THREE COMPUTER 
SCIENTISTS IN THE ROOM.
THOSE ARE THE NEXT THREE BULLETS
STARTING WITH, PETER, THE
EXPECTS TOGETHER.
AND THE LAST ONE JUST TO WRAP
UP THIS SECTION.
ALL RIGHT, THAT SECTION'S 
CLOSED.
IS
THAT GOOD?
EVERYBODY NOD YOUR HEAD.
MOVING TO THE END TO
END TEST.
I DON'T KNOW -- WE WOULD LIKE TO
HEAR MORE ABOUT AND I ORIGINALLY
SUGGESTED A ONE-WAY BRIEFING 
VERSUS A MEETING SECTION BUT DO 
PEOPLE HAVE A FEELING ABOUT 
WHETHER THIS IS WORTH MEETING 
SESSION TIME?
>> PEOPLE WANT TO SPECIFY?
>> A ONE WAY BRIEFING, CATHY?
>> I WAS THINKING THE ADDITIONAL
INFORMATION REGARDING THE END TO
END TEST WOULD BE A ONE-WAY 
BRIEFING.
COULD BE ONE OR ALL DEPENDING ON
WHAT THEY FIND OUT.
>> SO AS A REMINDER TO EVERYONE 
AND THIS IS HELPFUL TO KEEP IN 
MIND, IN OUR RECOMMENDATIONS WE 
HAVE A NUMBER OF THINGS WE'VE 
ASKED FOR IN THE FALL AGENDA AND
WHAT I NOTICED SO FAR IS WE HAVE
TOO MANY REQUESTS AND IT CAN'T 
POSSIBLY HAPPEN.
SO IT'S GOOD TO BE STRATEGIC 
ABOUT AS CATHY, SAYING, WE COULD
COVER THIS IN A ONE-WAY BRIEFING
TO ASK INFORMED QUESTIONS THAT 
ARE HELPFUL.
IN ADDITIONAL, WORKING GROUPS, 
WE HAVEN'T RECOMMENDED ANY 
WORKING GROUPS SO MAYBE WE ALOUD
TO -- ALLUDE TO THIS AND IF YOU 
WANT MORE ENGAGEMENT THAT WOULD 
BE PERFECT.
CATHY, YOU THINK OF A ONE-WAY 
BRIEFING?
>> IT SEEMS VAGUE.
WE EITHER WANT WRITTEN RESPONSES
OR A SESSION OR -- 
>> YEAH, THAT'S GOOD.
>> DOES THAT SOUND GOOD, 
EVERYBODY, ONE WAY BRIEFING?
>> THIS IS PETER.
I WOULD AGREE WITH THE ONE-WAY 
BRIEFING.
>> GREAT.
>> BE SPECIFIC.
>> IF WE'RE SPECIFIC IT'S VERY 
GOOD.
TOMMY.
>> TOMMY WRIGHT, I'M NOT 
SUPPOSED TO REALLY ENTER INTO 
THE DISCUSSION.
>> CLARIFICATIONS AND QUESTIONS 
ARE WELCOME.
ALL THE CITIZENSHIP QUESTIONS 
THE COMMITTEE IS WHERE THE 
CENSUS BUREAU IS CONDUCTING THIS
480,000 ADDRESSES THIS SUMMER ON
THAT.
I JUST WANTED TO REMIND
YOU OF THAT.
I'M NOT SURE I SAW THAT IN THE 
SECTION.
IT SEEMED TO BE FOCUSSED ON THE 
GATHERING ON THE 2020 CENSUS.
I JUST WANT TO REMIND THE 
COMMITTEE OF THAT.
>> 
>> I WASN'T SURE.
>>
IS IT THERE?
IT WOULD BE BEFORE GATHERING THE
2020 -- 
>> IS THERE?
I DON'T THINK IT'S THERE.
AND THE INFORMATION -- TOMMY 
WRIGHT.
>> PETER, THIS IS ALL ABOUT THE 
PLACEMENT OF THE QUESTION.
CSAC WOULD LIKE
A REPORT AND THE
IMPACTIMPACT.
>> AT THE
FALL 2019.
>> Caller: THAT CHANGE MAKES 
SENSE STO ME MODIFYING IT
IN THAT WAY.
>> EXCELLENT.
I'M GOING BACK TO THE END
TO END TEST.
>> THIS IS JUAN PABLO.
I HAVE A SUGGESTION OF SOMETHING
TO ADD THAT OCCURRED TO ME AFTER
THE PRESENTATION SO WE DIDN'T 
DISCUSS IT YESTERDAY.
INSTEAD OF
REQUEST TO GET INFORMATION ON 
THE PATH FORWARD ON THE INTERNET
SELF-RESPONSE AND DROP OFF 
POINTS, HOW DO 
PEOPLE NAVIGATE THE INTERNET 
SELF-RESPONSE
AND ALSO THE BERS OF USER WHO 
GET MOBILE DEVICES AN IF WE CAN 
GET THAT BREAK DOWN THAT WOULD 
BE USEFUL.
>> ONLINE RESPONSES
INCLUDING DATA.
>> FOLLOWED BY USERS INCLUDING 
DROP OFF POINTS LEARNING ABOUT 
DEMOGRAPHICS AND THE USE OF 
MOBILE DEVICE USERS.
>> BY DEMOGRAPHICS.
>> DID YOU SPECIFY USE OF MOBILE
DEVICE BY DEMOGRAPHIC GROUP?
>> YES, YOU COULD SAY OVERALL 
PERCENTAGE OF THESE GROUPS WERE 
MORE LIKELY TO USE MOBILE.
THAT MAY HELP YOU BETTER TARGET 
SOME OF THE 
OUTREACH LATER ON.
>> THE NEXT PARAGRAPH THIS IS MY
RECOMMENDATION BASED ON MY 
INTERACTION WITH COMMUNITY 
GROUPS.
>> THIS IS ALLISON.
ON THE PARAGRAPH ON THE 2020 
SPACE I WAS TRYING TO CAPTURE 
WHAT YOU AND JESSICA HAD SAID.
I WANT TO CAPTURE WHAT YOU WANT.
>> WEB AND MOBILE INTERFACE.
THERE'S JUST TWO, RIGHT?
NOT OTHER.
>> I THINK WE HAD THESE ASKS A 
YEAR AGO IN
HOPES AND IT'S A CURIOSITY AND I
DON'T WANT TO 
DISTRACT.
>> WHAT DO YOU THINK, ABBY?
SHOULD THAT BE ON THERE?
>> I THINK IT WOULD BE LESS OF A
DEMONSTRATION FOR US.
I THINK
MY CONCERN WAS AND THE PROS AND 
CONS.
YOUR POINT FROM YESTERDAY, WILL 
PEOPLE HELP FACILITATE USING IT 
AND HAVING A HEADS UP ON WHAT IT
LOOKS LIKE TO CRAFT MATERIALS I 
THINK SAY GREAT POINT IF WE 
PREFER TO TAILOR IT
TOWARDS THAT POINT.
>> CONSIDER THE BENEFITS OF
PUBLISHING THE INTERFACE
AHEAD OF TIME.
>> THIS IS JUAN PABLO.
I WOULD SAY PUBLISHING VIDEOS.
>> OKAY.
VIDEO DEMONSTRATIONS OR 
TUTORIALS.
>> I WOULD ADD TO THAT SENTENCE,
DOES IT MAKE SENSE ANYMORE?
>> NO, IT'S GOOD.
JUST NEEDS TO INCLUDE IN THE 
BEGINNING, SIMILARLY CSAC 
REQUEST THE CENSUS BUREAU 
CONSIDER JUST ADD THAT.
>> GO AHEAD.
>> OKAY.
THE LAST ONE WAS ASKING FOR 
DISCUSSION OF THE EVALUATIONS 
THAT ARE PLANNED AND ALLISON AND
I TWEAKED THIS TO SPECIFY COVER 
AND QUALITY WE WANT TO LEARN 
ABOUT THEM BUT GIVEN THE LIMITED
AMOUNT OF TIME THAT WOULD BE THE
MOST IMPORTANT PIECE FOR
THE FALL.
>> COMMENTS.
THIS IS JAY.
DOES THAT OAKLAND THE EVALUATION
OF THE COMMUNICATION STRATEGY 
FOR IS THAT
A SEPARATE EFFORT?
>> THIS IS TOMMY, IT INCLUDES 
SOME EXPERIMENTS YESTERDAY TO BE
FINALIZED AND SOME EVALUATIONS 
AND LOTS OF ASSESSMENTS AND I 
WAS TRYING TO REMEMBER THIS 
MORNING WHETHER IT INCLUDED THE 
PARTNERSHIP SPECIALISTS AS WELL 
AS SOME THINGS BUT THERE'S AN 
EVALUATION BUT WHO IS DOING IT.
>> THERE'S AN ASSESS MANY  -- 
ASSESSMENT OF THE PARTNERSHIP 
PROGRAM AND THERE'S SOME ASPECTS
OF THE 2020 PROGRAM BUT AS I 
SAID YESTERDAY, IT'S DIFFICULT 
TO DO THE KIND OF EXPERIMENT 
THAT WOULD REALLY SHOW YOU -- 
THE KIND OF PARTNERSHIP IS 
CHALLENGING BECAUSE YOU CAN'T 
REALLY TURN ANYTHING OFF IN ANY 
MUNICIPALITY AROUND THE COUNTRY.
WE TRIED IN 2010 TO DO AN 
EXPERIMENT BUT THE AIRWAYS ARE 
FLOODED AND IT'S JUST 
CHALLENGING.
WE ARE LOOKING AT WAYS AND I 
THINK IT'S ALSO TRUE THAT SOME 
OF THE EXPERIMENTS AS TOMMY SAYS
ARE STILL BEING REFINED AND 
DEVELOPED.
IT'S ONGOING WORK.
>> I DON'T KNOW WHAT'S AVAILABLE
IN 2016?
>> THERE'S ANNOUNCEMENT OF 
COMMUNICATIONS WORK FROM 2016 ON
THE WEBSITE.
>> THAT MAY BE A GOOD THING TO 
LOOK AT.
>> THAT'S TRUE.
>> THIS IS CATHY.
I GUESS I'M JUST CONCERNED WE 
COULDN'T COVER THE DEMOGRAPHIC 
ANALYSIS AND THE COMMUNICATION
IN ONE SECTION.
>> SHOULD WE HOLD RECOMMENDATION
FOR A FUTURE MEETING.
>>  I WAS NOTING ABOUT 
EVALUATING THE EFFECTIVENESS OF 
THE COMMUNICATION PLAN AND 
WHETHER IT'S COMBINED?
>> DO YOU THINK IT SHOULD BE?
>> THAT WOULD BE WHEN WE GET TO 
YOUR SECTION.
>> YEAH.
>> AND WHAT
DOES IT STAND FOR?
>> EXPERIMENTS.
>> NO, THE "B."
>> YOU ASKED ME BUT WHY WOULD I 
KNOW THE ANSWER.
>> WHAT IS C PEX.
>> EXPERIMENTS IF IT'S IN THE 
RIGHT ORDER.
>> SO PROGRAM FOR EVALUATION
AND EXPERIMENTS?
THE CENSUS
PROGRAM FOR.
>> THERE'S EXPERIMENTS, 
EVALUATIONS AND ASSESSMENTS AND 
MAYBE A LISTING OF THOSE IN SOME
FORM BUT THAT COULD BE SHARED.
>> THAT
WOULD BE GREAT.
>> YOU CAN DELETE AFTER CPEX THE
WORD PROGRAM.
>> THE CPEX
COMPONENT.
>> DOES ANYONE HAVE
COMMENTS?
>> INTEGRATE PARTNERSHIPS.
>> WE'LL TWO TO THE OTHER 
SECTIONS SO PLEASE LOOK AND MAKE
SURE IT'S WHAT YOU HAD IN MIND.
>> THIS IS MARIO AND AN 
APPRECIATE THE
EDIT.
>> I THINK I ADDED THE BING 
ABOUT  -- THING WITH THE APP SO 
IF YOU THINK IT'S A BAD IDEA
LET US KNOW.
>> THIS IS CATHY, ALICE JOB YOU 
HAD A
QUESTION.
>> I WROTE IT AFTER THE 
PRESENTATION AND AFTER TODAY'S 
PRESENTATION, I THINK WE CAN
TAKE IT OUT.
>> THIS IS JUAN PABLO.
CHANGING THE PROFILE PICTURE MAY
BE A HARDER SELL.
AND IT SHOWS IT'S PART
OF YOUR STATUS.
>> I THINK IT DEPENDS ON
THE SOCIAL MEDIA.
>> AND DEPLOYABLE THROUGH AN 
EASILY ACCESSIBLE BUTTON.
I'M NOT SURE THE INTENT BEHIND 
THE SENTENCE.
AND SOME PEOPLE MAY DEVELOP A 
RELATIONSHIP WITH FACEBOOK WHERE
FACEBOOK AGREED TO IMPLEMENT THE
FEATURE IN GOVERNMENT IT DIDN'T 
REQUIRE THE GOVERNMENT TO 
PRODUCE THIS MAYBE WE NEED TO 
CHANGE THE SENTENCE TO REFLECT 
IT'S AN ASK OF THE TECH 
COMPANIES TO INTEGRATE THIS.
>> COMPLETELY AGREE WITH JESSICA
AS THE AUTHOR OF THE CONFUSING 
SENTENCE AND WANTED TO GIVE 
SOMETHING CONCRETE TO THINK 
ABOUT BUT SHE'S RIGHT.
PARTNER WITH TECHNOLOGY PARTNERS
OR NEGOTIATE AGREEMENTS WITH 
TECHNOLOGY PARTNER THAT CAN 
LEVERAGE SOCIAL MEDIA PLATFORMS
FOR CENSUS MESSAGING AND THERE'S
A METHODOLOGY FOR HOW TO DO IT 
AND MAYBE IN THE PARAGRAPH FOR 
EXAMPLE SORT OF THING.
>> I LOVE THAT REFRAMING AND 
THANK YOU FOR GIVING ME AN 
OPPORTUNITY TO EXPRESS MY 
MILLENNIALISM IN FRONT OF THIS 
GROUP.
>> WE APPRECIATE THE 
REPRESENTATION.
NOW TO MOW MOTE THE
CENSUS.
FOR
EXAMPLE -- WHOOPS, SORRY, 
UNFAMILIAR
KEY BOARD.
I NEED SOMEONE WHO KNOWS 
FACEBOOK TO EDIT.
>> THAT'S TOTALLY
FINE.
>> I THINK YOU CAN GO OVER THE 
PERSON'S 
PROFILE PICK.
>> THE TRADITIONAL THING ON 
FACEBOOK IS YOU HAVE AN OVERLAY 
ON YOUR PROFILE PICTURE.
THAT'S THE THING PEOPLE DO.
I WOULDN'T CALL IT A WATER MARK 
BUT I'M SURE ALL THINGS ARE 
POSSIBLE.
>> THANK YOU,
CATHY.
>> THERE'S ANOTHER EXAMPLE OF 
NUMBER 4.
A DIFFERENT KIND OF TECHNOLOGY 
PARTNERSHIP, IF YOU WILL.
ANOTHER EXAMPLE MIGHT BE
.
THIS
WAS MARIO.
>> COULD BE PARTNERING WITH 
AMAZON.
LIKE THAT?
FIVE, SIX, SEVEN, EIGHT.
I WON'T SURE.
WE DON'T WANT AN APP TO RESPOND 
TO THE CENSUS.
I DON'T KNOW.
>> WHY NOT?
>> BECAUSE I DON'T THINK WE 
SHOULD INTRODUCE NEW TECHNOLOGY 
AT THIS POINT,
RIGHT?
>> THIS IS JUAN PABLO.
SO MAYBE I'LL PUT IN IDEA AND 
SAY SOMETHING LONG THE LINES OF 
PROVIDE FEEDBACK
SELF-RESPONSE WITH CURRENT 
RESPONSE RATES.
>> AND THIS WOULD EXPLORE WAYS 
TO PROVIDE IMMEDIATE FEEDBACK 
AFTER SELF-RESPONSE SUCH
AS I FEEL LIKE I HAVE SUCH 
POWER.
DOES THAT CAPTURE THE INTENT?
>> THIS IS JUAN PABLO.
AND WE CAN GET RID OF
IMMEDIATELY.
>> WE CAN PRESIDE CURRENT 
RESPONSE IN
YOUR LOCATION BUT 
LOCATIONS GLOBALLY.
>> WHERE DO THE IDEAS SIT?
LIKE WHAT ORGANIZATION WHAT PART
OF THE BUREAU WOULD HAVE THAT 
CONCEPTION INSTEAD?
YOU COULD PICK.
>> WHEN YOU'RE READY TO COME 
 EIGHT?
>> WOULD WE WANT TO CONSIDER 
SEVEN BEING A ONE-WAY
BRIEFING?
>> IT'S PROBABLY A GOOD IDEA AND
DO YOU WANT THAT IN THE FALL?
WAS THE FALL THE RIGHT TIMING IN
YOUR MIND?
>> DEFINITELY.
IT WOULD NOT BE THE SUMMER.
AS MEDIA PLAN 2.0 APPROACHES.
>> WHEN IS
THAT?
>> IF YOU WANT TO MAKE 
RECOMMENDATIONS IT SHUT BE AT 
THE MEETING.
>> YOU CAN ASK QUESTIONS IN A 
ONE-WAY BRIEFING.
>> IT'S NOT
BE AT THE MEETING.
>> YOU CAN ASK QUESTIONS IN A 
ONE-WAY BRIEFING.
>> IT'S NOT BE AT THE MEETING.
>> YOU CAN ASK QUESTIONS IN A 
ONE-WAY BRIEFING.
>> IT'S NOTO BE AT THE MEETING.
>> YOU CAN ASK QUESTIONS IN A 
ONE-WAY BRIEFING.
U BE AT THE MEETING.
>> YOU CAN ASK QUESTIONS IN A 
ONE-WAY BRIEFING.
>> IT'S NOTL BE AT THE MEETING.
>> YOU CAN ASK QUESTIONS IN A 
ONE-WAY BRIEFING.
D BE AT THE MEETING.
>> YOU CAN ASK QUESTIONS IN A 
ONE-WAY BRIEFING.
>> IT'S NOT ABOUT ME, THE MAM 
WORKING GROUP WILL MEET AGAIN SO
IT'S WHETHER THE GROUP WANTS TO 
PARTICIPATE IN RECOMMENDATIONS.
>> RIGHT.
>> THAT'S A GOOD QUESTION.
IS AN UPGRADE ON THE PRIORITY 
MEETING FOR CSAC, YES?
>> OR LEAVE IT AS-IS?
>> OR LEAVE IT?
>> ANYTHING ELSE
ON THIS SECTION?
ALL RIGHT.
MOVING ON TO THE DATA
PRODUCTS.
>> SO ANY
COMMENTS?
HOPEFULLY THEY'LL TIE TOGETHER 
OKAY BUT SO SAY IF THERE NEEDS 
TO BE A CHANGE.
>> IN THAT
PARAGRAPH, WHERE DID THAT GO?
>> AT THE END THERE'S ACCURACY.
>> ARE WE GOOD?
WE CAN TAKE A FEW 
>> ONE PABLO DID WE GET THE LAST
PARAGRAPH RIGHT?
HOW ABOUT I
SAY PROGRAM?
ARE WE DONE WITH THAT LAST 
SECTION?
ARE WE
GOOD?
I ADDED A COUPLE SENTENCES.
USER GUIDE.
ARE WE GOOD?
ALL RIGHT.
>> CAN WE ADD A FRIENDLY, THANK 
YOU FOR YOUR PRESENTATION AT THE
BEGINNING
OF MINE.
IT WOULD BE WEIRD TO HAVE 
RECOMMENDATIONS ON INTEGRATED 
CSAC AND THIS NAME OF THE GAME 
FROM HERE ON OUT IS MARKETING SO
IF IT'S
POSSIBLE TO ADD.
>> SHOULD WE SCROLL DOWN MORE?
I THINK THIS
IS WELL WRITTEN.
>> IT WAS SUGGEST TO LINK BACK 
TO THE CALL-IN QUESTION IN THE 
QUESTION.
I DON'T KNOW IF IT'S TOO 
SPECIFIC TO CALL UP A PERSON FOR
WHAT FEEDBACK
ON THAT.
>> AMANDA PEREZ.
I DON'T KNOW IF IT'S TRADITIONAL
TO GET THAT SPECIFIC WITH 
RESPONDING TO PUBLIC COMMENT SO 
FEEL FREE TO BACK THAT OUT.
>> I THINK THE REPRESENTATIVE OF
0 TO 
3.
>> SURE.
>> THIS IS JEFF.
IS THERE PUBLIC COMMENT BECAUSE 
IT'S PUBLIC COMMENT SECTION OR 
BECAUSE -- 
>> DURING
MEETING.
IT WASN'T DURING THE 
SESSION, RIGHT?
GOOD, LAST PARAGRAPH IN THE 
SECTION.
>> I'M SORRY, I'M GOING BACK.
THE LAST SENTENCE OF THE 
PREVIOUS PARAGRAPH SHOULD BE 
INCREASING 
NON-RESPONSE THAN 
UNDER COUNT.
>> THE NEXT PARAGRAPH IS MINE.
THE SECTION LOOK
OKAY TO EVERYBODY?
MOVING TO
CURRENT POPULATION SURVEY.
>> THE FIRST SHOULD BE 
DISCUSSION OF IMPROVEMENTS.
>> THEY'RE NOT UTILIZING
THE PROCESS.
>> MAYBE SCROLL BACK UP AGAIN.
>> TOMMY WRIGHT.
JUST A TECHNICAL DETAIL THE CSAC
SUPPLEMENT.
THE VARE MAY BE CONSISTENT WITH 
THE PILOT OF THE SESSION MAYBE 
YOU USE THE WORD SUPPLEMENT 
INSTEAD OF SURVEY IN THE FIRST 
LINE.
>> I'M SORRY.
>> THANK YOU.
OKAY, GOING DOWN TO THE
BULLETS.
>> THIS IS JAY.
ON THE PROTOCOL FOR OUTREACH AND
COMMUNICATION RELATED TO SUCH AN
OCCURRENCE I THINK IT SHOULD BE 
BROADER BEYOND OUTREACH AND 
COMMUNICATION AND INCLUDING HOW 
LONG SHOULD THE CALIBRATION BE 
AND VARIABLES.
SOMETHING THAT CAPTURES THE IDEA
THAT THIS TRIGGERS A WHOLE 
SUITE.
>> I'M SORRY, YOU HAD THE RENAME
VARIABLES AN OTHER THINGS.
>> YEAH, LIKE HOW LONG SHOULD A 
SERIES BE CARRIED FORWARD AND 
BEST PRACTICES FOR THE BRIDGING 
ACROSS THE CONTINUITY AND SOME 
OF THE LITTLE STUFF IS RENAMED 
VARIABLES SO PEOPLE AREN'T 
CONFUSED PART OF THE OUTREACH 
AND DISSEMINATION.
OTHER PARTS ARE BEST PRACTICES 
FOR HELPING USERS THROUGH THIS
TRANSITION.
>> 
>> SETTING BEST PRACTICES FOR 
THE TRANSITION?
>> EXACTLY.
>> FOR
USERS.
>> AND
COMMUNICATING THEM.
THERE'S BEST STATISTICAL 
PRACTICES AND EXPLAINING THAT TO
USERS.
>> THIS IS ALLISON.
BEFORE SETTING BEST PRACTICES 
DOES IT NEED TO SAY
SUCH AS?
>> NOW WE'LL MOVE
DOWN A LITTLE.
I THINK WE DON'T NEED TO NAME I 
SUGGEST WE PUT POLICY
RESEARCH GROUPS.
>>
LETTER POLICY?
>> I THINK IF WE SAVE BLOGS I 
SAY INCLUDING FOR LAY AUDIENCES 
I FELT LIKE THAT'S
MISSING.
FOR LAY
AUDIENCES.
>> THIS IS JUAN PABLO.
I THINK WE NEED A QUESTION MARK 
AT THE END OF THE LAST
SENTENCE.
>> EXCELLENT.
LAST SECTION AND 20
MINUTES TO GO.
>> DO WE LIKE THIS
PARAGRAPH?
I THINK SEVERAL OF US 
CONTRIBUTED TO THIS COMMENT ON 
THE PUBLIC COMMENT WHICH WAS 
INITIATED BY JACK WHICH
WAS GREAT.
>> THIS IS JAY.
CAN WE SAY WHERE THE
STATEMENT APPEARS BLAH, BLAH, 
BLAH.
>> CAN SOMEBODY HELP ME 
SPECIFICALLY?
IT WAS IN THE O.M.B.
THE INFORMATION
REQUEST FOR 
O.M.B.
>>
THE SECTION EIGHT OF THE 2020 
CENSUS.
>> CAN YOU SAY THAT AGAIN?
I LOST YOU.
A STATEMENT INTERSECTION?
>> SECTION EIGHT OF SUPPORTING 
STATEMENT PART A.
OF THE 2020 CENSUS I.C.R.
>> JUST IN THE QUOTES ADD TO THE
BEGINNING, THE CENSUS BUREAU HAS
IDENTIFIED.
NO CREDIBLE QUANTITATIVE 
EVIDENCE THAT IT WOULD IMPACT 
THE UNDER COUNT OF THE
2020 CENSUS.
>> I'LL READ IT AGAIN.
FROM THE ADDITION OF A 
CITIZENSHIP QUESTION WOULD 
IMPACT THE NET UNDER COUNT OF 
THE 2020 CENSUS.
AND YOU'VE GOT THAT.
SHALL I READ IT AGAIN TO BE 
SURE.
THE CENSUS BUREAU HAS IDENTIFIED
NO DELIVERABLE
QUANTIFIABLE EVIDENCE THE 
ADDITION OF AN
CITIZENSHIP QUESTION WOULD 
IMPACT THE UNDER COUNT.
>> I  -- THIS IS JUAN PABLO.
WE NEED TO CHANGE THE WORDING TO
MIRROR THE
LANGUAGE.
TO EFFECT THE UNDER COUNT OF THE
HISPANIC
POPULATION?
>> AN INCREASED UNDER COUNT?
>> NO.
>> THIS IS MARIO.
CAN WE DEFINE I.C.R. FOR PEOPLE 
MAY NOT KNOW?
INFORMATION COLLECTION REQUEST.
>> THANK YOU.
>> HOW'S IT LOOKING?
ANYONE WANT TO REVIEW EVEN JUST 
REREAD A PREVIOUS SECTION?
DO YOU FEEL LIKE YOU REMEMBER IT
AND FEEL GOOD
ABOUT IT?
DID YOU HAVE ANYTHING ELSE YOU 
WANTED TO RESPOND
TO?
>> IN THE PRIVACY SECTION FOR 
LIKE IN THE OTHER
SECTIONS?
>>
OH, YES.
>> ADD CSAC TO THE
NEXT SENTENCE.
>> THIS IS JEFF, CAN YOU GO BACK
TO CRITICAL ISSUE AND LIKE A 
DISCUSSION OF IT INCLUDING 
VIOLATION PLAN SECTIONS ABOVE 
MAYBE BE MORE SPECIFIC ABOUT 
WHERE IT'S
RECOMMENDED.
>> BETTER?
>> ADVOCACY -- MOTION TO SAVE 
THE DOCUMENT AND VOTE AYE.
>> EVERYONE OKAY WITH THIS?
ALL RIGHT.
ALL GOOD?
GOOD.
I KNOW PETER HAS
ALREADY SIGNED OFF.
WE GOT DONE 12 MINUTES EARLY.
>> TOMMY WRIGHT SPEAKING FOR THE
CENSUS BUREAU.
OUR SINCERE THANKS TO EVERYONE 
INCLUDING MEMBERS OF THE 
ADVISORY COMMITTEE.
THE NEXT MEETING ACCORDING TO MY
NOTE IS SEPTEMBER 12 AND 13th.
I'M LOOKING AT TARA.
SEPTEMBER 12
AND 13.
WE'LL CHECK RIGHT NOW AND WISH 
YOU A SAFE JOURNEY HOME.
>> THIS IS ALLISON.
LET ME ADD MY THANKS TO THE 
COMMITTEE OF COURSE FOR BEING 
HERE AND YOU'RE  -- YOUR REALLY 
ACTIVE AND ENGAGED PARTICIPATION
AND TO THE CENSUS BUREAU.
WE KNOW THIS IS REEL AN INTENSE 
TIME AND THROW ALL KINDS OF 
QUESTIONS AND IDEAS AT YOU AND 
WE APPRECIATE YOUR PATIENCE AND 
YOUR INTELLIGENCE AND YOUR 
PASSION FOR THE CENSUS AND THANK
YOU FOR ALL OF YOUR GREAT 
RESPONSES.
WE APPRECIATE IT.
>> TOMMY
WRIGHT FOR THE RECORD.
THE MEETING IS ADJOURNED.
AND 13.
SEE YOU THEN.
