4.EURAMET Guide On Comparisons (Toolbox)

Comparisons in EURAMET
Development of a Toolbox
Wolfgang Schmid, EURAMET

Luca Callegaro, INRIM (Italy)
Outline
Some issues with comparisons

Toolbox for management of comparisons
2
The problem
Number of Comparisons 12
10
0
1 2 3 4 5 6 7 >8
Duration of comparison (years)
www.bipm.org 3 www.euramet.org
Comparisons in the KCDB without conclusion > 5 years
35th JCRB-Meeting (March 2016)

In the KCDB there are 74 KCs and 45 SCs registered, which are
incomplete since more than 5 years
EURAMET:
18 KCs / 11 SCs
Almost all TCs concerned, exceptions: AUV, MC, TF
KC indentifyer Status Feb 2016 Indicated year Pilot SC identifyer Status Feb 2016 Indicated year Pilot
EURAMET.L-K3.2009 In progress 2009 - 2015 PTB EURAMET.EM-S31 Measurement completed 2009 - 2010 PTB
EURAMET.L-K8 Report in progress, Draft B 2009 - 2010 LNE, NRC EURAMET.EM-S33 In progress 2010 - 2011 LCOE (Spain)
EURAMET.M.D-K1.1 Report in progress, Draft A 2008 - 2012 PTB EURAMET.EM-S34 Protocol complete 2010 - 2011 LCOE (Spain)
EURAMET.M.FF-K5.a Protocol complete 2009 PTB EURAMET.EM-S37 In progress 2011 - 2013 CMI
EURAMET.M.P-K1.c In progress 2011 - 2014 FORCE EURAMET.M.M-S3 Planned 2011 - 2012 UME
EURAMET.M.P-K7 Report in progress, Draft B 2005 - 2007 MIKES EURAMET.M.P-S5 Report in progress, Draft B 2007 PTB
EURAMET.M.P-K8 Report in progress, Draft B 2009 - 2010 METAS EURAMET.M.P-S7 Report in progress, Draft B 2008 - 2010 METAS
EURAMET.PR-K2.a Measurements completed 2010 - 2012 VSL EURAMET.M.P-S9 Report in progress, Draft B 2011 LNE, MIKES
EURAMET.PR-K3.a.1 Report in progress, Draft B 2004 - 2005 LNE-INM EURAMET.M.T-S2 Report in progress, Draft A 2008 PTB
EURAMET.PR-K5 Measurement completed 2007 - MKEH EURAMET.T-S4 Report in progress, Draft B 2007 - 2009 NPL
EURAMET.PR-K6.2 Report in progress, Draft A 2008 - 2009 BIM EUROMET.RI(III)-S1 Report in progress, Draft B 2003 - 2007 IRSN
EURAMET.T-K1 Report in progress, Draft A 2008 - 2012 PTB
EURAMET.T-K3.2 Report in progress, Draft B 2009 - 2010 UME
EURAMET.T-K3.4 Report in progress, Draft A 2010 - 2011 MIRS/UL-FE/LMK
EUROMET.M.D-K2 Report in progress, Draft B 2001 PTB
EUROMET.M.F-K1 Report in progress, Draft B 2002 - 2004 MIKES
EUROMET.M.F-K3 In progress 2005 - PTB
EUROMET.T-K8 In progress 2008 - 2012 PTB
TC-Chairs and Secretariat started analysing situation and issues with pilots
Status in January 2017 KC SC

Reported at 35 JCRB (March 2016) 18 11
Added at 36 JCRB (Sep. 2016) 0 0
Concluded / final report published (KCDB or Metrologia) 4 3
Draft B sent to CC-WG 5 3
Thus, remaining comparisons without approved Draft B 9 5
Draft B in progress 3 2
Draft A in progress 2 3
Still no report 4 0
Some typical (?) issues
Measurements start years after agreement on comparison
(and registration in KCDB)
Measurements concluded more or less in time,
but preparation of report is very slow
Unexpected issues with measurement or travelling standards arise
-> new and valuable scientific insight, but sometimes tremendous delay
Coordinator is overloaded by work, or has other priorities than preparing report
Coordinator retires - nobody feels responsible to take over
Work comes to a standby - but nobody asks what is happening
CC-WG for KCs need > 6 weeks for review
How to overcome these issues?
Making rules clear and transparent

e.g. EURAMET Guide on Comparisons (presentation Luca Callegaro)
Reminding people on importance to conclude comparison in time;

offering support in case of issues
e.g. request from JCRB
follow-up from TC-Chairs
Increase commitment and support from NMI management:

template to be signed by representative of NMI committing resources
How to overcome these issues?
Making rules clear and transparent

e.g. EURAMET Guide on Comparisons (presentation Luca Callegaro)
Reminding people on importance to conclude comparison in time;

offering support in case of issues
e.g. request from JCRB
follow-up from TC-Chairs
Increase commitment and support from NMI management:

template to be signed by representative of NMI committing resources
Support management (administration) of comparisons

EURAMET comparisons toolbox
Why a toolbox?
Hammer to ensure the Thumbscrews to make
participants adhere to participants send results
the schedule on time
Chisel for removing Drill for drilling down

travelling standards from into the data
customs quarantine Big thick pencil
for writing report
The smarter solution: a web-based tool
Concept of the toolbox
Webportal for
management of the comparison,
collation of all relevant data, and
keeping online control of its status.
How the toolbox supports the coordinator (1)
Keeps contact data of participants

Knows the eligible institutes for KCs, SCs, PS
(all NMIs and DIs of the KCDB are stored; expert labs may be added)
Invites labs to participate
Sends and receives signed template by participants
Supports in setting up the time schedule
Provides related documents and further support tools
How the toolbox supports the coordinator (2)
Takes control on the running comparison, sending reminders when
the participating lab has to do something
May automatically block participants which have passed the
deadlines
Knows where the travel standard is at the moment
Collates measurement results
(to be provided by the participants directly on the webportal)
Provides some basic evaluation (En, 2), and correction for drift of
standard
Development of the toolbox
Initiative of the TC-EM:

first version of the toolbox was developed at PTB and tested
Concept was presented to EURAMET TC-Chairs
and considered as a useful tool
EURAMET took over responsibility for toolbox
Currently test with real comparisons
further developments / amendments of the toolbox on the way
Next steps: - validation of software
- further tests with comparisons
General use within EURAMET envisaged for 2018
Participants
Workflow
Workflow
Measurement results
Evaluation
Evaluation
Thank you for your
attention
Wolfgang.Schmid@euramet.org
tcem@euramet.org
www.bipm.org

4.EURAMET Guide On Comparisons (Toolbox)

Enviado por

Dados do documento

Descrição original:

Título original

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

4.EURAMET Guide On Comparisons (Toolbox)

Enviado por

Direitos autorais:

Formatos disponíveis

Comparisons in EURAMET

Wolfgang Schmid, EURAMET

Some issues with comparisons

35th JCRB-Meeting (March 2016)

Status in January 2017 KC SC

Making rules clear and transparent

Reminding people on importance to conclude comparison in time;

Increase commitment and support from NMI management:

Making rules clear and transparent

Reminding people on importance to conclude comparison in time;

Increase commitment and support from NMI management:

Support management (administration) of comparisons

Chisel for removing Drill for drilling down

Keeps contact data of participants

Initiative of the TC-EM:

Você também pode gostar