Epa-oig Ncwarn Complaint 6-8-16

8/15/2019 Epa-oig Ncwarn Complaint 6-8-16

1/66

COMPLAINT and request for investigation

of fraud, waste and abuse by a high-ranking

PA offi!ia" "eading to severe underre#orting and

"a!k of !orre!tion of $ethane venting and "eakage

throughout the %& natura" gas industry

'i"ed on (une ), *+

.ith the Offi!e of Ins#e!tor /enera" of the

%& nviron$enta" Prote!tion Agen!y

by

NC .A0N

Jim Warren, Executive Director

(919) 416-5077

[email protected]

Jo!n "un#$e, %oun&e$

(919) 94'-0600

run#$e@ricecree#.com

*% W+"*

.. ox 61051

Dur!am, *% '7715

P.O. Box 61051, Durham, NC 27715 • 919-416-5077 • www.ncwarn.org

Building people power for climate & energy justice


2/66

TA1L O' CONTNT&

%om$aint ............................................................................................................................ 1

ac#roun/ .................................................................................................................... '

ummar o2 eci2ic +$$eation& ................................................................................... 5

"ami2ication& 2or %$imate, a2et, 3ea$t! ..................................................................... 7

+ 3i!$ %re/i4$e W!i&t$e4$ower ..................................................................................

6n/u&tr 6nvo$vement o&ture ................................................................................... 9

%onc$u&ion ................................................................................................................... 10

8eri2ication& ....................................................................................................................... 1'

+en/ice&

+. +$$eation&

. Di&cu&&ion o2 %on2i/entia$ +$$en emo

%. :nu4$i&!e/ +$$en %omment& an/ 3owar/ "e&on&e on 3owar/ ('0154)

D. ro4$em& wit! t!e ;ox ;$ow eter

E.


3/66

P.O. Box 61051, Durham, NC 27715 • 919-416-5077 • www.ncwarn.org

June 5, '016

n&ector =enera$ +rt!ur +. E$#in&, Jr.

:.. Environmenta$ rotection +enc

22ice o2 n&ector =enera$

1'00 enn&$vania +venue, *.W. ('410


4/66

*% W+"* %om$aint to E+ n&ector =enera$ June , '016

'

een a//re&&e/. W!en we $earne/ o2 t!i&, we reac!e/ out to r. 3owar/ to etter un/er&tan/

t!e&e ro$em&, w!ic! eventua$$ $e/ to t!i& com$aint.

e22ort& to re/uce met!ane emi&&ion&.

w!ic! re/uction& o2 emi&&ion& cou$/ re&u$t in a 1 /ecrea&e in in/u&tr-wi/e emi&&ion&. contra&t, our com$aint invo$ve& t!e ro/uction &ector, w!ic! con&titute& ' o2 tota$ otentia$

emi&&ion re/uction& (E+-= '014, 17).

ro/uction &ector !a& a 2ar reater imact on c$imate, &a2et an/ u$ic !ea$t! t!an

un/ere&timatin $ea#ae in t!e /i&triution &ector.

Due to warnin& t!e $oa$ &cienti2ic communit aout t!e urenc o2 ma#in /ramatic

re/uction& in reen!ou&e a& emi&&ion, an/ ecau&e met!ane emi&&ion& 2rom t!e a& in/u&tr are

now con&i/ere/ $ea/in re&earc!er& to e t!e $are&t &ource o2 c$imate-/i&rutin emi&&ion& in

t!e :nite/ tate&, an/ ecau&e met!ane an/ toxic air emi&&ion& o&e an unre&o$ve/ !aFar/ to

ot! a& in/u&tr wor#er& an/ &urroun/in communitie&, we ure ou to exe/ite t!i&

inve&tiation to t!e reate&t extent o&&i$e.

3AC42(O%N'

et!ane, a reen!ou&e a& u/e/ t!e nterovernmenta$ ane$ on %$imate %!ane to e 100

time& more otent t!an caron /ioxi/e over a ten-ear erio/ in term& o2 c$imate imact&, i& t!e

/ominant comonent o2 natura$ a&. %on&eAuent$, t!ere i& rowin concern t!at t!e !eat-

train c!aracteri&tic& o2 emi&&ion& o2 met!ane in t!e natura$ a& &&tem &u&tantia$$ excee/

an c$imate ene2it& t!at mi!t e aine/ a& t!e e$ectric ower in/u&tr an/ ot!er& re$ace coa$

an/ oi$ wit! natura$ a&, inc$u/in 2rac#in a&, a$&o re2erre/ to a& &!a$e a&.

"outine emi&&ion&, via $anne/ ventin G ot! continuou& an/ intermittent G an/ 2rom

unintentiona$ $ea#ae t!rou!out t!e variou& &ector& o2 t!e oi$ an/ a& in/u&tr in2ra&tructure,

!ave recent$ een i/enti2ie/ a& t!e $are&t &ource o2 reen!ou&e a& o$$ution in t!e :. uc!

onoin emi&&ion& account 2or at $ea&t '9 o2 tota$ : met!ane emi&&ion&, an/ o&&i$ muc!

more, a& /e&crie/ e$ow (8ai/anat!an '015).

reventin reu$ation reAuirin t!e in/u&tr to eit!er re/uce or cature an/ re-u&e emi&&ion&.

in/u&tr !a& a$&o $ae/ ot! a articiator an/ 2un/in ro$e in &tu/ie& o2 emi&&ion&, inc$u/int!o&e invo$ve/ in t!i& com$aint.

+& note/ Dr. "oert 3owart!, a $ea/in met!ane emi&&ion& exert 2rom %orne$$ :niver&it, t!e

rai/ rowt! o2 t!e : natura$ a& in/u&tr in recent ear& /ue to extraction o2 &!a$e a& !a& $e/ to

increa&in concern aout t!e rowin $eve$& o2 met!ane emi&&ion& reorte/ in mo&t &tu/ie&. +

nota$e excetion wa& a &tu/ u$i&!e/ in etemer '01H t!e Environmenta$ De2en&e ;un/

(ED;) an/ t!e :niver&it o2


5/66


H

Figure 1. Comparison of methane emission studies across the US, showing the average findings

much higher than those from the Allen et al. (21!" stud# ($owarth 21%, 1&, modified".

Due to con2$ictin /ata on met!ane $ea#ae rate&, ED; $aunc!e/ a &erie& o2 16 &tu/ie& in '01'

co&tin I1 mi$$ion to $oo# at emi&&ion& 2rom t!e $i2e-cc$e o2 natura$ a& ro/uction, wit! 2un/in

2rom in/ivi/ua$&, 2oun/ation& (I1' mi$$ion), an/ in/u&tr (I6 mi$$ion) (a$e an/ on '015). i$

an/ a& comanie& rovi/e/ 90 o2 t!e 2un/in 2or t!e +$$en et a$. ('01H) &tu/, w!ic! wa& art o2

t!e ED; &erie& an/ wa& u$i&!e/ in t!e 'roceedings of the ational Academ# of Sciences.

oar/ at t!e time.

neumatic /evice& at ro/uction &ite& (+$$en et a$. '014). neumatic /evice& tica$$ re$ on

natura$ a& 2rom t!e &ite to oerate an/, a& &uc!, vent a& eit!er intermittent$ or continuou&$

/urin routine oeration. ecau&e o2 t!e $are numer o2 t!e&e /evice& in u&e in t!e ro/uction


6/66


4

&ector in t!e : G aroximate$ 500,000 accor/in to +$$en et a$. ('014) G t!e are current$

con&i/ere/ E+ to e t!e /ominant &ource o2 met!ane emi&&ion& at ro/uction &ite&.

:n2ortunate$, ot! o2 t!e&e &tu/ie& !a/ &ini2icant tec!nica$ ro$em& t!at cau&e/

un/erreortin o2 emi&&ion& 2rom ro/uction &ite&, ut t!o&e ro$em& were not /i&c$o&e/ or

ac#now$e/e/ t!e &tu/ aut!or&.

+$$en et a$. ('01H) re$ie/ on t!e ac!arac! 3i-;$ow am$er (3;) 2or mea&urement& ma/e at

c!emica$ inection um&, eAuiment $ea#&, neumatic contro$$er& an/ tan#& (a$t!ou! tan#

emi&&ion /ata were not inc$u/e/ in t!e emi&&ion inventor 2or t!i& &tu/). 3owever, &ince t!e

u$ication o2 t!e '01H &tu/, it !a& een /emon&trate/ t!at &en&or 2ai$ure can cau&e t!e 3;

not to &witc! 2rom it& $ow &ca$e to it& !i! &ca$e, re&u$tin in un/erreortin o2 emi&&ion rate&

or/er& o2 manitu/e (3owar/ et a$. '015). ;urt!er &tu/ t!en &!owe/ t!at t!i& 3; &en&or 2ai$ure

c$ear$ cau&e/ un/erreortin o2 emi&&ion rate& in +$$en et a$. ('01H) (3owar/ '015). ee

+en/ix % 2or Dr. +$$en& comment on 3owar/ ('015) an/ 9r. 3owar/& re&on&e to t!e

comment.

in/een/ent te&t& or t!e 2u$$ extent o2 t!e 2$ow meter ca$iration ro$em&. +& a re&u$t, at $ea&t

!a$2 o2 t!eir emi&&ion& mea&urement& ma e ia&e/ $ow a 2actor o2 two or more. (ee

+en/ix D.)

n a//ition, :< co$$ecte/ &u&tantia$ /ata on tan# emi&&ion& /urin +$$en et a$. ('01H) ut /i/ notu&e it, even t!ou! t!i& /ata &et mi!t e one o2 t!e mo&t exten&ive an/ u-to-/ate /ata &et&

avai$a$e 2or tan# emi&&ion&. t i& c$ear t!at exi&tin tan# mo/e$& /o not wor# we$$, an/ tan#& mi!t

e t!e /ominant &ource o2 met!ane emi&&ion& at we$$ &ite&, 2ar. +t t!e &ame time, a$$

in/ication& are t!at t!e 3; wa& exeriencin wi/e&rea/ &en&or 2ai$ure w!i$e u&e/ t!e :<

team to ma#e t!e&e mea&urement&, an/ it &eem& $i#e$ t!at t!e :< team wou$/ !ave encountere/

tan# emi&&ion& $are enou! t!at t!i& &en&or 2ai$ure wou$/ e oviou&. (ee +en/ix E.)

E+ o22icia$& enineer an/ ;ox 2$ow meter 2ai$ure& tec!nician& an/ ot!er roect articiant&.


7/66


5

n 2act, ro$em& wit! t!e 3; un/erreortin emi&&ion& !a/ een i/enti2ie/ a& ear$ a& '01' in a

aer co-aut!ore/ E+ re&earc!er Ean

n Ju$ '015, ac!arac!, nc. o&te/ a revi&e/ 3; manua$ on it& we&ite (ac!arac! '015) &!ort$

a2ter a reorter ae/ t!e coman to comment on t!e &en&or 2ai$ure (on '015).

recommen/& /ai$ rat!er t!an mont!$ ca$iration in t!e ca&e o2 mixe/ a& &tream& an/ warn& o2t!e o&&ii$it o2 &en&or tran&ition 2ai$ure, recommen/in &ome minima$ wor#aroun/&.

revi&ion /oe& not recommen/ u/atin t!e 2irmware, nor /oe& it in/icate t!e &ca$e o2 t!e ro$em

or o22er a meanin2u$ wa to revent it.

re&on&e to t!e concern& rai&e/ r. 3owar/ or w!et!er t!e were a$&o noti2ie/ o2 t!e ro$em

memer& o2 t!e +$$en '01H or '014 team or ot!er u&er&. +& 2ar a& we #now, ac!arac! /i/ not

i&&ue a ro/uct a$ert to exi&tin u&er& o2 t!e 3; at t!e time t!e manua$ wa& revi&e/.

t aear& t!at t!e oa$ o2 t!e :< team wa& not to critica$$ examine t!e ro$em& ut to convince

ED; an/ it& ro/uction committee memer& t!at no ro$em& exi&te/. We e$ieve r. 3owar/

wa& &eci2ica$$ revente/ 2rom rovi/in inut ecau&e t!e :< team #new t!at !e wou$/ e a$e

to &!ow t!at t!eir counterarument& were 2au$t an/ t!e re&u$tin &tu/ie& &cienti2ica$$ inva$i/.

2ai$ure o2 t!e E+ to accurate$ reort met!ane emi&&ion& 2or more t!an two ear&, muc! $e&&

reAuire re/uction&. eanw!i$e, t!e 2au$t /ata an/ mea&urin eAuiment are &ti$$ ein u&e/

exten&ive$ t!rou!out t!e natura$ a& in/u&tr wor$/wi/e.

*on-/i&c$o&ure an/ cover-u cou$/ !ave wi/e&rea/ im$ication&.

&tae& o2 natura$ a& roce&&in, tran&mi&&ion, &torae an/ /i&triution to /etermine met!ane

emi&&ion& (&ee ;iure '). t i& a$&o one o2 t!e /evice& arove/ E+ 2or man/ator reortin o2

met!ane emi&&ion& un/er uart W o2 t!e =reen!ou&e =a& "eortin roram (E+ '016).

ecau&e E+, aca/emic an/ in/u&tr er&onne$ !ave inore/ or mi&rere&ente/ t!e&e ro$em&

in&tea/ o2 a//re&&in t!em wit! r. 3owar/ in a ro2e&&iona$ manner, met!ane emi&&ion& remain

oor$ Auanti2ie/, a$t!ou! it &eem& ver $i#e$ t!at t!e are muc! !i!er t!an e&timate/ E+.

;or exam$e, a '016 ED; &tu/ (>on '016) 2oun/ met!ane $ea#ae rate& 90 !i!er t!an oriina$

e&timate&, wit! 90 o2 t!e $ea#& comin 2rom tan#& (cenna '016). %urrent &cienti2ic con&en&u&,

a& &!own in ;iure 1, i& t!at t!e met!ane emi&&ion& 2rom natura$ a& ro/uction an/ /i&triution

are muc! !i!er t!an in/icate/ t!e inva$i/ +$$en &tu/ie&.

&%MMA(5 O) &PCI)IC ALL2ATION& 'TAIL' IN APPN'I6 A

ince ein ma/e aware o2 t!e 2$aw& in +$$en et a$. ('01H) an/ +$$en et a$. ('014), Dr. +$$en mi&u&e/

!i& aut!orit, ave 2a$&e or mi&$ea/in in2ormation, rovi/e/ ina/eAuate /ocumentation an/

/e$ae/ ro/ucin reAue&te/ /ocumentation, t!u& minimiFin an/ 2ai$in to /i&c$o&e t!e &eriou&

ma$2unctionin o2 t!e 3; an/ ;ox 2$ow meter& an/ t!e con&eAuent e22ect on te&t re&u$t&.


8/66

*% W+"* %om$aint to E+ n&ector =enera$ June 5, '016

6

Figure 2. atural gas production sectors in which the )acharach $i*Flow Sampler ()$FS" is used.

+iagram source, https,--www.epa.gov-ghgreporting-ghgrp*and*oil*and*gas*industr#.

Dr. +$$en #new or &!ou$/ !ave #nown t!at t!e ma$2unctionin 3; re&u$te/ in inva$i/ /ata t!at&!ou$/ not !ave een u&e/ 2or +$$en et a$. ('01H). Dr. +$$en #new or &!ou$/ !ave #nown t!at t!e

ma$2unctionin 3;, a& we$$ a& ro$em& wit! t!e ;ox 2$ow meter&, re&u$te/ in inva$i/ /ata ein

u$i&!e/ in +$$en et a$. ('014). +$$en mi&rere&ente/ to 9r. 3owar/ t!at !i& concern& wou$/ e

a//re&&e/. n re2u&in to a//re&& t!e i&&ue o2 inva$i/ /ata, an/ re2u&in to communicate 2urt!er

wit! 9r. 3owar/, Dr. +$$en& action& re&u$te/ in /e$a an/ mi&u&e o2 E+ 2un/&.


9/66


7

Dr. +$$en, a& rincia$ re&earc!er, !a/ a /ut to inve&tiate an/ /i&c$o&e to t!e E+, ED; an/ ot!er

re&earc!er& i&&ue& t!at in/icate/ &evere ro$em& wit! t!e 3;, t!e tan# /ata an/ t!e neumatic

/evice &tu/ (+$$en et a$. '014).

o2 t!e ro/uction team wa& inten/e/ to mi&$ea/ t!e ED; ro/uction committee& aout t!e&ini2icance an/ &coe o2 t!e ro$em& wit! t!e 3;.

Dr. +$$en an/ t!e :< team 2urt!er mi&$e/ t!e e/itor an/ rea/er& o2 .nvironmental Science /

0echnolog# in Dr. +$$en& re&on&e to 3owar/& %omment on +$$en et a$. ('014).

n arc! o2 '014, Dr. +$$en 2ai$e/ to /i&c$o&e to E+, in/u&tr, ED; an/ ac!arac!, nc. t!at t!e

3; &en&or 2ai$ure !a/ een c$ear$ /emon&trate/, an/ t!at ro$em& wit! t!e 3; aeare/ to

!ave een on$ artia$$ re&o$ve/ wit! u/ate/ 2irmware an/ 2reAuent ca$iration&.

Dr. +$$en, a& c!air o2 t!e E+ cience +/vi&or oar/ 2rom '01' to '014, wa& a ai/ ecia$

=overnment Em$oee. +& &uc!, !e !a/ t!e a//itiona$ /ut to 2u$$ /ivu$e !i& ia&e& towar/

in/u&tr an/ !i& /irect con2$ict& o2 intere&t. 3i& /i&c$o&ure &tatement& in t!e +$$en et a$. ('01H,

17765) an/ +$$en et a$. ('014, 6H9) &tu/ie& &!ow !i& re&earc! an/ con&u$tin !ave $on een

2un/e/ t!e oi$ an/ a& in/u&tr, rinin t!e va$i/it o2 !i& &tu/ie& 2urt!er into Aue&tion.

(AMI)ICATION& )O( CLIMAT, &A)T5, 7ALT7

t !a& een /emon&trate/ t!at &en&or 2ai$ure can cau&e t!e 3; to un/erreort $ea# rate& an/

ot!er emi&&ion rate& or/er& o2 manitu/e. +ccurate &am$in an/ monitorin Dr. +$$en an/

t!e :< team wou$/ !ave iven E+ a 2u$$er un/er&tan/in o2 t!e /eva&tatin imact& o2 met!aneventin an/ $ea#ae. ecau&e o2 t!i& 2ai$ure, E+ 2un/& !ave een wa&te/, 2rau/ !a& een

committe/, an/ imroer an/ un$aw2u$ action& !ave een ta#en. ore imortant, t!e &cienti2ic

a&i& 2or roer$ reu$atin met!ane emi&&ion& 2rom t!e natura$ a& in/u&tr, an/ t!e re&u$tin

imact on t!e c$imate cri&i&, !ave een ut ac# near$ t!ree ear&.


10/66


ama to a//re&& t!e i&&ue o2 met!ane $ea#in 2rom exi&tin oi$ an/ a& ro/uction &ite& (&ee

+en/ix ;).

3; i& current$ t!e &tan/ar/ in&trument in t!e natura$ a& in/u&tr wor$/wi/e 2or mea&urin

met!ane emi&&ion&.

t!e +merican %aron "ei&tr (+%" '010), an/ t!e :nite/ *ation& %$ean Deve$oment ec!ani&m

(:* %D '009).

o&t imortant, !owever, t!e 3; i& a$&o u&e/ to rioritiFe t!e reair o2 natura$ a& $ea#&, an/ i2

a $are $ea# were not reaire/ ecau&e t!e 3; un/ere&timate/ it, t!i& cou$/ $ea/ to cata&tro!ic

comonent 2ai$ure an/Mor ex$o&ion.

A 7I27L5 C('I3L 17I&TL3LO1(


11/66


9

r. 3owar/ !a& aine/ t!e re&ect o2 co$$eaue& acro&& t!e 2ie$/ an/ o2 $ea/in re&earc!er&, 2or

exam$e, Dr. "oert 3owart! o2 %orne$$ :niver&it, a $ea/in re&earc!er o2 met!ane emi&&ion& an/

t!eir imact& on c$imate c!ane. (ee Dr. 3owart!& $etter en/or&in r. 3owar/& wor#, +en/ix

=.)

er!a& mo&t &a$ient to t!i& com$aint i& t!at, in a//ition to E+& re$iance on r. 3owar/&exerti&e, ED; wa& we$$ aware o2 !i& cre/entia$& ecau&e !i& in&trument&, trainin, 2ie$/

mea&urement&, an/ ana$&i& were ein u&e/ 2or t!e Wa&!inton tate :niver&it &tu/ o2

met!ane emi&&ion& 2rom natura$ a& /i&triution &&tem&, w!ic! ED; a$&o &on&ore/. Dr. +$$en

initia$$ re$ie/ &ini2icant$ on r. 3owar/, reconiFin t!at r. 3owar/& exerti&e in emi&&ion

mea&urement&, articu$ar$ wit! !i! 2$ow &am$in tec!no$o, excee/e/ t!at o2 t!e :< team G

unti$ !e i/enti2ie/ ro$em& wit! t!eir !i!-ro2i$e &tu/ie&. (ee +ttac!ment 3, 8ita o2

c$ean water ru$e& (on '016). Emi&&ion& 2actor& were /eve$oe/ in t!e ear$ 1990& an/ nee/ to e

u/ate/ to re2$ect t!e increa&e in 2rac#e/ we$$& (on an/ a$e '015).

n/ee/, unti$ a 1', '016, w!en t!e E+ re$ea&e/ it& 2ina$ ru$e on emi&&ion &tan/ar/& 2or new oi$

an/ a& we$$& an/ we$$-&ite eAuiment (E+ '016), t!ere wa& no 2e/era$ reu$ation an/ ver $itt$e

&tate reu$ation o2 met!ane $ea#ae an/ ventin 2rom natura$ a& ro/uction.

re$ea&e ru$e& 2or exi&tin we$$&, &o met!ane emi&&ion& 2rom 75 o2 oi$ an/ a& eAuiment are &ti$$

not reu$ate/.

Let t!e a& in/u&tr i& /iin in it& !ee$& an/ vowin to 2i!t t!e new E+ ru$e&, com$ainin t!e

ru$e& are an economic ur/en (Davenort '016). :n2ortunate$, t!i& 2i!t wi$$ e wae/ u&in

2au$t /ata 2rom t!e &cienti2ica$$ inva$i/ :< &tu/ie&. Even more concernin, t!o&e /ata were

ro/uce/ &cienti&t& wit! a roa$e ia&, i2 not a /irect con2$ict o2 intere&t, /ue to t!eir rior

a&&ociation& wit! t!e in/u&tr G &ee /i&c$o&ure& at +$$en et a$. ('01H) an/ +$$en et a$. ('014). *inet

ercent o2 t!e 2un/in 2or Dr. +$$en& '01H &tu/ came 2rom t!e oi$ an/ a& in/u&tr.

"e$iance on t!e +$$en &tu/ie& !a& a$$owe/ t!e oi$ an/ a& in/u&tr to continue to c$aim t!at

emi&&ion& are $ow an/ t!at, a& a re&u$t, no reu$ation i& nee/e/.

(+) !ai$e/ t!e conc$u&ion& o2 +$$en et a$. ('01H) a& BrovinC t!at emi&&ion& are $ow (Wine& '01H),wit! ot!er in/u&tr rou& toutin Bexcee/in$ $ow $ea#ae rate&,C an/ c$aimin t!at, /e&ite

/ramatic increa&e& in : natura$ a& ro/uction &ince '005, met!ane emi&&ion& 2rom natura$ a&

ro/uction !ave 2a$$en H &ince '005 (rown '015).

%omment& &umitte/ + on E+& /ra2t nventor# of U.S. reenhouse as missions and Sin3s,

144*215 &uort t!e 2in/in& o2 +$$en et a$. ('01H) an/ +$$en et a$. ('014), minimiFe t!e concern&

rou!t u 3owar/ ('015) an/ &uort u&e o2 t!e 3;, notin t!at Bt!e 3i-;$ow in&trument


12/66


10

i& one o2 a ver 2ew exi&tin /evice& 2or co&t-e22ective$ Auanti2in natura$ a& emi&&ion& 2rom

2uitive an/ ventin at t!e emi&&ion &ourceC (+ '016).

n/u&tr a$&o c$aim& t!at emi&&ion& 2rom &!a$e a&in& (rown '014) an/ natura$ a& extraction are

/own &ini2icant$ (Der '016) t!an#& to t!e 2in/in& o2 t!e 2$awe/ +$$en &tu/ie&. Even more

trou$e&ome, t!e in/u&tr !a& cite/ +$$en et a$. ('01H) a& roo2 o2 2ar $ower $ea#ae rate&, c$aimint!at &i#in met!ane emi&&ion& are /ue to wet$an/& an/ aricu$ture, an/ t!at natura$ a& wi$$

actua$$ &o$ve t!e c$imate ro$em (rown '016).

n re&on&e to an E+ ru$e roo&e/ in etemer '015 (;e/era$ "ei&ter '015), $oa$ oi$ an/ a&

$aw 2irm Jone& Da a&&ert& t!at reu$ation& are not nee/e/, an/ com$ain& aout ru$e& coverin

comre&&or&, neumatic& an/ &torae tan#&, a$&o oectin to t!e roo&e/ reAuirement t!at

$ea#& e reaire/ wit!in 15 /a&. Jone& Da an/ oi$ an/ a& $aw 2irm racewe$$ (n/er '016) eac!

a&&ert t!at t!e co&t to cature emi&&ion& cou$/ excee/ t!e /irect monetar va$ue o2 t!e recovere/

natura$ a& (Jone& Da '015).

CONCL%&ION

Dr. +$$en wa& %!air o2 t!e E+ cience +/vi&or oar/ /urin t!e erio/ a//re&&e/ in t!i&

com$aint. E+ !a& re$ie/ uon Dr. +$$en, &o !e !a/ a &ecia$ o$iation to a//re&& t!e 2$aw& in !i&

&tu/ie& an/ 2u$$ /i&c$o&e t!i& an/ #nown ro$em& wit! t!e 3; to E+ o$ic ma#er&.

i& an E+-arove/ in&trument an/ i& current$ t!e &tan/ar/ in&trument in t!e natura$ a& in/u&tr

wor$/wi/e 2or mea&urin met!ane emi&&ion& 2rom ventin an/ $ea#ae. +$t!ou! ura/in it&

2irmware ma re/uce &en&or 2ai$ure, it /oe& not e$iminate it, an/ it i& $i#e$ t!at mo&t 3;& in u&e

!ave o$/er 2irmware more &u&ceti$e to &en&or 2ai$ure.

re&u$t in $are $ea#& ein reorte/ a& an or/er o2 manitu/e &ma$$er t!an t!e actua$$ arere&ent& a 2ri!tenin &a2et an/ u$ic !ea$t! i&&ue an/ an aect 2ai$ure E+ to !e$ &tem

$oa$ c$imate /i&rution.

attac!e/ ex!iit& /emon&trate c$ear exam$e& o2 2rau/ re$atin to t!e &tu/ie& con/ucte/ on E+&

e!a$2, &tu/ie& E+ !a& re$ie/ uon to reare ru$e&, ui/ance /ocument&, an/ emi&&ion

&tan/ar/&. E+ !a& wa&te/ it& 2un/& exen/in count$e&& !our& 2o$$owin u on t!e 2$awe/

&tu/ie&.

rearation, an/ /i&&emination o2 t!e +$$en &tu/ie&. ca&e, t!e E+ = i& reAuire/ to inve&tiate 2rau/ an/ 2a$&e &tatement& ur&uant to 1 :..%. N

1001.


13/66


11


14/66


15/66


16/66

NC WARN Complaint to EPA Inspector General June 8, 2016

A-1

APPENDIX A. Allegations

A !cope o" Re#ie$

%&e EPA pro#i'es t&e "ollo$in( 'e"initions an' e)amples o" *rau', Waste an' A+use EPA2016c.

Fraud. a "alse representation a+out a material "act, an/ intentional 'eception 'esi(ne' to

unla$"ull/ 'epri#e t&e nite' !tates or EPA o" somet&in( o" #alue or to secure "or an in'i#i'ual

a +ene"it, pri#ile(e, allo$ance or consi'eration to $&ic& &e or s&e is not entitle', ina'euate or

missin( 'ocumentation, 'ela/s in pro'ucin( reueste' 'ocumentation, "alse or mislea'in(

in"ormation, lac o" communication an'3or support "or et&ical stan'ar's +/ mana(ement

Waste. in#ol#es t&e ta)pa/ers not recei#in( a reasona+le #alue "or mone/ in connection $it&

an/ (o#ernment-"un'e' acti#ities 'ue to inappropriate act or omission 4ost $aste 'oes not

in#ol#e a #iolation o" la$, +ut relates primaril/ to mismana(ement, inappropriate actions, an'

ina'euate o#ersi(&t

Abuse. +e&a#ior t&at is 'e"icient or improper, misuse o" aut&orit/, misusin( t&e o""icial5s

position "or personal (ain, an' con"lict o" interest A+use 'oes not necessaril/ in#ol#e "rau' or

#iolations o" la$s, re(ulations, or pro#isions o" a contract

%&e EPA IG also re#ie$s complaints o" EPA-relate' criminal acti#it/ In t&is case, t&e EPA IG is

reuire' to in#esti(ate "rau' an' "alse statements pursuant to 18 !C 7 1001.

a E)cept as ot&er$ise pro#i'e' in t&is section, $&oe#er, in an/ matter $it&in t&e uris'iction o" t&e e)ecuti#e, le(islati#e, or u'icial +ranc& o" t&e Go#ernment o" t&e

nite' !tates, no$in(l/ an' $ill"ull/9

1 "alsi"ies, conceals, or co#ers up +/ an/ tric, sc&eme, or 'e#ice a material

"act:

2 maes an/ materiall/ "alse, "ictitious, or "rau'ulent statement or

representation: or

; maes or uses an/ "alse $ritin( or 'ocument no$in( t&e same to contain

an/ materiall/ "alse, "ictitious, or "rau'ulent statement or entr/:

s&all +e "ine' un'er t&is title, imprisone' not more t&an < /ears or, i" t&e o""ense

in#ol#es international or 'omestic terrorism as 'e"ine' in section 2;;1, imprisone'not more t&an 8 /ears, or +ot& I" t&e matter relates to an o""ense un'er c&apter 10=A,

10=>, 110, or 11?, or section 1


17/66


A-2

> @ist o" !peci"ic Alle(ations

a Phase I Study (Allen et al. 2013): The principal researcher of the Uniersity of

Te!as at Austin studies" #r. #aid Allen" $ho $as %PA Science Adisory &oard

'hair fro 2012 to 201" isused his authority" *ae false or isleadin*

inforation" proided inade+uate docuentation and delayed producin*re+uested docuentation" thus inii,in* and failin* to disclose to the %#-

Production roup (%#- staff scientists and ana*ers" the Technical /orin*

roup" representaties fro proect sponsors" the Steerin* 'oittee and the

Science Adisory 'oittee) the serious alfunctionin* of the &acharach i

-lo$ Sapler (&-S)" the tool used to easure ethane leaa*e in Allen et al.

(2013). #r. Allen ne$ or should hae no$n that the alfunctionin* &-S

resulted in inalid data that should not hae 4een used for the Allen et al. (2013)

results.

i In cto+er 201;, r Allen, $&o le' t&e % team "or t&e P&ase I stu'/

t&at 'irectl/ measure' met&ane leaa(e in t&e natural (as pro'uction

sector, $as in"orme' +/ 4r Bo$ar' o" t&e "act t&at t&e main

measurement tool +ein( use' "or t&e P&ase I stu'/ Allen et al 201;, t&e

>B*!, $as mal"unctionin( !ince t&e >B*! is a $i'el/ use' tool to

measure natural (as met&ane emissions, t&is means t&at in#ali' results

&a#e $i'esprea', pro"oun' implications Rat&er t&an act on t&is

in"ormation +/ 'isclosin( it to ot&er researc& participants, r Allen

misuse' &is aut&orit/, an' (a#e "alse or mislea'in( in"ormation to t&e

E* Pro'uction Group +et$een cto+er 201; an' Januar/ 201,

minimiDin( 4r Bo$ar'5s concerns

ii >et$een No#em+er 201; an' Januar/ 201, r Allen no$in(l/

misrepresente' to 4r Bo$ar' t&at r Allen $oul' stop t&e ne)t p&ase

o" t&e researc&, P&ase II Allen et al 201, 'ue to 4r Bo$ar'5s concerns

a+out t&e >B*! mal"unctionin( r Allen misuse' &is aut&orit/ +/ "alsel/

tellin( 4r Bo$ar' t&at r Allen $oul' in#ol#e 4r Bo$ar' in ualit/

assurance "or P&ase II, $&ic& "ocuse' on emissions "rom pneumatic

'e#ices usin( t&e >B*! as $ell as *o) "lo$ meters

iii %&is 'ela/ also resulte' in 4r Bo$ar'5s ina+ilit/ to respon' pu+licl/ in a

scienti"ic ournal, t&e Procee'in(s o" t&e National Aca'em/ o" !ciencesPNA!, a+out &o$ pro+lems $it& t&e >B*! mi(&t a""ect Allen et al

201; r Allen5s no$in( misrepresentations to 4r Bo$ar' t&at t&e/

$oul' colla+orate on t&is issue resulte' in t&e e)piration o" t&e t&ree-

mont& $in'o$ cto+er to ecem+er 201; t&at 4r Bo$ar' &a' to

respon' pu+licl/ in t&e ournal PNA! to r Allen an' t&e % team on t&e

mal"unctionin( o" t&e >B*!


18/66


A-;

i# %&ere"ore, t&ese 'ela/s an' intentional misrepresentations resulte' in a

misuse o" "un's +/ t&e EPA, since r Allen, as C&air o" t&e EPA !cience

A'#isor/ >oar', ne$ or s&oul' &a#e no$n t&at t&e mal"unctionin( o"

t&e >B*! resulte' in +a' 'ata "or Allen et al 201; %&ese intentional

misrepresentations raise serious uestions a+out t&e scienti"ic #ali'it/ o"

t&e "in'in(s in Allen et al 201; an' 'emonstrate a clear con"lict o"interest in r Allen5s pu+lication o" 'ata &e ne$ or s&oul' &a#e no$n

to +e "alse As an EPA emplo/ee at t&e time, r Allen &a' a clear 'ut/ to

in#esti(ate un'erreportin( o" t&e >B*!

4. Phase II Study (Allen et al. 201" pneuatics): #r. Allen isused his authority"

*ae false or isleadin* inforation" proided inade+uate docuentation and

delayed producin* re+uested docuentation 4y inii,in* and failin* to disclose

to the %#- Production roup the serious alfunctionin* of the &acharach i3-lo$

Sapler (&-S). #r. Allen ne$ or should hae no$n that the alfunctionin*

&-S" as $ell as pro4les $ith the -o! flo$ eters" resulted in inalid data. #r.

Allen and the UT tea isrepresented to 5r. o$ard that his concerns $ould 4e

addressed. In refusin* to address the issue of inalid data" and refusin* to

counicate further $ith 5r. o$ard" #r. Allen6s actions resulted in delay and

isuse of %PA funds.

i In 4arc& 201, 4r Bo$ar' an' in'ustr/ collea(ues con'ucte' "iel' tests

o" t&e ni#ersit/ o" %e)as % >B*! an' *o) "lo$ meters on pneumatic

'e#ices %&ese "iel' tests $ere not part o" P&ase I or P&ase II % stu'ies,

+ut $ere 'one separatel/ 'urin( t&e P&ase II stu'/ time"rame as a result

o" t&e concerns o" 4r Bo$ar' an' % team mem+ers a+out t&emal"unctionin( o" t&e >B*! Pneumatic 'e#ices 'eser#e special attention

as t&e EPA reports t&ere $ere =??,000 pneumatic 'e#ices use' in !

natural (as pro'uction in 2012

ii In 4arc& 201, in connection $it& t&ese "iel' tests, 4r Bo$ar' ma'e an

a(reement $it& mem+ers o" t&e % team to present a oint statement to

t&e E* pro'uction committees a+out t&e pro+lems $it& +ot& t&e >B*!

an' *o) "lo$ meters, an' &o$ t&ese pro+lems ma/ &a#e a""ecte'

researc& results Bo$e#er, rat&er t&an $or on a oint statement, t&e %

team imme'iatel/ presente' t&e 4arc& 201 test results o" t&e >B*!$it&out 4r Bo$ar'5s no$le'(e or input

1 Bo$e#er, $&et&er

pro+lems $it& t&e *o) "lo$ meter $ere 'isclose' in t&at meetin( is

unno$n

1 %&ese test results "rom t&e 4arc& 201 "iel' tests $ere inclu'e' in +ot& Bo$ar' et al 201


19/66


A-

iii

r Allen t&en re"use' to communicate "urt&er $it& 4r Bo$ar',

resultin( in a "urt&er 'ela/ o" t&e in#esti(ation +ecause 4r Bo$ar'

assume' &e $as still colla+oratin( $it& t&e % team on P&ases I an' II

$&en, in "act, t&e % team &a' no intention o" $orin( $it& &im >/

pre#entin( 4r Bo$ar'5s input, t&e % team $as a+le to minimiDe t&epro+lems $it& t&e >B*! to all team mem+ers, inclu'in( t&e E*

Pro'uction Group

i#

%&e pro+lems $it& t&e P&ase II 'ata set, $&ic& 4r Bo$ar' ma'e clear to

t&e % team in emails a#aila+le upon reuest,2 inclu'e'.

1 No routine cali+ration on t&e *o) "lo$ meters $&ile in t&e "iel'

2 ne *o) "lo$ meter out o" t$o t&at $ere use' in t&e stu'/ $as

rea'in( "ar too lo$, an' $it&out routine cali+rations t&ere $as no

$a/ to 'etermine i" t&e ot&er meter also &a' pro+lems

# 4att Barrison, a mem+er o" t&e % team, tol' 4r Bo$ar' in an email

'ate' 632;31 a#aila+le upon reuest t&at &e $as tain( a +i(

scienti"ic risF in pu+lis&in( &is results criticiDin( Allen et al 201;

$it&out "irst seein( t&e P&ase II 'ata r Allen &a' pre#iousl/ asserte'

t&at i" 4r Bo$ar' complete' a Non-isclosure A(reement NA, &e

$oul' +e a+le to see t&e P&ase II 'ata Bo$e#er, e#en a"ter 4r Bo$ar'

complete' an NA, r Allen $it&&el' t&e 'ata &e &a' promise' 4r

Bo$ar' etaile' timeline a#aila+le

#i

>ecause t&e % team re"use' to 'isclose t&e P&ase II 'ata, 4r Bo$ar'&a' no $a/ to e#aluate t&e % team5s assertion t&at t&e P&ase II results

con"irme' r Allen5s conclusions t&at pro+lems $it& t&e >B*! 'i' not

a""ect t&e P&ase I results %&e P&ase II 'ata $ere ne#er ma'e a#aila+le to

4r Bo$ar' until t&e/ $ere pu+lis&e' si) mont&s later, in late 201

Allen et al 201, an' t&e results s&o$e' t&at 4r Bo$ar'5s anal/sis $as

correct

#ii r Allen pu+lis&e' t&e Allen et al 201 pneumatic 'ata +ut 'i' not

'isclose t&e tests t&at 4r Bo$ar' con'ucte' in 4arc& 201 s&o$in(

t&at t&e per"ormance o" one o" t&e *o) "lo$ meters use' $as "ar $orset&an in'icate' in t&eir supplemental in"ormation 4r Bo$ar' pu+lis&e'

2 4r Bo$ar' re#ie$e' t&e meter pro+lems in an email e)c&an(e $it& 4att Barrison 201-0;-21 4att Barrison

in $&ic& 4r Barrison su((ests 4r Bo$ar' tae t&e re"erence to t&e meter out o" t&e oint statement 4s Carrie

Reese $it& Pioneer Natural Resources con"irme' s&e &a' noti"ie' E* o" t&e meter pro+lem 201-0


20/66


A-<

a comment on Allen et al 201 Bo$ar' 201


21/66


A-6

1 %&at r Allen pu+lis&e' tan 'ata on t&e % $e+site t&at &e

ne$ $ere in#ali' $it&out an/ notation t&at t&e/ mi(&t +e "ault/:

2 %&at r Allen $as a$are t&at t&e >B*! $as un'erreportin( 'ata

"or tan emissions +ut did not report this to EPA, e#en t&ou(& &e

$as c&air o" t&e EPA !cience A'#isor/ >oar' an' t&e >B*! is

appro#e' +/ EPA to mae !u+part W measurements o" tans in

t&e transmission, stora(e an' processin( sectors: an'

; %&at r Allen ne$, $&en 4r Bo$ar' "irst reporte' &is concerns

a+out t&e >B*! sensor "ailure in late 201;, t&at t&e >B*! $as

un'erreportin( tan emissions, so t&at r Allen s&oul' &a#e

acte' on 4r Bo$ar'5s concerns imme'iatel/

iii %&ere"ore, t&e 'ela/s, use o" "alse or mislea'in( in"ormation, no$in(

misrepresentations an' lac o" communication in a''ressin( pro+lems

$it& t&e tan 'ata &a#e resulte' in a no$in( misuse o" EPA resources

d.

#r. Allen" as principal researcher" had a duty to inesti*ate and disclose to the

%PA issues that indicated seere pro4le(s $ith the &2-S" the tan0 data and the

Phase II pneu(atic deice study.

i As c&air o" t&e EPA !cience A'#isor/ >oar', r Allen &a' a le(al, et&ical

an' moral 'ut/ to in#esti(ate an' 'isclose issues in &is researc& t&at

in'icate' suc& a se#ere pro+lem $it& t&e >B*!, a $i'el/-use' instrument

appro#e' +/ EPA "or !u+part W Green&ouse Gas emission measurements

EPA 2016+, $it& enormous en#ironmental, &ealt& an' sa"et/

implications, inclu'in(.

1 t&e impact on climate o" un'erreporte' met&ane emissions

'ue to >B*! sensor "ailure in Allen et al 201; as $ell as on

ot&er GBG in#entories suc& as EPA !u+part W, since suc&

un'erreportin( coul' a'#ersel/ a""ect pu+lic polic/:

2 t&e impact on communit/ &ealt& "rom un'erestimates o" air

to)ic emissions in#entories t&at ma/ also +e 'eri#e' "rom

in#entories suc& as t&ose liste' in 1 a+o#e: sites $it& &ea#ier

&/'rocar+ons &a#e +ot& t&e (reatest air to)ics impact an' t&e

(reatest lieli&oo' o" un'erreportin( 'ue to >B*!, an' t&is

un'erreportin( coul' pre#ent polic/ maers "rom tain(

a'euate action to protect t&e &ealt& o" communities near oil

an' (as "acilities: an'

; t&e impact on sa"et/ an' &ealt& resultin( "rom si(ni"icant

leas (oin( uni'enti"ie' an' unrepaire' 'ue to >B*! sensor


22/66


A-?

"ailure, since lar(e leas coul' lea' to catastrop&ic "ailure as

$ell as contri+ute si(ni"icantl/ to air pollution impact on

near+/ communities

ii r Allen too speci"ic actions to 'ela/ t&e >B*! un'erreportin(

in#esti(ation an' 'isclosure, an' to 'iscre'it t&e #ali' concerns o" 4r

Bo$ar', inclu'in(.

1 repeate'l/ lea'in( 4r Bo$ar' to +elie#e t&at t&e % team

$oul' colla+orate $it& &im to in#esti(ate an' 'isclose t&e

>B*! sensor "ailure:

2 lea'in( E* sta"" an' committees to +elie#e t&at &e $oul'

a''ress t&e issue o" >B*! sensor "ailure $it& 4r Bo$ar'

$&ile actuall/ re"usin( to communicate $it& 4r Bo$ar': an'

;

'isseminatin( ar(uments a(ainst t&e e""ect o" >B*! sensor"ailure on t&e P&ase I 'ata set t&at r Allen ne$ to +e "alse

in a con"i'ential memo Appen'i) > $it&out (i#in( 4r

Bo$ar' an/ noti"ication or opportunit/ to respon'

iii Comments sent to EPA +/ r Allen on leas Allen 201a an'

pneumatics Allen 201+ su+mitte' in June 201 inclu'e' 'ata r Allen

ne$ to +e "alse an' mislea'in(

i# %&ere"ore, t&e 'ela/s, no$in( misrepresentations an' lac o"

communication in a''ressin( pro+lems $it& t&e >B*! an' *o) "lo$meters resulte' in a no$in( misuse o" EPA resources

e. The confidential" undated re4uttal eo (Appendi! &) that #r. Allen distri4uted

to e4ers of the production tea $as intended to islead the %#- production

coittees a4out the si*nificance and scope of the pro4les $ith the &2-S.

i >et$een Jul/ an' cto+er 201, r Allen $rote a con"i'ential re+uttal

memo t&at $as 'istri+ute' to E* an' its pro'uction committees

aca'emic an' in'ustr/ representati#es, $it&out 4r Bo$ar'5sno$le'(e or input %&is re+uttal memo ar(ue' t&at 4r Bo$ar' $as

$ron( a+out t&e >B*! sensor "ailure5s e""ect on t&e Allen et al 201;

stu'/

ii %&is re+uttal memo $as not release' to t&e pu+lic an' $as onl/ o+taine'

t&rou(& a *ree'om o" In"ormation Act reuest


23/66


A-8

iii 4r Bo$ar' $as ne#er allo$e' to spea $it& mem+ers o" t&e E*

pro'uction committees at an/ time, e#en a"ter t&e re+uttal memo came

to li(&t, so t&at t&e issue o" >B*! "ailure $as ne#er a''resse'

i# r Allen5s re+uttal "aile' to 'isclose t&at t&e % >B*! teste' in 4arc&

201 &a' a ne$er #ersion o" "irm$are t&an $&en use' in P&ase I an' t&atBeat& Consultants, 'istri+utor o" t&e >B*! as $ell as t&e compan/ $it&

t&e most e)perience $it& t&e >B*!, &a' reporte' t&at ne$ "irm$are &a'

a''resse' soe o" t&e pro+lems $it& t&e >B*! un'erreportin( o"

met&ane leas

# %&ere"ore, r Allen no$in(l/ misrepresente', an' "aile' to 'isclose

material in"ormation &e ne$ or s&oul' &a#e no$n to +e incorrect in

t&e re+uttal memo, resultin( in a misuse o" EPA resources

f. #r. Allen and the UT tea also isled the editor and readers of En#ironmental

!cience H %ec&nolo(/ in #r. Allen6s response (Allen 2018) to 5r. o$ard6s

coent (o$ard 2018a) on Allen et al. (201).

i r Allen "aile' to 'isclose t&at t&e % >B*! teste' in t&e % la+orator/

an' in t&e 4arc& o" 201 "iel' testin( &a' a ne$er #ersion o" "irm$are

t&an $&en use' in P&ase I an' t&at Beat& Consultants state' t&at ne$

"irm$are &a' a''resse' onl/ some o" t&e pro+lems $it& t&e >B*!

ii r Allen asserte' t&at t&e 4arc& 201 "iel' tests con'ucte' +/ 4r

Bo$ar' in t&e presence o" mem+ers o" t&e % team $ere not 'onecorrectl/ an' t&at proper protocols $ere not "ollo$e'

iii %&ere"ore, r Allen no$in(l/ misrepresente' an' "aile' to 'isclose

material in"ormation &e ne$ or s&oul' &a#e no$n a+out t&e up'ate'

"irm$are an' its e""ect on t&e pro+lems $it& t&e >B*!, resultin( in a

misuse o" EPA resources

*. In 5arch 201" #r. Allen failed to disclose to %PA" industry and &acharach" Inc.

that &-S sensor failure had 4een clearly deonstrated" and that pro4les $ith

the &-S appeared to hae 4een only partially resoled $ith updated fir$areand fre+uent cali4rations.

i r Allen ne$ or s&oul' &a#e no$n t&at &is e""orts to pre#ent

in#esti(ation an' 'isclosure o" t&e >B*! sensor "ailure $oul' liel/ result

in in#ali' stu'/ results


24/66


A-=

ii Conseuentl/, at least an a''itional t$o /ears o" EPA !u+part W

emissions 'ata ma/ &a#e +een un'erreporte' In a''ition, communit/

&ealt& an' $orer sa"et/ ma/ &a#e +een nee'lessl/ impacte'

iii %&ere"ore, r Allen no$in(l/ misrepresente', an' "aile' to 'isclose

material in"ormation &e ne$ or s&oul' &a#e no$n to +e incorrect$&en &e asserte' t&at up'ate' "irm$are an' more "reuent cali+rations

resol#e' t&e pro+lems $it& t&e >B*!, resultin( in a misuse o" EPA

resources

h. As deonstrated in his disclosure stateents in Allen et al. (2013) and Allen et al.

(201)" #r. Allen has a lon* history of consultin* for industry and leadin*

industrycontrolled and industryfunded studies. is 4iases" and direct conflict of

interest" ay hae contri4uted to his failure to disclose alfunctionin* tools and

faulty data.


25/66


B1

APPENDIX B. Discussion of Confidential Allen Memo

Statement by Touché o!a"d

In !cto"er o# 201$, %&ile a''ressin( m) concerns a"out sensor #ailure in t&e Bac&arac& *i+lo%

ampler -B*+. /ia con#erence call %it& t&e American Petroleum Institute, one o# t&e

participants sai', I 'ont e/en no% %&) %ere &a/in( t&is call3 I &a/e a memo #rom 4a/i' Allen

sa)in( t&is isnt a pro"lem35 W&en I later ase' %&) I &a'nt "een s&o%n t&is memo, att

*arrison o# 7R Corporation sai' t&at it %as con#i'ential "ut t&at it #ocuse' on re(ional

'i##erences an' also t&e P&ase II results -Allen et al3 -201$., at t&at time not )et pu"lis&e'.3 I

%as /er) surprise' to learn o# t&e eistence o# t&is memo, since I %as (i/en no opportunit) to

respon' to it or to un'erstan' its contents, an' it %as clear t&at it minimi9e' t&e pro"lem o#

B*+ sensor #ailure3 E/en a#ter pu"lication o# Allen et al3 -201$., a#ter %&ic& t&e contents o# t&e

memo %oul' no lon(er "e con#i'ential 'ue to P&ase II 'ata, m) repeate' re:uests to E4+ an'

4r3 Allen to see t&is memo %ere i(nore'3

;&e memo -Anal)sis o# *i+lo% ampler Cross!/er Per#ormance in 7ni/ersit) o# ;eas

et&ane tu'ies5. %as e/entuall) release' un'er a ;eas !pen Recor's Act re:uest in

No/em"er o# 201< -alt&ou(& I onl) 'isco/ere' t&at in April o# 2016. an' is attac&e' at t&e en'

o# t&is appen'i3 7n#ortunatel), t&e ar(uments ma'e in t&is memo are not onl) #ault), "ut also

ones t&at 4r3 Allen an' &is collea(ues &a' reason to no% %ere incorrect3 Conse:uentl), it

appears t&at 4r3 Allen speci#icall) trie' to mislea' E4+ an' its pro'uction committees a"out t&e

se/erit) o# t&e B*+ #ailure issue an' its e##ect on Allen et al3 -201=.3 ;&e ar(uments ma'e in

t&e memo are 'iscusse' "elo%3

1. ;&e memo states t&at la"orator) testin(, 'one in t&e #all o# 201=, s&o%e' t&at t&e 7;

B*+ 'i' not e&i"it sensor #ailure3 *o%e/er>

a3 All o# t&is testin( %as 'one a#ter t&e 7; B*+ #irm%are %as up(ra'e', "ut t&e

memo eclu'es t&at point an' maes no mention an)%&ere t&at *eat&

Consultants tec&nicians &a' reporte' t&at up(ra'e' #irm%are &a' 'ramaticall)

impro/e' t&e per#ormance o# B*+s t&at %ere no%n to "e un'erreportin(3

"3 ;&e 7; person in c&ar(e o# la"orator) testin( reporte' t&at t&e) cali"rate' t&eir

B*+ "e#ore e/er) test, %&ic& %as not t&e protocol use' in Allen et al3 -201=. as

reporte' ") a 7R #iel' tec&nician3 Recent cali"ration %as seen to eliminate t&e

sensor #ailure on t&e 7; instrument -%&ic& &a' ne% #irm%are. 'urin( t&e arc&

201$ #iel' testin(3

2. ;&e memo states t&at t&e arc& 201$ #iel' testin( I con'ucte' s&o%e' onl) one #ailure,

an' t&at #ailure %as not representati/e "ecause t&eir protocol %as to cali"rate an) time

t&e instrument %as turne' on an' t&e test emission rate o# 60 sc#& -stan'ar' cu"ic #eet

per &our. %as (reater t&an ?8@ o# t&e Allen et al3 -201$. emission rates3 *o%e/er>

a3 A(ain, t&e) 'o not 'isclose t&at t&e arc& 201$ testin( %as con'ucte' on

samplers t&at &a' t&eir #irm%are up(ra'e', an' t&at t&is up(ra'e %as reporte'


26/66


B2

to 'ramaticall) impro/e t&e per#ormance o# B*+s t&at %ere un'erreportin(

lea rates3

"3 4urin( t&e arc& 201$ #iel' tests, I %as (i/en t&e 7; B*+ to test a#ter t&e 7;

team &a' con'ucte' a "ump test -as oppose' to a #ull cali"ration.3 ;&e 7; team

ne/er su((este' prior to t&e testin( t&at it s&oul' "e #ull) cali"rate' an' onl)

per#orme' suc& a cali"ration after t&e sensor #ailure occurre'3 Anot&er #iel'

tec&nician #rom 7R speci#icall) state' t&at t&e) 'i'nt routinel) cali"rate 'urin(

Allen et al3 -201=. -P&ase I. or 'urin( t&e %or &e &a' 'one on Allen et al3 -201$.

-P&ase II, on(oin( at t&e time o# t&ese tests.3 ;&is %as corro"orate' ") t&e #act

t&at t&e 7; B*+ internal lo( in'icate' t&at it &a' not "een cali"rate' #or t%o

%ees prior to t&ese tests, e/en t&ou(& it %as "ein( use' #or t&e 7; P&ase II

pro(ram 'urin( t&at time3

c3 ;&e complaint t&at t&e test #lo% rate %as at)pical "ecause it %as (reater t&an

?8@ o# t&e sources measure' 'urin( P&ase II is /er) mislea'in(, as t&e 7; team

no%s3 ;&e test #lo% rate o# 60 sc#& is actuall) a relati/el) lo% emission rate t&att&e B*+ mi(&t nee' to measure in an) routine #iel' measurement pro(ram3

oreo/er, as "ot& Allen et al3 -201=. an' Allen et al3 -201$. point out an' as &as

"een s&o%n in ot&er stu'ies, t&e lar(e emitters are t&e most important3 ;&e 7;

team no%s t&at it is critical t&at t&e B*+ "e a"le to accuratel) measure t&e

lar(er emission rates3 Results #rom t&e 2@ o# pneumatic 'e/ices measure' in

Allen et al3 -201$. -P&ase II. t&at %ere lar(er t&an t&e test #lo% rate o# 60 sc#&

accounte' #or =1@ o# t&e total emission rate measure' in t&at %or3 In t&e +ort

Wort& stu') -ERG 2011., 10@ o# all t&e sources measure' ") B*+ %ere 60 sc#&

an' ma'e up 6=@ o# t&e total emission rate, an' se/eral sources %ere o"ser/e'

to "e at t&e top capacit) o# t&e B*+3 ources 03$ sc#m -2$ sc#&, t&e

approimate emission rate re:uirin( t&e B*+ to transition to its &i(& scale. in

t&e +ort Wort& stu') ma'e up 20@ o# all sources "ut 81@ o# t&e total emission

rate3 B*+ sensor #ailure 'oes not appear to &a/e "een pre/alent 'urin( t&at

stu') -as 'iscusse' in *o%ar' et al3 201

a3 It is not possi"le to accuratel) :uanti#) emissions usin( t&e IR camera 'ue to

/ariations in camera per#ormance an' 'ilution o# t&e source 'ue to %in' spee'

an' tur"ulence c&an(es3 4urin( t&e +ort Wort& stu') -ERG 2011. t&e 'ail) IR

camera per#ormance c&ecs in'icate' o/er an or'er o# ma(nitu'e /ariation in

&o% %ell a no%n source coul' "e 'etecte'3


27/66


B=

$. ;&e memo states t&at t&e a/era(e o# pneumatic 'e/ice emission measurements Allen et

al3 -201=. ma'e ") t&e B*+ are (reater t&an in Allen et al3 -201$., ma'e ") +o #lo%

meters, an' t&en (oes on to state t&at i# B*+ sensor #ailure &a' cause' un'erreportin(

in t&e 201= stu'), t&e 201= emission rates %oul' &a/e "een lo%er t&an 201$3 *o%e/er>

a3 ;&e 201= pneumatic measurements ma'e ") B*+ ina'/ertentl) #ocuse' almost

eclusi/el) on 'e/ices t&at %ere emittin( -o/er ?


28/66

B-4


29/66

-


30/66

-


31/66

-


32/66

-


33/66

F o r R

e v i e w O n

l y

Comment on “University of Texas study underestimatesnational methane emissions inventory at natural gas

production sites due to instrument sensor failure”

Journal: Energy Science & Engineering

Manuscript ID: ESE-2015-08-0064

Wiley - Manuscript type: Response

Search Terms: Natural gas, Environment

Abstract:

Howard (2015) claims an underestimation of emissions due to sensor

failure in our report of methane emissions from natural gas productionsites (Allen, et al., 2013). We disagree with these assertions.

APPENDIX C. Unpublished Allen Comments and Howard Response on Howard (2015b)

C-1

http://www.ncwarn.org/http://www.ncwarn.org/


34/66

F o r R

e v i e w O n

l y

Howard (2015) claims an underestimation of emissions due to sensor failure in our report of

methane emissions from natural gas production sites (Allen, et al., 2013). We disagree with

these assertions.

Howard (2015) asserts that the HiFlow® sampler, which has been used extensively in measuring

natural gas emissions since the 1990s, has a design flaw that causes the instrument to fail todetect emissions that have high concentrations of heavier hydrocarbons, and that this sensor

failure caused underestimated emissions in Allen et al. (2013). The primary evidence presented

in support of this hypothesis is data from our previous work (Allen, et al., 2013), in which the

fraction of devices with high emission rates was greater for sites with low heavy hydrocarbonconcentrations in the produced gas (high methane concentrations) than for sites with lower

methane concentration. Howard (2015) is correct in noting that we observed significant

variations in methane emission rates in different natural gas production regions in the UnitedStates, however, he assumes that all regions should have similar emission rates and that therefore

the differences are due to a failure of the HiFlow® sampler; this assumption is flawed. Different

regions have great variations in operating practices, equipment on site, and local regulations. For

example, parts of the Rocky Mountain region where Allen, et al. (2013) made measurements(which has high concentrations of heavier hydrocarbons in produced gas, low concentrations of

methane), require leak detection and repair, control devices on tank venting and the installation

of low bleed controllers. These controls are not currently required in many other regions,causing regional differences in emission rates. Other studies, in addition to Allen, et al. (2013),

have observed regional differences in emission rates. For example, Peischl, et al. (2015) have

reported very different emission rates in different natural gas production regions with highmethane concentrations (dry gas), ranging from a low of 0.18-0.41% of gas production in the

northeast Marcellus, to rates of 1.0 to 2.1% in the Haynesville (a factor of 5 difference between

two regions, both with dry gas (high methane fractions)). These are both regions sampled byAllen, et al (2013) and these differences (a factor of 5) point out the importance of local

regulations, age of equipment, type of equipment and multiple other factors that influence

emission differences between regions, in regions with similar methane content of produced gas.

As additional evidence of a problems with the of the HiFlow® sampler, Howard (2015)

describes field testing of the HiFlow® sampler at a single field site. As described in a recent

rebuttal to a comment that made a similar claim (Allen, et al., 2015a):

“The study team [of Allen, et al., 2013] participated in a two-day field test of several

HiFlow® samplers. Participants in the field testing included our team, the commenter, aconsulting firm, an instrument provider and consulting firm, and a natural gas producer.

During this field test, the UT HiFlow® sampler [the sampler used in Allen, et al. (2013,

2015b)] successfully crossed-over on sites with methane concentrations in the producedgas ranging from 77%−91%. Over two days of testing, the UT HiFlow® sampler crossed-

over successfully in all but one test; that test occurred at a site with produced gas

containing 91% methane. Subsequent examination of the instrument indicated that it had

lost calibration after losing power, then being restarted by personnel not on our study team.The sampling protocol in Allen et al. required a calibration check each time the HiFlow®

sampler was turned on. Once the calibration protocol was followed, the HiFlow® sampler

resumed proper operation.”

ge 1 of 5 Energy Science & Engineering

C-2


35/66

F o r R

e v i e w O n

l y

Howard (2015) notes the successful operation of our HiFlow® sampler at test sites with methane

concentrations as low as 77%, but does not explain how this is consistent with his assertion thatthe HiFlow® instrument consistently fails at low methane concentrations. In the same rebuttal

(Allen, et al., 2015a) we noted that we had also done laboratory testing of the HiFlow® sampler

used by Allen, et al. (2013), and additional data analyses of infrared camera data also collected by Allen, et al. (2013). That information will not be repeated here, but the data and analyses

indicate that sensor failure did not significantly impact the measurements made with the

HiFlow® sampler, in either Allen et al. (2013) or subsequent work using the sampler (Allen, etal., 2015b).

The previously published rebuttal (Allen, et al., 2015a) also compares results among multiple

studies of emissions from pneumatic controllers, using the HiFlow® sampler and other types ofsampling devices. Howard (2015) argues that these comparisons should not be considered.

However, these two studies, using two different measurement methods, showed the same type of

regional distributions of emissions for pneumatic controllers (high emissions per controller in the

Gulf Coast, low emissions per controller in the Rocky Mountains). The average emissionsmeasured using a supply gas meter (Allen, et al., 2015b) were in fact lower, by about a factor of

2, than the emissions reported in Allen, et al. (2013) made using the HiFlow® sampler. This is just the opposite of the effect that would be expected if the HiFlow® sampler were missing high

emitting devices.

Finally, in Allen et al. (2013), measurements were made downwind of about 13-20% of thesampled sites (the percentage depended on the type of site), to independently assess whether the

on-site measurements, including the emissions measured using the HiFlow® sampler, were

accurately quantifying emissions. Howard (2015) uses these data to perform a number ofcomplex comparisons, which focus on percentage differences between the on-site and downwind

measurements, particularly at sites with low methane concentrations in produced gas. These

analyses obscure 2 simple facts.1.

The independent downwind measurements in the Rocky Mountain region (10 sites with

40 wells), the region with the lowest average methane concentration in produced gas,

reported by Allen, et al. (2013), are lower (0.66 standard cubic feet per minute (scf/m)

per site, or 0.17 scf/m per well) than in other regions with higher methane concentrationsin the gas. For example, in the Mid-Continent region, emissions at 5 sites with 10 wells

averaged 3.0 scf/min per site or 1.5 scf/min per well. Thus, the independent downwind

concentrations also found regional differences in emission rates; regions with lowmethane fractions in produced gas were observed in the downwind sampling to have

lower emissions than regions with higher methane fractions.

2. The average per well emissions in the Rocky Mountains, made using independentdownwind sampling at sites with 40 wells, were low. The average emission rates from

these wells were less than half of the emissions that would be expected from just one high

emission rate source per well that Howard (2015) argues should be prevalent at sites withhigh methane concentrations. Simply stated, if there were missing emissions of the

magnitude asserted by Howard (2015), they would have significantly increased measured

downwind concentrations. The downwind data, made completely independently of the

PageEnergy Science & Engineering

C-3


36/66

F o r R

e v i e w O n

l y

HiFlow® measurements, indicate a lower frequency of high emitting sources at sites with

low methane concentrations in produced gas in the Allen, et al. (2013) data set.

Overall, based on multiple independent measurements (IR camera scans, downwind sampling,

and parallel direct flow and HiFlow® measurements) we conclude that sensor failure did not

significantly impact the measurements made with the UT HiFlow®

sampler in either Allen et al.(2013) or Allen, et al. (2015b).

AcknowledgmentsThe authors thank other authors of Allen, et al. (2013, 2015b) and technical experts from the

study sponsors for their input.

DisclosuresThe authors declare the following competing financial interest(s): Lead author David Allen has

served as chair of the Environmental Protection Agency’s Science Advisory Board (2012-2015),

and in this role was a paid Special Governmental Employee. He is also a journal editor for the

American Chemical Society and has served as a consultant for multiple companies, includingEastern Research Group, ExxonMobil, and Research Triangle Institute. He has worked on other

research projects funded by a variety of governmental, nonprofit and private sector sourcesincluding the National Science Foundation, the Environmental Protection Agency, the Texas

Commission on Environmental Quality (TCEQ), the American Petroleum Institute and an air

monitoring and surveillance project that was ordered by the U.S. District Court for the Southern

District of Texas. David Sullivan has worked on other research projects funded by the TCEQ, theCalifornia Air Resource Board, the Texas Air Research Center, and the U.S. District Court for

the Southern District of Texas. Matt Harrison, who worked for URS at the time of the

publication of the original papers (Allen, et al., 2013; Allen, et al., 2015b), is now an employeeof AECOM, a company that purchased URS. Financial support for the original reports (Allen, et

al., 2013; Allen, et al., 2015b) was provided by were Environmental Defense Fund (EDF),

Anadarko Petroleum Corporation, BG Group plc, Chevron, ConocoPhillips, Encana Oil & Gas(USA) Inc., Pioneer Natural Resources Company, SWEPI LP (Shell), Southwestern Energy,

Statoil, Talisman Energy USA and XTO Energy, a subsidiary of ExxonMobil. Funding for

EDF’s methane research series, including the University of Texas study, is provided for by Fiona

and Stan Druckenmiller, Heising-Simons Foundation, Bill and Susan Oberndorf, Betsy and SamReeves, Robertson Foundation, Alfred P. Sloan Foundation, TomKat Charitable Trust, and the

Walton Family Foundation.

ReferencesAllen, D. T.; Torres, V. M.; Thomas, J.; Sullivan, D.; Harrison, M.; Hendler, A.; Herndon, S. C.;

Kolb, C. E.; Fraser, M. P.; Hill, A. D.; Lamb, B. K.; Miskimins, J.; Sawyer, R. F.; Seinfeld, J. H.

Measurements of methane emissions at natural gas production sites in the United States. Proc. Natl. Acad. Sci. U.S.A. 2013, 110, 17768−17773 (2013).


C-4


37/66

F o r R

e v i e w O n

l y

Allen, D.T., Sullivan, D.W., and Harrison, M. Response to Comment on “Methane Emissions

from Process Equipment at Natural Gas Production Sites in the United States: Pneumatic

Controllers”, Environmental Science & Technology, doi: 10.1021/acs.est.5b00941 (2015a).

Allen, D.T.; Pacsi, A.; Sullivan, D.; Zavala-Araiza, D.; Harrison, M.; Keen, K.; Fraser, M.; Hill,

A.D.; Sawyer, R.F.; and Seinfeld, J.H. Methane Emissions from Process Equipment at NaturalGas Production Sites in the United States: Pneumatic Controllers, Environmental Science &

Technology, 49, 633–640, doi:10.1021/es5040156 (2015b).

Howard, T.; University of Texas study underestimates national methane emissions inventory at

natural gas production sites due to instrument sensor failure, Energy Science & Engineering ,DOI: 10.1002/ese3.812015

Peischl, J., Ryerson, T.B., Aikin, K.C., de Gouw, J.A., Gilman, J.P., Holloway, J.S., Lerner,B.M., Nadkarni, R., Neuman, J.A., Nowak, J.B., Trainer, M., Warneke, C., and Parrish, D.D.

Quantifying atmospheric methane emissions from the Haynesville, Fayetteville, and northeastern

Marcellus shale gas production regions , Journal of Geophysical Research Atmospheres, doi:

10.1002/2014JD022697 (2015)


C-5


38/66

F o r R

e v i e w O n

l y

D. A () (1)

B HF (BHF) 2013 (2) I (3).

BHF

(CH4)

(NG) . M , , BHF

NG , BHF , / .

A (1) BHF 1990, BHF

2003. H NG

, B, I.

BHF. H, I B, I. I

BHF.

BHF (2)

(1) ,

(4) (5), , (3),

NG CH4 < 91%. H, BHF (2)

,

. I BHF (2)

. H,

(3) BHF

, NG CH4

97%. BHF NG

.

A (1) R M

,

CH4 CH4

. A R

M , (3)

CH4 . ,

:

1)

E R M ,

NG < 91% CH4 > 91% CH4;

2)

P (6) BHF

(2), .., ,

CH4 ;

3)

E BHF (2) A

CH4

98 95% CH4;


C-8


39/66

F o r R

e v i e w O n

l y

4)

A ( ) (2)

R M ,

BHF

CH4 , R M .

I (1)

. A (3), I

(2)

(4).

(2). A I

, I BHF

. G

,

. I,

, . I

M 2013, (1) (2)

(2), . I M 2013

, BHF ,

, .

(1)

I . A I

(3),

. C,

(1),

.

A (1)

(6) BHF

(2), BHF

. H, I (3), BHF

(2)

.

BHF (2) (6).A, (6)

. (6)

,

. H, I (7), I

M 2013 (6) ,

. D ,

. E


C-9


40/66

F o r R

e v i e w O n

l y

(6),

.

(2) (6)

.

A (1) BHF

; ,

. F , F. A Q

(8), QA IR 15

, , .

, ,

IR ,

.

F, (1) (3)

(2)

R M

. I , : R M,

40 , .

H (2015)

. , H

(2015), .

H, (1)

CH4 , . I ,

R M 0.66 ,

50% BHF 0.4 8 .

I BHF 4

, 0.2 .

C,

BHF .

, D. A (1) (3)

(2) , I . F 1

(2). F , I

98%

, BHF ,

BHF .

A F 1,

CH4 , (1) I (3).


C-10


41/66

F o r R

e v i e w O n

l y

H, F 1 R M

BHF . ,

( BHF

) R

M MC CH4 82%,

A CH4 97% ( CH4 97% (3)). O 13 CH4 < 82% (RM5)

,

CH4 > 97% .

: MC: 0.586;

R M: 0.461; A: 1.44.

CH4 > 97% ( A ) BHF , I

(2)

. C,

MC R M , BHF

BHF, I (3). ,

BHF , .

G BHF

, , , (1)

BHF (2) . (1) (2) EPA A B (2),

BHF EPA . BHF

,

, , BHF

.

. I CH4

, EPA G G R (9),

A C R (10), N C D M (11).

F 12 I , I

. ,

(1) BHF (2) ,

, BHF NG . I

(2)

NG BHF

(2) .


C-11


42/66

F o r R

e v i e w O n

l y

R C

1.

A, D.., . C

. ,

2.

A, D.., .M. , J. , D. , M. H, A. H, . 2013.

M . P.

N. A. . A 110:1776817773.

3.

H, . 2015.

. E . E.

:10.1002/3.81.

4.

H, ., .. F, A. . 2015.

: I . J. A

M. A. 65:856862. :10.1080/10962247.2015.1025925.

5.

M, M..; A, M..; I, J.; L, C.; H, B.; R, D.; , E.D.; ,

B.C.

. 2012. P A & M A 105

A C & E, A, . A

://..//.?=411ACE12

6.

A, D.., A. P, D. , D. A, M. H, K. K, . 2014. M

:

P . E. . . 49:633640. :10.1021/5040156.

7.

H, . C M

: P , E &

2015, 49, 39813982, :10.1021/..500507.8.

E R G (ERG). 2011. C F

, F , . A : ://./

F/G/AQ. ( 20 J 2015).

9.

C F R. 2014. 40 CFR P 98, . A :

://..//?=//40/409802. (

11 M 2015).

10.

A C R. 2010. E R M M

M C HB P C O N G

. A : ://.//

//

11. ( 10 2015).

11.

N F C C C C D M.

2009. A AM0023: L

( 3). A :

://..//J//2/J2L0EKMB3HD187RPO6FCQINGA/EB5004


C-12


43/66

F o r R

e v i e w O n

l y

AM00233.?=MDJ82DC37EGIMHQLR ( 10

2015).

F C

F 1. C (

BHF ) (2).

CH4 , BHF ,

. BHF ,

R M . BHF =

B HF ; MC = M; RM = R M; AP = A.


C-13


44/66

F o r R

e v i e w O n

l y

70x66mm (300 x 300 DPI)


C-14


45/66


D1

Appendix D. Problems with the Fox Meter

Analysis by Touché Howard of Fox Meter Calibration Problems in the Allen et al. !"#$% &DF

Phase '' (tudy of Pneumatic De)ices

In Decem!er o" 201#, Allen et al$ %201#& pu!lis'e( a stu() o" emission rates "rom pneumatic

(e*ices con(ucte( !) t'e +ni*ersit) o" e-as %+& an( sponsore( !) ED. an( corporate

partners$ 'is stu(), also /non as t'e + P'ase II pneumatic stu(), as a "olloup to Allen

et al$ %201& %/non as + P'ase I&$ 'ere ma) !e almost 1,000,000 pneumatic (e*ices in t'e

pro(uction sement o" t'e oil an( as in(ustr) an( t'e) ma) contri!ute o*er 234 o" met'ane

emissions "rom t'is sement$ A((itionall), at sites it' 'i'er compositions o" 'ea*ier

')(rocar!ons, pneumatic (e*ices ma) contri!ute su!stantiall) to t'e release o" air to-ics t'at

coul( a""ect t'e 'ealt' o" surroun(in communities$ Conse5uentl), accurate measurements o"

pneumatic emission rates are crucial "or un(erstan(in t'e true contri!ution o" t'ese (e*ices

to !ot' met'ane an( air to-ics emissions t'rou'out t'is sement o" t'e in(ustr) an( to

pro*i(e oo( ui(ance to polic) ma/ers an( communit) representati*es$

A total o" appro-imatel) 60 (e*ices ere measure( in t'e P'ase II Allen et al$ %201#& stu()$

'ere ere to maor (i""erences !eteen t'e P'ase I an( P'ase II stu(ies, 'oe*er$ .irst, t'e

P'ase I stu() ina(*ertentl) "ocuse( on (e*ices t'at ere emittin, as oppose( to t'e ran(om

sample t'at as inten(e( %Allen et al$ 201#, 7oar( 2013!&, 'ile t'e oal o" t'e P'ase II

stu() as to measure e*er) pneumatic t'at it as possi!le to sur*e) at eac' site *isite(,

pro*i(in a more representati*e sample$ econ(, t'e primar) measurement met'o( "or P'ase

II as to install a .o- .2 "lo meter in t'e suppl) as line it' some measurements ma(e

usin t'e 9ac'arac' 7i.lo ampler %97.&: (urin P'ase I all measurements ere ma(e usint'e 97.$

'e P'ase II "iel( proram ran "rom appro-imatel) Decem!er o" 201 t'rou' at least ;arc' o"

201#$ 'e "inal en( (ate is not /non$


46/66


D2

+pon seein t'e pro!lem it' .o- ;eter A (urin m) test on ;arc' 18, 201#, ;att 7arrison o"

+R %no AEC?ea', e*er)one /nos t'at

meter is "la/)$ ?ou can 'oo/ it up to a pneumatic, 'ear t'e pneumatic "ire, an( not see

an)t'in on t'e meter$@

'e + team too/ .o- ;eter A out o" ser*ice t'at (a) an( t'e (ata s'eets "rom t'e test erepro*i(e( to t'em$ A((itionall), Carrie Reese con"irme( to me t'at s'e reporte( t'e meter

pro!lem to Dr$ Ramon Al*are at ED. 'en s'e returne( "rom t'e "iel($

urprisinl), t'e + team as (oin no cali!ration c'ec/s in t'e "iel( to pre*ent pro!lems li/e

t'is$ ;) test as t'e "irst c'ec/ o" t'e meters t'at 'a( !een (one since t'e meters 'a( !een

cali!rate( at t'e start o" t'e proect$ 9ecause man) o" t'e sites t'e + team sur*e)e( 'a(

'i'er concentrations o" 'ea*ier ')(rocar!ons, t'ere as a 'i' possi!ilit) t'at one or !ot'

meters coul( !ecome "oule(, i*en t'at t'e 'ea*ier ')(rocar!ons are o"ten seen to

accumulate on t'e pneumatic (e*ices$ A((itionall), t'e .o- "lo meter manual speci"icall)

states t'at t'e meter ill rea( too lo i" it !ecomes (irt)$

7oe*er, 'en t'e P'ase II Allen et al$ %201#& stu() as pu!lis'e( in Decem!er o" 201#, I as

surprise( to see t'at no mention as ma(e o" t'e ;arc' 18, 201# .o- "lo meter test$

Instea(, in a "ootnote in t'eir supplementar) in"ormation, t'e aut'ors in(icate t'at (urin t'eir

post cali!ration c'ec/ t'e) "oun( t'at one meter as reportin too lo !) #4, re5uirin a

correction "actor o" 1$32$ %Conse5uentl), i" t'e + correction "actor ere applie( to correct t'e

results o" t'e "ault) meter on t'e (a) t'at I teste( it, t'e correcte( results oul( still !e a!out

'al" t'e actual "lo rate, since I "oun( it to !e measurin lo !) a "actor o" almost $&

A((itionall), in or(er to (etermine at 'at point t'e meter cali!ration pro!lem starte(, t'e)

re*iee( t'e 5ualit) assurance c'ec/s t'at 'a( !een ma(e !) (oin a su!set o" simultaneous

measurements comparin t'e .o- "lo meters to t'e 97.$

+n"ortunatel), t'e "ailure o" t'e aut'ors to (isclose t'e test I con(ucte( in*ali(ates t'e Allen et

al$ %201#& (ata set, !ecause t'e) speci"icall) suppresse( t'at in(epen(ent testin s'oe( t'e

per"ormance o" t'eir "ault) meter as muc' orse t'an t'e) reporte( in t'eir supplementar)

in"ormation$ ;oreo*er, !e)on( t'is "ailure to report t'e ;arc' 18, 201#, "lo meter test,

t'ere are a((itional trou!lin 5uestions$

.irst, it seems inconcei*a!le t'at an) researc'er, once s'on !) in(epen(ent tests t'at an

instrument as i*in incorrect results, oul( not imme(iatel) test t'at instrument t'emsel*es

an( imme(iatel) institute more riorous cali!ration c'ec/s o" t'e instruments$ 7oe*er, t'is is'at is implie( !) Allen et al$Bs %201#& supplemental in"ormation an( !) Allen et al$Bs %2013&

response to m) letter to E %7oar( 2013a&, 'ere t'e) state t'at t'e) "oun( t'e pro!lem

(urin t'eir post proect cali!ration c'ec/$ Conse5uentl), t'is in(icates t'at t'e) too/ no

action 'en I (emonstrate( t'at one .o- "lo meter as rea(in "ar too lo$


47/66


D

I" t'is is t'e case, t'en t'e "ailure to imme(iatel) in*estiate t'is pro!lem an( to implement

impro*e( cali!ration c'ec/s in(icates a complete (isrear( "or 5ualit) assurance, an( pro*i(es

"urt'er e*i(ence t'at t'e (ata set s'oul( not !e relie( upon$

7oe*er, it seems more li/el) t'at t'e aut'ors (i( in "act in*estiate t'e pro!lem an(

con(ucte( t'eir on tests o" t'e .o- "lo meter imme(iatel) a"ter t'e ;arc' 18, 201#, tests,!ut (i( not (isclose t'at t'e) 'a( (one t'is$ I" so, t'is raises t'e trou!lin possi!ilit) t'at t'e

aut'ors ma) 'a*e t'en trie( to correct t'e pro!lem !) cleanin t'e meter, !ut (i( not (isclose

t'at t'e) 'a( (one t'at$ 'is oul( e-plain ') t'e meter per"ormance impro*e( !eteen

t'e ;arc' 18, 201#, test an( t'e + post proect cali!ration test$ %It is also possi!le t'at t'e

meter per"ormance simpl) *arie( reatl) o*er time, !ut t'is oul( !e anot'er in(ication o"

poor (ata 5ualit)$& I" t'e aut'ors cleane( .o- "lo meter A !ut (i( (isclose t'is "act, an( t'en

ent on to claim t'at t'e post proect cali!ration as representati*e o" t'e meter per"ormance

"rom t'e point t'e) suppose(l) i(enti"ie( 'ere t'e pro!lem occurre(, t'en t'is oul( !e an

a((itional "rau($

o t'e /e) 5uestions "or t'e EPA


48/66


D#

econ(, t'e aut'ors sa) t'e) i(enti"ie( a step c'ane in t'e meter response !eteen meter

measurements on su!se5uent (a)s usin t'e 97. measurements$ 'is oul( in(icate t'at t'e

c'ane as e5ual to or reater t'an t'e (ecrease in response seen 'en t'e) (i( t'e post

proect cali!ration, 'ic' as a (ecrease o" 0$#, meanin t'at post proect t'e meter rea(

onl) 0$66 o" t'e correct response$ 7oe*er, as seen in .iure 1, to t'ir(s o" t'e

measurements ma(e !) .o- ;eter A t'at t'e + team "lae( "or correction rea( less t'an

0$66 o" t'e 97. measurements, an( most ere su!stantiall) orse t'an t'is$ Conse5uentl), it

oul( not !e possi!le !ase( on t'ese (ata "or t'e aut'ors to /no at 'ic' o" t'ese times H i"

an) H t'e meter !ecame (irt)$ 'ere is simpl) "ar too muc' uncertaint) in t'ese comparisons$

'e t'ir( %an( most trou!lin& issue it' 'o t'e aut'ors trie( to i(enti") 'ere t'e meter

pro!lem occurre( centers on 'o unli/el) it is t'at t'e pro!lem occurre( 'ere t'e) sa) it (i($

Aain, t'e /e) issue is t'at t'e aut'ors state t'at t'e pro!lem as i(enti"ie( !) a step c'ane

in t'e meter per"ormance t'at occurre( in !eteen to !ac/to!ac/ meter tests t'at eac'

'a( a 97. measurement as ell$

9ecause t'e aut'ors pinpointe( t'at t'e meter pro!lem occurre( speci"icall) in !eteen to

measurements t'at eac' 'a( 97. measurements as ell, t'e) ere a!le to implement t'eir

post proect cali!ration correction it'out eliminatin an) (ata$ In contrast, i" t'e meter

pro!lem 'a( occurre( at a point in t'e (ata collection 'en a 97. measurement 'a(nBt !een

ma(e simultaneousl), t'en some amount o" (ata oul( 'a*e 'a( to !e eliminate($

A t'ou't e-periment ma) ma/e t'is clearer$ I" t'ere ere a correspon(in 97.

measurement "or e*er) .o- "lo meter measurement, t'en no matter 'en t'e .o- ;eter A

pro!lem occurre(, t'e 97. measurement oul( !e a!le to pinpoint it, assumin t'at t'e

measurements ma(e !) t'e 97. an( .o- meters ere accurate$

7oe*er, t'ere ere onl) 2 97. measurements t'at ere ma(e simultaneousl) it' t'e 0

.o- "lo meter measurements, an( t'ese 97. measurements ere not space( e*enl)

t'rou'out t'e proect$ Instea(, t'ere ere lon perio(s 'ere no 97. measurements ere

ma(e, an( ot'er perio(s 'ere multiple 97. measurements ere ma(e on a i*en site$ .or

instance, no 97. measurements ere ma(e in t'e Appalac'ia reion, so i" t'e pro!lem 'a(

!een (isco*ere( a"ter t'at reion 'a( !een (one, all o" t'e (ata collecte( !) .o- ;eter A in

t'at reion oul( 'a*e 'a( to !e (iscar(e($

ince onl) 2 simultaneous 97. measurements ere ma(e alon it' t'e .o- "lo meter

measurements, t'is means t'at t'ere as at !est a 4 c'ance t'at t'e .o- meter pro!lemoul( occur !eteen to su!se5uent .o- meter measurements t'at also 'a( 97.

measurements$ 7oe*er, as seen in .iure 2, most o" t'e 97. an( .o- "lo meter

measurements are eit'er too small or (onBt aree ell enou' %it'in a "actor o" to, since

t'eir reporte( correction as onl) 1$32& to !e a!le to i(enti") 'ere t'is meter pro!lem

occurre($ In "act, onl) 3 o" t'e .o- meter measurements %1$34& are lare enou' an( also


49/66


D3

'a*e 97. measurements t'at aree ell enou' t'at t'e) coul( !e consi(ere( can(i(ates "or

i(enti")in 'ere t'e meter pro!lem occurre($

9ut o" t'ose "i*e, onl) "our ere measure( usin .o- ;eter A, an( o" t'ose "our, onl) one

measurement also 'a( anot'er measurement imme(iatel) !e"ore it it' no ot'er

measurements ta/en in !eteen$

Conse5uentl), t'ere is onl) one place in t'is (ata set o" measurements t'at 'a( all t'e

necessar) in"ormation %lare enou' rea(ins, a(e5uate areement !eteen t'e 97. an( t'e

.o- "lo meter, an( !ac/to!ac/ measurements it' no measurements in !eteen& t'at coul(

possi!l) !e use( to i(enti") 'ere t'is meter pro!lem occurre( it'out t'e nee( to (iscar(

an) o" t'e .o- "lo meter (ata$ 'is e5uates to a 0$4 c'ance o" t'e meter pro!lem actuall)

occurrin ust at t'e ri't spot 'ere all t'ese *aria!les aline( so t'at no (ata oul( 'a*e to

!e eliminate($ 9ut t'at, in "act, is e-actl) 'ere t'e aut'ors sa) t'e meter pro!lem occurre($

'e most c'arita!le interpretation o" t'is unli/el) scenario is t'at t'e aut'ors (i( not

un(erstan( 'o terri!le t'eir 5ualit) assurance results ere, an( t'e) pic/e( t'e onl) spot t'at

'appene( to meet t'e re5uirements t'at t'e) nee(e(, e*en t'ou' it is clear t'at t'e 97.

measurement comparisons ere "ar too uncertain to ma/e suc' a (etermination$

7oe*er, i*en t'at t'e aut'ors 'i( t'e e-istence o" t'e ;arc' 18, 201#, test "rom t'e E

ournal e(itor, re*ieers, an( rea(ers, it is possi!le t'at t'e) also manipulate( (ata points in

or(er to create a place in t'e (ata set t'at oul( allo t'em to create t'is scenario$ It ma) not

!e possi!le to (etermine i" t'is occurre(, !ut it is a clear possi!ilit)$

Alt'ou' I oriinall) t'ou't t'at it mi't !e possi!le "or t'e + team to use t'e (ata "rom t'e

ot'er meter, t'e "ailure to "ull) (isclose t'e .o- ;eter A pro!lem an( t'e poor 5ualit)

assurance comparisons it' t'e 97. measurements 'a*e since ma(e it clear t'at t'is (ata set

cannot !e sal*ae($


50/66


D6

Fi*ure #.

Fi*ure !.

3$00

3$00

13$00

23$00

3$00

#3$00

33$00

0$00 10$00 20$00 0$00 #0$00 30$00

Documents

Epa-oig Ncwarn Complaint 6-8-16