#MetricEval - Twitter Hashtag

almost 3 years ago

Wondering how good your new #NLProc metrics are? Wanting to analyze some SOTA metrics? Now you can use #MetricEval with pip install metric-eval (https://t.co/Ir6fRpwT6s) #EMNLP2023 #eval #OpenSource #AI

Ziang Xiao @ZiangXiao

about 3 years ago

What constitutes a good #eval metric? We bridge #MeasurementTheory in #EducationalTesting and #Psychometrics to #NLProc. We propose #MetricEval, a theory-driven framework to conceptualize and operationalize measurement error sources to evaluate #NLG metrics. #EMNLP2023 🧵

ZiangXiao's tweet photo. What constitutes a good #eval metric? We bridge #MeasurementTheory in #EducationalTesting and #Psychometrics to #NLProc. We propose #MetricEval, a theory-driven framework to conceptualize and operationalize measurement error sources to evaluate #NLG metrics. #EMNLP2023 🧵 https://t.co/9aqJrbusiG

1

81

18

33

22K

0

34

3

7

5K

Ziang Xiao @ZiangXiao

about 3 years ago

In this paper (https://t.co/VcICHPTj0P), we propose #MetricEval along with a set of statistical tools to analyze measurement errors in #NLProc eval metrics. The framework focuses on two major sources of measurement errors affecting reliability and validity respectively.

ZiangXiao's tweet photo. In this paper (https://t.co/VcICHPTj0P), we propose #MetricEval along with a set of statistical tools to analyze measurement errors in #NLProc eval metrics. The framework focuses on two major sources of measurement errors affecting reliability and validity respectively. https://t.co/pK6cAxiPdv

1

3

0

315

Ziang Xiao @ZiangXiao

about 3 years ago

What constitutes a good #eval metric? We bridge #MeasurementTheory in #EducationalTesting and #Psychometrics to #NLProc. We propose #MetricEval, a theory-driven framework to conceptualize and operationalize measurement error sources to evaluate #NLG metrics. #EMNLP2023 🧵

1

81

18

33

22K

Top Tweets for #MetricEval

Last Seen Hashtags on Sotwe

Trends for you

Most Popular Users