Eleftherios Avramidis
@lefteravSenior Research on Machine Translation/sign language, Natural Language Processing, Computational Linguistics, Fan of open source/free software and radio
Similar User
@KocmiTom
@carolscarton
@_atoral
@markuseful
@luisabentivogli
@_SheilaCastilho
@bazril
@DShterionov
@fblain
@TiedemannJoerg
@CParraEsc
@fbk_mt
@RABawden
@fedegasp1
@karakanta
Help us break LLMs! The test suite sub-task will be included for the sixth time in the General MT Shared Task of the Conference on Machine Translation (WMT24). This year's theme is to reveal weaknesses of LLMs when translating #LLMs #EMNLP #NLProc| www2.statmt.org/wmt24/testsuit…
Happy to announce the WMT23 Metrics Shared Task! New this year amongst other changes: paragraph-level metric task for En-De & a new language pair: Hebrew-English. wmt-metrics-task.github.io #emnlp #NLProc #machinetranslation (1/n)
Our #ACL2023 paper on "Neural #MachineTranslation for Translating Text to #SignLanguage Glosses" was named an outstanding paper! A result of the excellent MSc thesis of Dele @Yvan_Zhu at @TUBerlin with the invaluable help of Vera Czehmann. #NLProc @DFKI aclanthology.org/2023.acl-long.…
traveling to the #ICASSP2023 #conference with to discuss at #SLTAT2023 the #design of our @DFKI prototypical #AI #SignLanguage #translation tool employing lightweight #AugmentedReality and smart headphones. dfki.de/en/web/researc…
Meta evaluation of metrics usually does not get much attention. Dan's paper clearly shows that it is important to understand what your meta eval actually measures. Highly recommend to read! Really insightful work! Especially if you think about doing evaluation with LLMs.
LLM-based metrics like GEMBA predict many ties, but the way that ties should be handled in Kendall’s tau for meta-evaluating metrics has been a longstanding issue. We propose an update to the meta-evaluation methodology to handle ties. arxiv.org/pdf/2305.14324…
The “Test suites” sub-task will be included for the sixth time in the General MT Shared Task of the Conference on Machine Translation (WMT23). Submission deadline: June 19th - more info: www2.statmt.org/wmt23/testsuit… #NLProc #EMNLP2023 #EMNLP #ACL
Really delighted that the #wearable Textile Game Controller of the @DFKI department of Interactive Textiles was presented by Esther Zahn and Hannah Fischer at the Interactivity Section of #CHI2023 in Hamburg
Hello everyone! The deadline for submitting a paper to our workshop has been extended until April 24th. (Which means more time to work on great papers!) We're looking forward to all your contributions and to seeing you at @EAMT_2023 in Tampere! For info: sites.google.com/tilburgunivers…
Glad I am for the first time an instructor for two projects topics for 13 students of computer science at @TUBerlin_QU: "Towards automatic #SignLanguage translation" & "Fine grained evaluation of machine #translation". @DFKI @TUBerlin #NLProc
My colleague was looking for citations on Bing Chat and got as a response a former non-published document of his with the same title but different made-up authors! #BingChat #ChatGPT
So I'm writing a grant proposal and using bing chat to find some related work.. suddently it cites one of my works, but with the wrong authors - with the same title and kinda niche topic (ai enabled biodiversity monitoring of surface waters). THE THING IS 1/2
Hello everyone! The Automatic Translation for Signed and Spoken Languages (AT4SSL) Workshop will be part of the @EAMT_2023, in Tampere, this year! If you are working on topics related to MT for Signed and Spoken Languages, have a look at our CfP: sites.google.com/tilburgunivers…
Excited that through our @DFKI #research project we can work on the automatic translation of sign languages. Our first experiments were shown with a technical report at the 7th Conference on #MachineTranslation, in #EMNLP2022. Still long way to go. #nlproc dfki.de/en/web/researc…
Also check our last year’s metric task paper: aclanthology.org/2021.wmt-1.73/ . There are a lot of goodies: (7/n)
We welcome any additional comments and suggestions from the community regarding these evaluation plans and will take all such feedback into consideration. (6/n)
Please check out all details regarding both the main task and all subtasks: wmt-metrics-task.github.io (5/n)
For the Challenge Sets task we invite anyone to submit a new test suite and/or an analysis paper on metric behaviour for specific perturbations/phenomena similar to what we did last year! (4/n)
Similar to last year, we will not only evaluate the performance of metrics on the WMT submissions, but also augment the set of systems with additional MT systems generated by methods like sampling or MBR decoding. (3/n)
(a) Better Human Evaluation: Like last year, our primary human scores will be derived from expert-based MQM annotations. (b) We have 3 new subtasks: (i) QE as a Metric, (ii) Challenge Sets, (iii) MBR Decoding. (2/n)
United States Trends
- 1. Black Friday 684 B posts
- 2. $VSG 9.032 posts
- 3. Knicks 9.913 posts
- 4. Oklahoma State 4.425 posts
- 5. #HelluvaBoss 33,9 B posts
- 6. Hornets 6.460 posts
- 7. #VECTOR 1.893 posts
- 8. #MHAFinalVol 15,2 B posts
- 9. Fickell N/A
- 10. Locke 4.016 posts
- 11. Thomas Brown 9.718 posts
- 12. Gundy 1.222 posts
- 13. Mikal 3.241 posts
- 14. #CandyConversation N/A
- 15. #SeesCandies N/A
- 16. Josh Green 1.547 posts
- 17. Ollie Gordon N/A
- 18. Stolas 12,8 B posts
- 19. Syria 208 B posts
- 20. Meathead 5.662 posts
Who to follow
-
Tom Kocmi
@KocmiTom -
Carolina Scarton
@carolscarton -
Antonio Toral
@_atoral -
Markus Freitag
@markuseful -
Luisa Bentivogli
@luisabentivogli -
Dr. Sheila Castilho
@_SheilaCastilho -
Barry Haddow
@bazril -
Dimitar Shterionov
@DShterionov -
Fred Blain
@fblain -
Jörg Tiedemann
@TiedemannJoerg -
Carla Parra Escartín
@CParraEsc -
MT Group at FBK
@fbk_mt -
Rachel Bawden
@RABawden -
fedegasp
@fedegasp1 -
Alina Karakanta
@karakanta
Something went wrong.
Something went wrong.