Follow
Ivan Stelmakh
Ivan Stelmakh
Verified email at cs.cmu.edu - Homepage
Title
Cited by
Cited by
Year
PeerReview4All: Fair and accurate reviewer assignment in peer review
I Stelmakh, NB Shah, A Singh
Algorithmic Learning Theory, 828-856, 2019
1032019
ASQA: Factoid questions meet long-form answers
I Stelmakh, Y Luan, B Dhingra, MW Chang
arXiv preprint arXiv:2204.06092, 2022
622022
On testing for biases in peer review
I Stelmakh, N Shah, A Singh
Advances in Neural Information Processing Systems 32, 2019
552019
A novice-reviewer experiment to address scarcity of qualified reviewers in large conferences
I Stelmakh, NB Shah, A Singh, H Daumé III
Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4785-4793, 2021
342021
Prior and prejudice: The novice reviewers' bias against resubmissions in conference peer review
I Stelmakh, NB Shah, A Singh, H Daumé III
Proceedings of the ACM on Human-Computer Interaction 5 (CSCW1), 1-17, 2021
332021
Catch me if i can: Detecting strategic behaviour in peer assessment
I Stelmakh, NB Shah, A Singh
Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4794-4802, 2021
322021
Crowdspeech and voxdiy: Benchmark datasets for crowdsourced audio transcription
N Pavlichenko, I Stelmakh, D Ustalov
arXiv preprint arXiv:2107.01091, 2021
272021
A large scale randomized controlled trial on herding in peer-review discussions
I Stelmakh, C Rastogi, NB Shah, A Singh, H Daumé III
Plos one 18 (7), e0287443, 2023
232023
Debiasing evaluations that are biased by evaluations
J Wang, I Stelmakh, Y Wei, NB Shah
Proceedings of the AAAI Conference on Artificial Intelligence 35 (11), 10120 …, 2021
212021
A gold standard dataset for the reviewer assignment problem
I Stelmakh, J Wieting, G Neubig, NB Shah
arXiv preprint arXiv:2303.16750, 2023
112023
To ArXiv or not to ArXiv: A study quantifying pros and cons of posting preprints online
C Rastogi, I Stelmakh, X Shen, M Meila, F Echenique, S Chawla, ...
arXiv preprint arXiv:2203.17259, 2022
112022
Cite-seeing and reviewing: A study on citation bias in peer review
I Stelmakh, C Rastogi, R Liu, S Chawla, F Echenique, NB Shah
Plos one 18 (7), e0283980, 2023
92023
How do authors’ perceptions of their papers compare with co-authors’ perceptions and peer-review decisions?
C Rastogi, I Stelmakh, A Beygelzimer, YN Dauphin, P Liang, ...
Plos one 19 (4), e0300710, 2024
82024
Towards fair, equitable, and efficient peer review
I Stelmakh
Proceedings of the AAAI Conference on Artificial Intelligence 35 (18), 15736 …, 2021
42021
VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions.
D Ustalov, N Pavlichenko, I Stelmakh, D Kuznetsov
CSW@ VLDB, 1-7, 2021
32021
A Randomized Controlled Trial on Anonymizing Reviewers to Each Other in Peer Review Discussions
C Rastogi, X Song, Z Jin, I Stelmakh, H Daumé III, K Zhang, NB Shah
arXiv preprint arXiv:2403.01015, 2024
22024
No Rose for MLE: Inadmissibility of MLE for Evaluation Aggregation Under Levels of Expertise
C Rastogi, I Stelmakh, N Shah, S Balakrishnan
2022 IEEE International Symposium on Information Theory (ISIT), 3168-3173, 2022
22022
Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments
A Goldberg, I Stelmakh, K Cho, A Oh, A Agarwal, D Belgrave, NB Shah
arXiv preprint arXiv:2311.09497, 2023
12023
Making Scientific Peer Review Scientific
I Stelmakh
Carnegie Mellon University, 2022
2022
A Study Quantifying Pros and Cons of Posting Preprints Online
C Rastogi, I Stelmakh, X Shen, M Meila, F Echenique, S Chawla, ...
arXiv preprint arXiv:2203.17259, 2022
2022
The system can't perform the operation now. Try again later.
Articles 1–20