About
Dr. Dror is an Assistant Professor (Senior Lecturer) at the Department of Information Systems, Faculty of Computer and Information Science, University of Haifa. She completed her Postdoctoral Research at the Cognitive Computation Group at the Department of Computer and Information Science, University of Pennsylvania, Working with Prof. Dan Roth. she completed her Ph.D. in the Natural Language Processing Group, supervised by Prof. Roi Reichart, at the Faculty of Industrial Engineering and Management at the Technion - Israel Institute of Technology. Her research involves developing statistically sound methodologies for empirical investigation and evaluation for Data Science with a focus on Natural Language Processing applications.Personal website: https://rtmdrr.github.io/
Graduate candidates interested in research, please send resumes to: rdror@is.haifa.ac.il
Graduate candidates interested in research, please send resumes to: rdror@is.haifa.ac.il
Publications
- Diffusion denoiser-aided gyrocompassing, Ben-Arie, G., Engelsman, D., Dror, R. & Klein, I., 1 Oct 2026, In: Measurement: Journal of the International Measurement Confederation. 287, 122370.
- Multi-Agent Framework for Adaptive Social-Emotional Learning in Children’s Digital Communication, Malik, A., Elbaum, O., Malkevich, T., Elyoseph, Z., Solomon, A., Dror, R. & Ayalon, O., 22 Mar 2026, Companion Proceedings of the 31st International Conference on Intelligent User Interfaces, IUI 2026 Companion. Association for Computing Machinery, p. 185-188 4 p. (International Conference on Intelligent User Interfaces, Proceedings IUI).
- Detecting Behavioral and Emotional Themes Through Latent and Explicit Knowledge, Mcdossi, O., Klein, R., Shaer, A., Dror, R. & Solomon, A., Feb 2026, In: Systems. 14, 2, 123.
- Breaking the Ceiling: Mitigating Extreme Response Bias in Surveys Using an Open-Ended Adaptive-Testing System and LLM-Based Response Analysis, Gish, M., Nowominski, A. & Dror, R., Feb 2026, In: AI (Switzerland). 7, 2, 73.
- Entomophobia is a determinant of household insecticide use, Dror, R. & Gish, M., 2026, In: Journal of Integrated Pest Management. 17, 1, pmag025.
- Image-Based POI Identification for Mobile Museum Guides: Design, Implementation, and User Evaluation, Egbariya, B., Dror, R., Kuflik, T. & Shimshoni, I., Jul 2025, In: Heritage. 8, 7, 266.
- Using Facial Expressions to Predict Process Mining Task Performance, Shalev, L., Hadar, I., Dror, R., Solomon, A., Sorokina, E., Raymond, M. W. & Soffer, P., 2025, Process Mining Workshops - ICPM 2024 International Workshops, Lyngby, Denmark, October 14–18, 2024, Revised Selected Papers. Delgado, A. & Slaats, T. (eds.). Springer Science and Business Media Deutschland GmbH, p. 559-571 13 p. (Lecture Notes in Business Information Processing; vol. 533).
- The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs, Calderon, N., Reichart, R. & Dror, R., 2025, Long Papers. Che, W., Nabende, J., Shutova, E. & Pilehvar, M. T. (eds.). Association for Computational Linguistics (ACL), p. 16051-16081 31 p. (Proceedings of the Annual Meeting of the Association for Computational Linguistics; vol. 1).
- Diffusion-Driven Inertial Generated Data for Smartphone Location Classification, Cohen, N., Dror, R. & Klein, I., 2025, Proceedings of the 15th International Conference on Indoor Positioning and Indoor Navigation, IPIN 2025. Nurmi, J., Lohan, S., Ometov, A., Klus, L., Mutschler, C. & Torres-Sospedra, J. (eds.). Institute of Electrical and Electronics Engineers Inc., (Proceedings of the 15th International Conference on Indoor Positioning and Indoor Navigation, IPIN 2025).
- The Curator's Helper, Dror, R., Hutchinson, D., Jones, M. A., Kuflik, T. & Van Hyning, V., 27 Jun 2024, UMAP 2024 - Adjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery, Inc, p. 496-504 9 p. (UMAP 2024 - Adjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization).
- State of What Art? A Call for Multi-Prompt LLM Evaluation, Mizrahi, M., Kaplan, G., Malkin, D., Dror, R., Shahaf, D. & Stanovsky, G., 2024, In: Transactions of the Association for Computational Linguistics. 12, p. 933-949 17 p.
- 140 Characters of Justice? The Promise and Perils of Using Social Media to Reveal Lay Punishment Perspectives, Ravid, I. & Dror, R., 13 Aug 2023, In: University of Illinois Law Review. 2023, 5, p. 1473-1531 59 p.
- Zero-Shot On-the-Fly Event Schema Induction, Dror, R., Wang, H. & Roth, D., 2023, EACL 2023 - 17th Conference of the European Chapter of the Association for Computational Linguistics, Findings of EACL 2023. Association for Computational Linguistics (ACL), p. 693-713 21 p. (EACL 2023 - 17th Conference of the European Chapter of the Association for Computational Linguistics, Findings of EACL 2023).
- Human-in-The-loop schema induction, Zhang, T., Tham, I., Hou, Z., Ren, J., Zhou, L., Xu, H., Zhang, L., Martin, L. J., Dror, R., Li, S., Ji, H., Palmer, M., Brown, S., Suchocki, R. & Callison-Burch, C., 2023, System Demonstrations. Association for Computational Linguistics (ACL), p. 1-10 10 p. (Proceedings of the Annual Meeting of the Association for Computational Linguistics; vol. 3).
- RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios, Du, X., Zhang, Z., Li, S., Wang, Z., Yu, P., Wang, H., Lai, T. M., Lin, X., Liu, I., Zhou, B., Wen, H., Li, M., Hannan, D., Lei, J., Kim, H., Dror, R., Wang, H., Regan, M., Zeng, Q. & Lyu, Q. & 14 others, , 2022, NAACL 2022 - 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Demonstrations Session. Association for Computational Linguistics (ACL), p. 54-63 10 p. (NAACL 2022 - 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Demonstrations Session).
- On the Limitations of Reference-Free Evaluations of Generated Text, Deutsch, D., Dror, R. & Roth, D., 2022, p. 10960-10977. 18 p.
- Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics, Deutsch, D., Dror, R. & Roth, D., 2022, NAACL 2022 - 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference. Association for Computational Linguistics (ACL), p. 6038-6052 15 p. (NAACL 2022 - 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference).
- A statistical analysis of summarization evaluation metrics using resampling methods, Deutsch, D., Dror, R. & Roth, D., 27 Oct 2021, In: Transactions of the Association for Computational Linguistics. 9, p. 1132-1146 15 p.
- Statistical Significance Testing for Natural Language Processing, Dror, R., Peled-Cohen, L., Shlomov, S. & Reichart, R., 3 Apr 2020, Springer Cham. 116 p. (Synthesis Lectures on Human Language Technologies; vol. 13, no. 2)
- Deep dominance - How to properly compare deep neural models, Dror, R., Shlomov, S. & Reichart, R., 2020, ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Association for Computational Linguistics (ACL), p. 2773-2785 13 p. (ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference).
- The hitchhiker's guide to testing statistical significance in natural language processing, Dror, R., Baumer, G., Shlomov, S. & Reichart, R., 2018, ACL 2018 - 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Association for Computational Linguistics (ACL), p. 1383-1392 10 p. (ACL 2018 - 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers); vol. 1).
- The structured weighted violations perceptron algorithm, Dror, R. & Reichart, R., 2016, EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings. Association for Computational Linguistics (ACL), p. 469-478 10 p. (EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings).
Education
- BSc Cum Laude in Industrial Engineering and Management, Technion, Israel (2014)
- Master in Operation Research and Optimization, Technion, Israel (2016) (within direct track to PhD)
- PhD in Natural Language Processing, Technion, Israel (2020)
- Postdoctorate in Natural Language Processing, Department of Computer and Information Science, University of Pennsylvania, USA (2023)
Research Areas
- Establishing robust, generalizable research practices to improve the rigor and reproducibility of empirical investigations across applied Data Science, and specifically in Natural Language Processing (NLP). My work provides verifiable techniques for systematically measuring and evaluating model performance in both objective and subjective tasks.
- Designing and validating advanced protocols for enhancing reliability in NLP research pipeline. This involves developing statistically sound frameworks for quantifying the quality of data annotations and setting benchmarks for complex tasks.
- Pioneering statistically rigorous methodologies for the comprehensive empirical evaluation of Large Language Models (LLMs) in complex, real-world scenarios. This includes developing novel metrics to assess LLMs' performance as automated judges, their efficacy in goal-driven web-agent tasks, and their consistency in adopting various linguistic personas.
Awards
- 2015, 2017 - Award of Academic Excellence and Research, Faculty of Industrial Engineering and Managemen, Technion – Israel Institute of Technology, Israel
- 2017 - Gutwirth Excellence Fellowship for PhD Research, The Gutwirth Foundation
- 2014, 2018, 2019 - Award of Excellent Teaching Assistant, Technion - Israel Institute of Technology
- 2018 - Google PhD Fellowship, Google
- 2019 - Eric and Wendy Schmidt Postdoctoral Award for Women in Mathematical and Computing Sciences, Schmidt Futures, USA
- 2022 - Women’s Postdoctoral Career Development Award in Science, Weizmann Institute of Science, Israel