Shimon Ullman

Shimon Ullman
Shimon
Ullman
Research Module Co-Leader
Massachusetts Institute of Technology (MIT), Weizmann Institute of Science

Associated Research Module: 

Associated Research Thrust: 

Prof Ullman is the Samy and Ruth Cohn Professor of Computer Science and the Department Head, Computer Science and Applied Mathematics, The Weizmann Institute of Science, Rehovot, Israel; as well as an adjunct professor in the Brain and Cognitive Sciences Department, MIT.

Website: 

Current Advisees

Andrei Barbu - Research Scientist

Past Advisees

Guy Ben-Yosef - Research Scientist
Yevgeni Berzak - Graduate Student

Projects

Grounded language acquisition
Grounded question answering
Intentions and goals in human interactions
Invariant representations for action recognition in the human visual system
Multi-sentence event recognition
Objects and hands in context
Visual processing with minimal recognizable configurations

CBMM Publications

S. Ullman, Assif, L., Strugatski, A., Vatashsky, B. - Z., Levi, H., Netanyahu, A., and Yaari, A. Uri, “Image interpretation by iterative bottom-up top- down processing”. 2021.
G. Ben-Yosef, Kreiman, G., and Ullman, S., “What can human minimal videos tell us about dynamic recognition models?”, in International Conference on Learning Representations (ICLR 2020), Virtual Conference, 2020.
G. Ben-Yosef, Kreiman, G., and Ullman, S., “Minimal videos: Trade-off between spatial and temporal information in human and machine vision.”, Cognition, 2020.
S. Ullman, “Using neuroscience to develop artificial intelligence”, Science, vol. 363, no. 6428, pp. 692 - 693, 2019.
S. Ullman, Dorfman, N., and Harari, D., “A model for discovering ‘containment’ relations”, Cognition, vol. 183, pp. 67 - 81, 2019.
G. Ben-Yosef, Assif, L., and Ullman, S., “Full interpretation of minimal images”, Cognition, vol. 171, pp. 65 - 84, 2018.
G. Ben-Yosef, Assif, L., and Ullman, S., “Full interpretation of minimal images.”, Cognition, vol. 171, pp. 65-84, 2018.
D. Harari, Tenenbaum, J. B., and Ullman, S., “Discovery and usage of joint attention in images”, arXiv.org, 2018.
G. Ben-Yosef and Ullman, S., “Image interpretation above and below the object level”. 2018.
G. Ben-Yosef and Ullman, S., “Image interpretation above and below the object level”, Proceedings of the Royal Society: Interface Focus, 2018.
G. Ben-Yosef and Ullman, S., “Image interpretation above and below the object level”, Interface Focus, vol. 8, no. 4, p. 20180020, 2018.
T. Owaki, Vidal-Naquet, M., Nam, Y., Uchida, G., Sato, T., Câteau, H., Ullman, S., and Tanifuji, M., “Searching for visual features that explain response variance of face neurons in inferior temporal cortex”, PLOS ONE, vol. 13, no. 9, p. e0201192, 2018.
G. Ben-Yosef, Kreiman, G., and Ullman, S., “Spatiotemporal interpretation features in the recognition of dynamic images”. 2018.
G. Ben-Yosef, Assif, L., and Ullman, S., “Full interpretation of minimal images”. 2017.
G. Ben-Yosef, Yachin, A., and Ullman, S., “A model for interpreting social interactions in local image regions”, in AAAI Spring Symposium Series, Science of Intelligence, Palo Alto, CA, 2017.
I. Lifshitz, Fetaya, E., and Ullman, S., “Human Pose Estimation Using Deep Consensus Voting”, in ECCV 2016, 2016.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Language and Vision Ambiguities (LAVA) Corpus”. 2016.
S. Ullman, Assif, L., Fetaya, E., and Harari, D., “Atoms of recognition in human and computer vision”, PNAS , vol. 113, no. 10, pp. 2744–2749, 2016.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Do You See What I Mean? Visual Resolution of Linguistic Ambiguities”. 2016.
A. Rosenfeld and Ullman, S., “Visual Concept Recognition and Localization via Iterative Introspection. ”, in Asian Conference on Computer Vision, 2016.
D. Harari, Gao, T., Kanwisher, N., Tenenbaum, J. B., and Ullman, S., “Measuring and modeling the perception of natural and unconstrained gaze in humans and machines”. 2016.
G. Ben-Yosef, Yachin, A., and Ullman, S., “Recognizing and Interpreting Social Interactions in Local Image Regions”, The 24th Annual Workshop on Object Perception, Attention, and Memory (OPAM), Boston, MA. 2016.
G. Ben-Yosef, Assif, L., Harari, D., and Ullman, S., “A model for full local image interpretation”, Cognitive Science Society . 2015.
E. Fetaya, Shamir, O., and Ullman, S., “Graph Approximation and Clustering on a Budget”, Artificial Intelligence and Statistics , vol. 38. 2015.
S. de la Rosa, Choudhery, R. N., Curio, C., Ullman, S., Assif, L., and Bülthoff, H. H., “Visual categorization of social interactions”, Visual Cognition , vol. 22, no. 9-10, 2015.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Do You See What I Mean? Visual Resolution of Linguistic Ambiguities”, in Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal. , 2015.
T. Gao, Harari, D., Tenenbaum, J. B., and Ullman, S., “When Computer Vision Gazes at Cognition.”. 2014.