Jesse Thomason

Postdotoral Researcher - University of Washington
thomason DOT jesse AT gmail

I am a postdoctoral researcher working with Luke Zettlemoyer at the University of Washington. My research interests are primarily in semantic understanding and language grounding. I received my PhD from the University of Texas at Austin, working with Ray Mooney at the intersection of natural language processing and robotics. I developed algorithms that bootstrap robot understanding from interaction with humans, improving language understanding and perceptual grounding for embodied robots.

News

July 2018
I am co-organizing the SIGdial 2018 Special Session on Physically Situated Dialogue in Melbourne, Australia sometime in July 12-14th. We received a great turnout of exciting submissions to the special session track, and look forward to hosting a language and robotics-focused event within the dialog community.
June 2018
I am co-organizing the Robotics: Science and Systems 2018 Workshop on Models and Representations for Natural Human-Robot Communication in Pittsburgh, PA on June 29th and 30th. We are planning a two-day workshop with eight invited speakers, together with contributed talks and posters.
June 2018
I am starting as a postdoc with Luke Zettlemoyer at the University of Washington. I am excited to work on grounded semantic understanding tasks, and for the opportunity to collaborate with many of the great researchers at UW.
April 2018
I defended my dissertation on Continually Improving Grounded Natural Language Understanding through Human-Robot Dialog, wrapping up nearly 5 years in Austin working with Ray Mooney and collaborating with Peter Stone. I am grateful to them and to my frequent collaborators, Jivko Sinapov, Shiqi Zhang, and Aishwarya Padmakumar!

Refereed Conference and Journal Papers

Multi-modal Predicate Identification using Dynamically Learned Robot Controllers
Saeid Amiri, Suhua Wei, Shiqi Zhang, Jivko Sinapov, Jesse Thomason, and Peter Stone.
Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI-18), Stockholm, Sweden, July 2018.
paper
@inproceedings{amiri:ijcai18,
  title={Multi-modal Predicate Identification using Dynamically Learned Robot Controllers},
  author={Saeid Amiri and Suhua Wei and Shiqi Zhang and Jivko Sinapov and Jesse Thomason and Peter Stone},
  booktitle={Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI-18)},
  month={July},
  year={2018}
}
Guiding Exploratory Behaviors for Multi-Modal Grounding of Linguistic Descriptions
Jesse Thomason, Jivko Sinapov, Raymond Mooney, and Peter Stone.
Proceedings of the 32nd Conference on Artificial Intelligence (AAAI-18), New Orleans, Louisiana, February 2018.
papersourceslides
@inproceedings{thomason:aaai18,
  title={Guiding Exploratory Behaviors for Multi-Modal Grounding of Linguistic Descriptions},
  author={Jesse Thomason and Jivko Sinapov and Raymond Mooney and Peter Stone},
  booktitle={Proceedings of the 32nd Conference on Artificial Intelligence (AAAI-18)},
  month={February},
  year={2018}
}
Maximum-Variance Total Variation Denoising for Interpretable Spatial Smoothing
Wesley Tansey, Jesse Thomason, and James G Scott.
Proceedings of the 32nd Conference on Artificial Intelligence (AAAI-18), New Orleans, Louisiana, February 2018.
paperposter
@inproceedings{tansey:aaai18,
  title={Maximum-Variance Total Variation Denoising for Interpretable Spatial Smoothing},
  author={Wesley Tansey and Jesse Thomason and James G Scott},
  booktitle={Proceedings of the 32nd Conference on Artificial Intelligence (AAAI-18)},
  month={February},
  year={2018}
}
Opportunistic Active Learning for Grounding Natural Language Descriptions
Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Justin Hart, Peter Stone, and Raymond J. Mooney.
Proceedings of the 1st Annual Conference on Robot Learning (CoRL-17), pages 67-76, Mountain View, California, August 2017.
paperdemosourceposterslides
@inproceedings{thomason:corl17,
  title={Opportunistic Active Learning for Grounding Natural Language Descriptions},
  author={Jesse Thomason and Aishwarya Padmakumar and Jivko Sinapov and Justin Hart and Peter Stone and Raymond J. Mooney},
  booktitle={Proceedings of the 1st Annual Conference on Robot Learning (CoRL-17)},
  pages={67-76},
  month={August},
  year={2017}
}
Improving Black-box Speech Recognition using Semantic Parsing
Rodolfo Corona, Jesse Thomason, and Raymond J. Mooney.
Proceedings of the 8th International Joint Conference on Natural Language Processing (IJCNLP-17), Taipei, Taiwan, November 2017.
paperposter
@inproceedings{corona:ijcnlp17,
  title={Improving Black-box Speech Recognition using Semantic Parsing},
  author={Rodolfo Corona and Jesse Thomason and Raymond J. Mooney},
  booktitle={Proceedings of the 8th International Joint Conference on Natural Language Processing (IJCNLP-17)},
  month={November},
  year={2017}
}
Multi-Modal Word Synset Induction
Jesse Thomason and Raymond J. Mooney.
Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI-17), pages 4116-4122, Melbourne, Australia, August 2017.
paperposterslides
@inproceedings{thomason:ijcai17,
  title={Multi-Modal Word Synset Induction},
  author={Jesse Thomason and Raymond J. Mooney},
  booktitle={Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI-17)},
  pages={4116-4122},
  month={August},
  year={2017}
}
Integrated Learning of Dialog Strategies and Semantic Parsing
Aishwarya Padmakumar, Jesse Thomason, and Raymond J. Mooney.
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL-17), pages 547-557, Valencia, Spain, April 2017.
paper
@inproceedings{padmakumar:eacl17,
  title={Integrated Learning of Dialog Strategies and Semantic Parsing},
  author={Aishwarya Padmakumar and Jesse Thomason and Raymond J. Mooney},
  booktitle={Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL-17)},
  pages={547-557},
  month={April},
  year={2017}
}
BWIBots: A platform for bridging the gap between AI and human--robot interaction research
Piyush Khandelwal, Shiqi Zhang, Jivko Sinapov, Matteo Leonetti, Jesse Thomason, Fangkai Yang, Ilaria Gori, Maxwell Svetlik, Priyanka Khante, Vladimir Lifschitz, J. K. Aggarwal, Raymond Mooney, and Peter Stone.
Sage: The International Journal of Robotics Research (IJRR-17), February 2017.
paper
@article{khandelwal:ijrr17,
  title={BWIBots: A platform for bridging the gap between AI and human--robot interaction research},
  author={Piyush Khandelwal and Shiqi Zhang and Jivko Sinapov and Matteo Leonetti and Jesse Thomason and Fangkai Yang and Ilaria Gori and Maxwell Svetlik and Priyanka Khante and Vladimir Lifschitz and J. K. Aggarwal and Raymond Mooney and Peter Stone},
  journal={The International Journal of Robotics Research (IJRR-17)},
  publisher={Sage},
  month={February},
  year={2017}
}
Learning Multi-Modal Grounded Linguistic Semantics by Playing "I Spy"
Jesse Thomason, Jivko Sinapov, Maxwell Svetlik, Peter Stone, and Raymond Mooney.
Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI-16), pages 3477-3483, New York City, New York, July 2016.
paperdemosourceposterslides
@inproceedings{thomason:ijcai16,
  title={Learning Multi-Modal Grounded Linguistic Semantics by Playing ``{I} Spy''},
  author={Jesse Thomason and Jivko Sinapov and Maxwell Svetlik and Peter Stone and Raymond Mooney},
  booktitle={Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI-16)},
  pages={3477-3483},
  month={July},
  year={2016}
}
Learning to Interpret Natural Language Commands through Human-Robot Dialog
Jesse Thomason, Shiqi Zhang, Raymond Mooney, and Peter Stone.
Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI-15), pages 1923-1929, Buenos Aires, Argentina, July 2015.
paperdemosourceposterslides
@inproceedings{thomason:ijcai15,
  title={Learning to Interpret Natural Language Commands through Human-Robot Dialog},
  author={Jesse Thomason and Shiqi Zhang and Raymond Mooney and Peter Stone},
  booktitle={Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI-15)},
  pages={1923-1929},
  month={July},
  year={2015}
}
Integrating Language and Vision to Generate Natural Language Descriptions of Videos in the Wild
Jesse Thomason, Subhashini Venugopalan, and Raymond Mooney.
Proceedings of the 25th International Conference on Computational Linguistics (COLING-14), pages 1218-1227, Dublin, Ireland, August 2014.
paperposter
@inproceedings{thomason:coling14,
  title={Integrating Language and Vision to Generate Natural Language Descriptions of Videos in the Wild},
  author={Jesse Thomason and Subhashini Venugopalan and Raymond Mooney},
  booktitle={Proceedings of the 25th International Conference on Computational Linguistics (COLING-14)},
  pages={1218-1227},
  month={August},
  year={2014}
}
Prosodic Entrainment and Tutoring Dialogue Success
Jesse Thomason, Huy Nguyen, and Diane Litman.
Proceedings of the 16th International Conference on Artificial Intelligence in Education (AIED-13), pages 750-753, Memphis, TN, July 2013.
paperposter
@inproceedings{thomason:aied13,
  title={Prosodic Entrainment and Tutoring Dialogue Success},
  author={Jesse Thomason and Huy Nguyen and Diane Litman},
  booktitle={Proceedings of the 16th International Conference on Artificial Intelligence in Education (AIED-13)},
  pages={750-753},
  month={July},
  year={2013}
}
Differences in User Responses to a Wizard-of-Oz versus Automated System
Jesse Thomason and Diane Litman.
Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-13), pages 796-801, Atlanta, GA, June 2013.
paperslides
@inproceedings{thomason:naacl13,
  title={Differences in User Responses to a Wizard-of-Oz versus Automated System},
  author={Jesse Thomason and Diane Litman},
  booktitle={Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-13)},
  pages={796-801},
  month={June},
  year={2013}
}
Exploring Multi-dimensional Data on Mobile Devices with Single Hand Motion and Orientation Gestures
Jesse Thomason and Jingtao Wang.
Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion (MobileHCI-12), pages 173-176, San Francisco, CA, September 2012.
paperdemoposter
@inproceedings{thomason:mobilehci12,
  title={Exploring Multi-dimensional Data on Mobile Devices with Single Hand Motion and Orientation Gestures},
  author={Jesse Thomason and Jingtao Wang},
  booktitle={Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion (MobileHCI-12)},
  pages={173-176},
  month={September},
  year={2012}
}
Differentiated service strategies for ad-hoc wireless sensor networks in harsh communication environments
Jesse Thomason, Kenji Yoshigoe, R.B. Lenin, James M. Bridges, and Srini Ramaswamy.
Springer: Wireless Networks (WN-12) 18(5), pages 551-564, September 2012.
paper
@article{thomason:springer:wn12,
  title={Differentiated service strategies for ad-hoc wireless sensor networks in harsh communication environments},
  author={Jesse Thomason and Kenji Yoshigoe and R.B. Lenin and James M. Bridges and Srini Ramaswamy},
  journal={Wireless Networks (WN-12)},
  volume={18},
  issue={5},
  publisher={Springer},
  pages={551-564},
  month={September},
  year={2012},
  doi={10.1007/s11276-012-0418-3}
}

Workshops, Thesis work, etc.

Interaction and Autonomy in RoboCup@Home and Building-Wide Intelligence
Justin Hart, Harel Yedidsion, Yuqian Jiang, Nick Walker, Rishi Shah, Jesse Thomason, Aishwarya Padmakumar, Rolando Fernandez, Jivko Sinapov, Raymond Mooney, and Peter Stone.
AI-HRI AAAI Fall Symposium Series (AAAI-FSS), Washington, DC, October 2018.
paper
@inproceedings{hart:aaai-fss18,
  title={Interaction and Autonomy in RoboCup@Home and Building-Wide Intelligence},
  author={Justin Hart and Harel Yedidsion and Yuqian Jiang and Nick Walker and Rishi Shah and Jesse Thomason and Aishwarya Padmakumar and Rolando Fernandez and Jivko Sinapov and Raymond Mooney and Peter Stone},
  booktitle={AI-HRI AAAI Fall Symposium Series (AAAI-FSS)},
  month={October},
  year={2018}
}
Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog
Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Justin Hart, Peter Stone, and Raymond J. Mooney.
Late-breaking Track at the SIGDIAL Special Session on Physically Situated Dialogue (RoboDIAL-18), Melbourne, Australia, July 2018.
papervideo
@inproceedings{thomason:robodial18,
  title={Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog},
  author={Jesse Thomason and Aishwarya Padmakumar and Jivko Sinapov and Nick Walker and Yuqian Jiang and Harel Yedidsion and Justin Hart and Peter Stone and Raymond J. Mooney},
  booktitle={Late-breaking Track at the SIGDIAL Special Session on Physically Situated Dialogue (RoboDIAL-18)},
  month={July},
  year={2018}
}
Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog
Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Justin Hart, Peter Stone, and Raymond J. Mooney.
Proceedings of the RSS Workshop on Models and Representations for Natural Human-Robot Communication (MRHRC-18), Pittsburgh, PA, June 2018.
paperdemoposter
@inproceedings{thomason:mrhrc18,
  title={Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog},
  author={Jesse Thomason and Aishwarya Padmakumar and Jivko Sinapov and Nick Walker and Yuqian Jiang and Harel Yedidsion and Justin Hart and Peter Stone and Raymond J. Mooney},
  booktitle={Proceedings of the RSS Workshop on Models and Representations for Natural Human-Robot Communication (MRHRC-18)},
  publisher={Robotics: Science and Systems (RSS)},
  month={June},
  year={2018}
}
Continually Improving Grounded Natural Language Understanding through Human-Robot Dialog
Jesse Thomason.
Department of Computer Science, The University of Texas at Austin, April 2018.
paperslides
@phdthesis{thomason:thesis18,
  title={Continually Improving Grounded Natural Language Understanding through Human-Robot Dialog},
  author={Jesse Thomason},
  booktitle={Doctoral Dissertation},
  school={Department of Computer Science, The University of Texas at Austin},
  month={April},
  year={2018}
}
Interpretable Low-Dimensional Regression via Data-Adaptive Smoothing
Wesley Tansey, Jesse Thomason, and James G. Scott.
Proceedings of the ICML Workshop on Human Interpretability in Machine Learning (WHI-17), pages 44-48, Sydney, Australia, August 2017.
paperposter
@inproceedings{tansey:whi17,
  title={Interpretable Low-Dimensional Regression via Data-Adaptive Smoothing},
  author={Wesley Tansey and Jesse Thomason and James G. Scott},
  booktitle={Proceedings of the ICML Workshop on Human Interpretability in Machine Learning (WHI-17)},
  publisher={International Conference on Machine Learning (ICML)},
  pages={44-48},
  month={August},
  year={2017}
}
Guiding Interaction Behaviors for Multi-modal Grounded Language Learning
Jesse Thomason, Jivko Sinapov, and Raymond J. Mooney.
Proceedings of the First Workshop on Language Grounding for Robotics (RoboNLP-17), pages 20-24, Vancouver, Canada, August 2017.
paperposter
@inproceedings{thomason:robonlp17,
  title={Guiding Interaction Behaviors for Multi-modal Grounded Language Learning},
  author={Jesse Thomason and Jivko Sinapov and Raymond J. Mooney},
  booktitle={Proceedings of the First Workshop on Language Grounding for Robotics (RoboNLP-17)},
  publisher={Association for Computational Linguistics},
  pages={20-24},
  month={August},
  year={2017}
}
Continuously Improving Natural Language Understanding for Robotic Systems through Semantic Parsing, Dialog, and Multi-modal Perception
Jesse Thomason.
Doctoral Dissertation Proposal, December 2016.
paperslides
@inproceedings{thomason:proposal16,
  title={Continuously Improving Natural Language Understanding for Robotic Systems through Semantic Parsing, Dialog, and Multi-modal Perception},
  author={Jesse Thomason},
  booktitle={Doctoral Dissertation Proposal},
  month={December},
  year={2016}
}

Toybox

FlashCardr
2016
Twitter Poetry
2015
The Infinite Bestiary
2014