Publications

Preprints

• Ketz, N. A., & Pilly, P. K. (2022). Concept-modulated model-based offline reinforcement learning for rapid generalization. arXiv preprint arXiv:2209.03207.
• Krichmar JL, Ketz NA, Pilly PK, Soltoggio A. Flexible Path Planning through Vicarious Trial and Error. bioRxiv. 2021 Jan 1.
• Kolouri, S., Ketz, N., Zou, X., Krichmar, J., and Pilly, P. (2019). Attention-based structural-plasticity. arXiv preprint arXiv:1903.06070
• Ketz, N., Kolouri, S., and Pilly, P. (2019). Using world models for pseudo-rehearsal in continual learning. arXiv preprint arXiv:1903.02647
• Pilly PK, Skorheim SW, Hubbard RJ, Ketz NA, Roach SM, Jones AP, Robert B, Bryant NB, Lerner I, Hartholt A, Mullins TS. Spatiotemporal patterns of transcranial electrical stimulation can strengthen the metamemory of individual episodic memories in humans. bioRxiv. 2019 Jun 15:672378.

Journals

• Baker, Megan M., et al. A domain-agnostic approach for characterization of lifelong learning systems. Neural Networks (2023).
• Robert, Bradley M., et al. Closed-loop transcranial alternating current stimulation of slow wave oscillations during sleep reduces declarative learning the next day. Brain Stimulation: Basic, Translational, and Clinical Research in Neuromodulation 15.6 (2022): 1565-1566.
• Ben-Iwhiwhu E, Dick J, Ketz NA, Pilly PK, Soltoggio A. Context meta-reinforcement learning via neuromodulation. Neural Networks. 2022 Aug 1;152:70-9.
• Kudithipudi, Dhireesha, et al. “Biological underpinnings for lifelong learning machines.” Nature Machine Intelligence 4.3 (2022): 196-210.
• Ladosz P, Ben-Iwhiwhu E, Dick J, Ketz N, Kolouri S, Krichmar JL, Pilly PK, Soltoggio A. Deep Reinforcement Learning With Modulated Hebbian Plus Q-Network Architecture. IEEE Transactions on Neural Networks and Learning Systems. 2021 Sep 24.
• Pilly, P. K., Skorheim, S. W., Hubbard, R. J., Ketz, N. A., Roach, S. M., Lerner, I., … & Mullins, T. S. (2020). One-shot tagging during wake and cueing during sleep with spatiotemporal patterns of transcranial electrical stimulation can boost long-term metamemory of individual episodes in humans. Frontiers in neuroscience, 13, 1416.
• Lerner, I., Ketz, N. A., Jones, A. P., Bryant, N. B., Robert, B., Skorheim, S. W., Hartholt, A., Rizzo, A. S., Gluck, M. A., Clark, V. P., et al. (2019). transcranial current stimulation during sleep facilitates insight into temporal rules, but does not consolidate memories of individual sequential experiences. Scientific reports, 9(1):1516
• Jones, A. P., Choe, J., Bryant, N. B., Robinson, C. S. H., Ketz, N. A., Skorheim, S. W., Combs, A., Lamphere, M. L., Robert, B., Gill, H. A., et al. (2018).* Dose-dependent effects of closed-loop tacs delivered during slow-wave oscillations on memory consolidation.* Frontiers in Neuroscience, 12:867
• Ketz, N., Jones, A. P., Bryant, N. B., Clark, V. P., and Pilly, P. K. (2018).* Closed-loop slow-wave tacs improves sleep-dependent long-term memory generalization by modulating endogenous oscillations.* Journal of Neuroscience, 38(33):7314–7326
• Ketz, N., Jensen, O., and O’Reilly, R. C. (2015). Thalamic pathways underlying pfc-mtl oscillatory interations. Trends in Neurosciences, 38(1):3–12
• Ketz, N., O’Reilly, R. C., and Curran, T. (2014). Classification aided analysis of oscillatory signatures in controlled retrieval. NeuroImage, 85(2):749–60
• Ketz, N., Morkonda, S. G., and O’Reilly, R. C. (2013). Theta coordinated error-driven learning in the hippocampus. PLoS Comput Biol, 9(6)
• Depue, B. E., Ketz, N., Mollison, M. V., Nyhus, E., Banich, M. T., and Curran, T. (2013). Erps and neural oscillations during volitional suppression of memory retrieval. J. Cognitive Neuroscience, 25(10):1624–1633
• Duncan, K., Ketz, N., Inati, S. J., and Davachi, L. (2012).* Evidence for area ca1 as a match/mismatch detector: A high-resolution fmri study of the human hippocampus.* Hippocampus, 22(3):389–398
• O’Reilly, R. C., Bhattacharyya, R., Howard, M. D., and Ketz, N. (2011).* Complementary learning systems.* Cognitive Science
• Tambini, A., Ketz, N., and Davachi, L. (2010).* Enhanced brain correlations during rest are related to memory for recent experiences.* Neuron, 65:280–290
• Marsolek, C. J., Deason, R. G., Ketz, N. A., Ramanathan, P., Bernat, E. M., Steele, V. R., Patrick, C. J., Verfaellie, M., and Schnyer, D. M. (2010).* Identifying objects impairs knowledge of other objects: a relearning explanation for the neural repetition effect.* Neuroimage, 49:1919–1932

Conference Proceedings

• Krichmar, J. L., Ketz, N. A., Pilly, P. K., & Soltoggio, A. (2022, September). Flexible Path Planning in a Spiking Model of Replay and Vicarious Trial and Error. In From Animals to Animats 16: 16th International Conference on Simulation of Adaptive Behavior, SAB 2022, Cergy-Pontoise, France, September 20–23, 2022, Proceedings (pp. 177-189). Cham: Springer International Publishing.
• Xing, J., Zou, X., Pilly, P. K., Ketz, N. A., & Krichmar, J. L. (2022, September). Adapting to Environment Changes Through Neuromodulation of Reinforcement Learning. In From Animals to Animats 16: 16th International Conference on Simulation of Adaptive Behavior, SAB 2022, Cergy-Pontoise, France, September 20–23, 2022, Proceedings (pp. 115-126). Cham: Springer International Publishing.
• Maguire, G., Ketz, N., Pilly, P. K., & Mouret, J. B. (2022, September). A-EMS: An Adaptive Emergency Management System for Autonomous Agents in Unforeseen Situations. In Towards Autonomous Robotic Systems: 23rd Annual Conference, TAROS 2022, Culham, UK, September 7–9, 2022, Proceedings (pp. 266-281). Cham: Springer International Publishing.
• Kolouri, Soheil, Ketz, Nicholas A., Soltoggio, Andrea, Pilly, and Praveen K. (2020) Sliced Cramer Synaptic Consolidation for Preserving Deeply Learned Representations. Spotlight presentation at International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia
• Jones, Aaron P., Choe, Jaehoon, Bryant, Natalie B., Robinson, Charles S., Ketz, Nicholas A., Skorheim, Steven W., Combs, Angela, Lamphere, Melanie L., Robert, Bradley M., Gill, Hope A., Heinrich, Melissa D., Howard, Mike D., Clark, Vincent P., Pilly, Praveen K. (2019). Closed-oop tACS targeting slow-wave oscillations during sleep enhances consolidation of generalized information. Poster session presented at International Brain Stimulation Conference, Vancouver, BC, CA
• Hubbard, Ryan J., Ketz, Nicholas A., Jones, Aaron P., Robert, Bradley, Bryant, Natalie B., Skorheim, Steven, Roach, Shane, Clark, Vincent P., and Pilly, Praveen K. (2018).* Memory Reactivation with Neurostimulation during Sleep Elicits Electrophysiological Responses that Predict Behavioral Changes.* Poster session presented at national conference for the Cognitive Neuroscience Society. Boston, MA
• Ketz, Nick, Phillips, Matthew, Roach, Shane, and Pilly, Praveen. (2017).* Optimized independent component selection for automated EEG artifact removal.* Poster session presented at international conference for the Organization for Human Brain Mapping. Vancouver, BC, CA
• Bryant, N. B., Ketz, N. A., Jones, A. P., Choe, J., Robinson, C. S., Combs, A., … and Pilly, P. K. (2017). 0245 Closed-Loop tACS During SWS Boosts Slow-wave and Delta Power and Post-Sleep Memory for Threat Detection on Novel Stimuli. Journal of Sleep and Sleep Disorders Research, 40
• Ketz, Nick, O’Reilly, Randall, Curran, Tim. (2016). Paired Associate Encoding Influenced by Entrained Theta Power. Poster session presented at national conference for the Cognitive Neuroscience Society. New York, NY
• Ketz, Nick, O’Reilly, Randall, Curran, Tim. (2015).* Classification aided analysis of oscillatory connectivity during controlled retrieval. *Poster session presented at international conference for the Organization for Human Brain Mapping. Honolulu, HI, USA
• Ketz, Nick, O’Reilly, Randall, Curran, Tim. (2013).* Classification Aided Analysis of Oscillatory Signatures in Controlled Retrieval.* Poster session presented at national conference for the Cognitive Neuroscience Society. San Francisco, CA.
• Ketz, Nick, Gnanasekaran, Srinimish, O’Reilly, Randall. (2012).* Error-driven learning within the Hippocampus; theta rhythm, and novelty based learning signals.* Neural Computation and Psychology Workshop, San Sebastian, Spain
• Ketz, Nick, Gnanasekaran, Srinimish, O’Reilly, Randall. (2012). Error-driven learning within the Hippocampus; theta rhythm, and novelty based learning signals. Cosyne, Salt Lake City
• Tambini, A., Ketz, N. A., Davachi, L., (October 2009), Resting state brain activity changes with and predicts memory for recent experiences. Slide presentation at national conference for the Society for Neuroscience. Chicago, IL
• Duncan, K., Ketz, N. A., Davachi, L., (October 2009), Match/mismatch calculations in the human hippocampus: A high-resolution fMRI study. Slide presentation at national conference for the Society for Neuroscience. Chicago, IL
• Duncan, K., Ketz, N. A., Davachi, L., (November 2008), ’Match’ And ’mismatch’ signals: a high-resolution fMRI study of the human hippocampus. Poster session presented at national conference for the Society for Neuroscience. Washington, DC
• Duncan, K., Ketz, N. A., Davachi, L., (April 2008), Relational ’Match’ and ’Mismatch’ Signals in the Human Hippocampus are Differentially Modulated by Active Maintenance and Perceptual Novelty. Poster session presented at national conference for the Cognitive Neuroscience Society. San Francisco, CA.
• Marsolek, C. J., Ketz, N. A., Ramanathan, P., Deason, R. G., Davis, S., Verfaellie, M., Schnyer, D. M. (June 2007),* Neural priming effects in fMRI: Integrated fMRI and neurocomputational evidence for what may be reflected.* Poster session presented at Human Brain Mapping Annual Meeting, Chicago, IL
• Ramanathan, P., Ketz, N. A., Deason, R. G., Westerberg, C. E., Marsolek, C. J. (May 2007).* Visual antipriming and priming predicted by neurally plausible models of object identification.* Poster session presented at Cognitive Neuroscience Society Annual Meeting, New York, NY. Last updated: November 13, 2018

Patents

• Pilly, Praveen K., Nicholas A. Ketz, and Michael D. Howard. System and method for safety and efficacy override of an autonomous system. U.S. Patent No. 11,420,655. 23 Aug. 2022.
• Pilly P, Choe J, Howard M, Ketz N, inventors; HRL Laboratories LLC, assignee. System and method for asynchronous brain control of one or more tasks. United States patent US 11,237,634. 2022 Feb 1.
• Kolouri S, Ketz NA, Pilly PK, Martin CE, Howard MD, inventors; HRL Laboratories LLC, assignee. Artificial neural networks having attention-based selective plasticity and methods of training the same. United States patent US 11,210,559. 2021 Dec 28.
• Martin CE, Ketz NA, Pilly PK, Kolouri S, Howard MD, Stepp ND, inventors; HRL Laboratories LLC, assignee. Artificial neural network and method of training an artificial neural network with epigenetic neurogenesis. United States patent US 11,113,597. 2021 Sep 7.
• Ketz, Nicholas A., Matthew E. Phillips, and Praveen K. Pilly. System and method for optimized independent component selection for automated signal artifact removal to generate a clean signal. U.S. Patent No. 10,716,514. 21 Jul. 2020.
• Ketz, Nicholas A., et al. Autonomous system including a continually learning world model and related methods. U.S. Patent Application No. 16/548,560.
• Martin, Charles E., et al. Artificial Neural Network and Method of Training an Artificial Neural Network with Epigenetic Neurogenesis. U.S. Patent Application No. 16/561,735.
• Skorheim, Steven W., et al. Transcranial stimulation system and method to improve cognitive function after traumatic brain injury. U.S. Patent Application No. 15/983,629.