Publications

Publication list updates still in progress: manually verified citations and PDFs so far for 2023–2024 only.
Michael R. Dawson, Adam S. R. Parker, Heather E. Williams, Ahmed W. Shehata, Jacqueline S. Hebert, Craig S. Chapman, Patrick M. Pilarski (2024). Joint Action is a Framework for Understanding Partnerships Between Humans and Upper Limb Prostheses. 2024 10th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob 2024), 1–4 September, Heidelberg, Germany, pp. 605-611.

PDF Cite

Heather E. Williams, Jacqueline S. Hebert, Patrick M. Pilarski, Ahmed W. Shehata (2024). Evidence that a deep learning regression-based controller mitigates the limb position effect for an individual with transradial amputation. Myoelectric Controls Symposium (MEC24), 12–15 August, Fredericton, NB, Canada, pp. 1–4.

PDF Cite

Mitchell A. Dumba, Michael R. Dawson, Glyn Murgatroyd, Patrick M. Pilarski, Jacqueline S. Hebert, Ahmed W. Shehata (2024). A Virtual Reality Training Environment for Myoelectric Prosthesis Grasp Control with Sensory Feedback. Myoelectric Controls Symposium (MEC24), 12–15 August, Fredericton, NB, Canada, pp. 1–4.

PDF Cite

Laura C. Petrich, Heather E. Williams, Matthew E. Taylor, Jacqueline S. Hebert, Pierre Lemelin, Ahmed W. Shehata, Patrick M. Pilarski (2024). A Preliminary Investigation Into Bio-Inspired Data Collection for Transhumeral Targeted Muscle Reinnervation Prosthetic Control. Myoelectric Controls Symposium (MEC24), 12–15 August, Fredericton, NB, Canada, pp. 1–4.

PDF Cite

Heather E. Williams, Ahmed W. Shehata, Kodi Y. Cheng, Jacqueline S. Hebert, Patrick M. Pilarski (2024). A multifaceted suite of metrics for comparative myoelectric prosthesis controller research. PLoS ONE, 19(5): e0291279.

PDF Cite

Heather E. Williams, Ahmed W. Shehata, Kodi Y. Cheng, Jacqueline S. Hebert, Patrick M. Pilarski (2024). Myoelectric Prosthesis Control using Recurrent Convolutional Neural Network Regression Mitigates the Limb Position Effect. bioRxiv 2024.02.05.578477.

PDF Cite

Scott A. Stone, Quinn A. Boser, T. Riley Dawson, Albert H. Vette, Jacqueline S. Hebert, Patrick M. Pilarski, Craig S. Chapman (2024). Generating accurate 3D gaze vectors using synchronized eye tracking and motion capture. Behavior Research Methods, 56: 18–31.

PDF Cite

Heather E. Williams, Jacqueline S. Hebert, Patrick M. Pilarski, Ahmed W. Shehata (2023). A Case Series in Position-Aware Myoelectric Prosthesis Control Using Recurrent Convolutional Neural Network Classification with Transfer Learning. 2023 International Conference on Rehabilitation Robotics (ICORR), Singapore, pp. 1–6.

PDF Cite

Kory W. Mathewson, Adam S. R. Parker, Craig Sherstan, Ann L. Edwards, Richard S. Sutton, Patrick M. Pilarski (2023). Communicative capital: A key resource for human-machine shared agency and collaborative capacity. Neural Computing and Applications, 35(23): 16805–16819.

PDF Cite

Alex Kearney, Anna J. Koop, Patrick M. Pilarski (2023). What's a good prediction? Challenges in evaluating an agent's knowledge. Adaptive Behavior, 31(3): 197-212.

PDF Cite

Nathan J. Wispinski, Andrew Butcher, Craig S. Chapman, Matthew M. Botvinick, Patrick M. Pilarski (2023). Adaptive patch foraging in deep reinforcement learning agents. Transactions on Machine Learning Research (TMLR), 667: 1–19. Also appeared in short form at the 5th Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM2022).

PDF Cite

Aleksandra Kalinowska, Patrick M. Pilarski, Todd D. Murphey (2023). Embodied communication: How robots and people communicate through physical interaction. Annual Review of Control, Robotics, and Autonomous Systems, 6: 205–232.

PDF Cite

Adam S. R. Parker, Michael R. Dawson, Patrick M. Pilarski (2022). Continually Learned Pavlovian Signalling Without Forgetting for Human-in-the-Loop Robotic Control. NeurIPS Workshop on Human in the Loop Learning (HiLL), pp. 1–11. Also arXiv:2305.14365 [cs.LG].

PDF Cite

Richard S. Sutton, Michael Bowling, Patrick M. Pilarski (2022). The Alberta plan for AI research. arXiv:2208.11173 [cs.AI].

PDF Cite

Patrick M. Pilarski, Andrew Butcher, Elnaz Davoodi, Michael Bradley Johanson, Dylan J. A. Brenneis, Adam S. R. Parker, Leslie Acker, Matthew M. Botvinick, Joseph Modayil, Adam White (2022). The Frost Hollow Experiments: Pavlovian signalling as a path to coordination and communication between agents. arXiv:2203.09498 [cs.AI].

PDF Cite Code

Alexandra Kearney, Anna Koop, Johannes Günther, Patrick M Pilarski (2022). What Should I Know? Using Meta-gradient Descent for Predictive Feature Discovery in a Single Stream of Experience. Conference on Lifelong Learning Agents (CoLLAs 2022).

Cite

Aleksandra Kalinowska, Elnaz Davoodi, Kory W Mathewson, Todd Murphey, Patrick M Pilarski (2022). Towards situated communication in multi-step interactions: Time is a key pressure in communication emergence. Proceedings of the Annual Meeting of the Cognitive Science Society.

Cite

Aleksandra Kalinowska, Elnaz Davoodi, Florian Strub, Kory Mathewson, Todd Murphey, Patrick Pilarski (2022). Situated communication: A solution to over-communication between artificial agents. Emergent Communication Workshop at ICLR 2022.

Cite

Ana Luisa Trejos, S Farokh Atashzar, Simon DiMaio, Patrick M Pilarski, Mahdi Tavakoli (2022). Robotics, Autonomous Systems, and AI for Nonurgent/Nonemergent Healthcare Delivery During and After the COVID-19 Pandemic. Frontiers in Robotics and AI.

Cite

Mahdi Tavakoli, S Farokh Atashzar, Ana Luisa Trejos, Simon DiMaio, Patrick M Pilarski (2022). Robotics, Autonomous Systems and AI for Nonurgent/Nonemergent Healthcare Delivery During and After the COVID-19 Pandemic. Frontiers Media SA.

Cite

Heather Elizabeth Williams, Ahmed W Shehata, Michael Rory Dawson, Erik Scheme, Jacqueline Susanne Hebert, Patrick M Pilarski (2022). Recurrent Convolutional Neural Networks as an Approach to Position-Aware Myoelectric Prosthesis Control. IEEE Transactions on Biomedical Engineering.

Cite

Nadia M Ady, Roshan Shariff, Johannes Günther, Patrick M Pilarski (2022). Prototyping three key properties of specific curiosity in computational reinforcement learning. The 5th Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM2022).

Cite

Javier L Castellanos-Cruz, Marı́a F Gómez-Medina, Mahdi Tavakoli, Patrick Pilarski, Kim D Adams (2022). Preliminary testing of eye gaze interfaces for controlling a haptic system intended to support play in children with physical impairments: Attentive versus explicit interfaces. Journal of Rehabilitation and Assistive Technologies Engineering.

Cite

Alex Kearney, Johannes Günther, Patrick M Pilarski (2022). Prediction, Knowledge, And Explainability: Examining The Use of General Value Functions in Machine Knowledge. Frontiers in Artificial Intelligence.

Cite

Andrew Butcher, Michael Bradley Johanson, Elnaz Davoodi, Dylan JA Brenneis, Leslie Acker, Adam SR Parker, Adam White, Joseph Modayil, Patrick M Pilarski (2022). Pavlovian Signalling with General Value Functions in Agent-Agent Temporal Decision Making. Adaptive and Learning Agents (ALA) Workshop at AAMAS 2022.

Cite

Aleksandra Kalinowska, Elnaz Davoodi, Florian Strub, Kory W Mathewson, Ivana Kajic, Michael Bowling, Todd D Murphey, Patrick M Pilarski (2022). Over-communicate no more: Situated RL agents learn concise communication protocols. arXiv preprint arXiv:2211.01480.

Cite

Pouria Faridi, Javad K Mehr, Don Wilson, Mojtaba Sharifi, Mahdi Tavakoli, Patrick M Pilarski, Vivian K Mushahwar (2022). Machine-learned Adaptive Switching in Voluntary Lower-limb Exoskeleton Control: Preliminary Results. 17th IEEE International Conference on Rehabilitation Robotics (ICORR).

Cite

Nadia M Ady, Roshan Shariff, Johannes Günther, Patrick M Pilarski (2022). Five Properties of Specific Curiosity You Didn't Know Curious Machines Should Have. arXiv preprint arXiv:2212.00187.

Cite

Heather E Williams, Johannes Günther, Jacqueline S Hebert, Patrick M Pilarski, Ahmed W Shehata (2022). Composite Recurrent Convolutional Neural Networks Offer a Position-Aware Prosthesis Control Alternative While Balancing Predictive Accuracy with Training Burden. 2022 International Conference on Rehabilitation Robotics (ICORR).

Cite

Aleksandra Kalinowska, Elnaz Davoodi, Kory W Mathewson, Todd D Murphey, Patrick M Pilarski (2022). Communication Emergence in a Goal-Oriented Environment: Towards Situated Communication in Multi-Step Interactions. RLDM.

Cite

Dylan JA Brenneis, Adam S Parker, Michael Bradley Johanson, Andrew Butcher, Elnaz Davoodi, Leslie Acker, Matthew M Botvinick, Joseph Modayil, Adam White, Patrick M Pilarski (2022). Assessing human interaction in virtual reality with continually learning prediction agents based on reinforcement learning algorithms: A pilot study. Adaptive and Learning Agents (ALA) Workshop at AAMAS 2022.

Cite

Kory W Mathewson, Patrick M Pilarski (2022). A Brief Guide to Designing and Evaluating Human-Centered Interactive Machine Learning. SMILES ICLR Workshop 2022; also arXiv preprint arXiv:2204.09622.

Cite

Scott a Stone, Quinn a Boser, T Riley Dawson, Albert H Vette, Jacqueline S Hebert, Patrick M Pilarski, Craig S Chapman (2021). Sub-centimeter 3d gaze vector accuracy on real-world tasks: An investigation of eye and motion capture calibration routines. ACM Symposium on Eye Tracking Research and Applications.

Cite

Heather E Williams, Craig S Chapman, Patrick M Pilarski, Albert H Vette, Jacqueline S Hebert (2021). Myoelectric prosthesis users and non-disabled individuals wearing a simulated prosthesis exhibit similar compensatory movement strategies. Journal of NeuroEngineering and Rehabilitation.

Cite

Ahmed W Shehata, Heather E Williams, Jacqueline S Hebert, Patrick M Pilarski (2021). Machine Learning for the Control of Prosthetic Arms: Using Electromyographic Signals for Improved Performance. IEEE SIGNAL PROCESSING MAGAZINE.

Cite

Alex Kearney, Anna Koop, Johannes Günther, Patrick M Pilarski (2021). Finding Useful Predictions by Meta-gradient Descent to Improve Decision-making. NeurIPS 2021 Workshop: Self-Supervised Learning - Theory and Practice.

Cite

Jonathon S Schofield, Marcus a Battraw, Adam SR Parker, Patrick M Pilarski, Jonathon W Sensinger, Paul D Marasco (2021). Embodied cooperation to promote forgiving interactions with autonomous machines. Frontiers in neurorobotics.

Cite

Dammika P Manage, Jana Lauzon, Linda M Pilarski, Patrick M Pilarski, Lynn M McMullen (2021). Comparison of a Miniaturized Cassette PCR System with a Commercially Available Platform for Detecting Escherichia coli in Beef Carcass Swabs. Micromachines.

Cite

Alex Kearney, Anna Koop, Patrick M Pilarski (2020). What's a Good Prediction? Issues in Evaluating General Value Functions Through Error.. arXiv [Preprint]. arXiv: 2001.08823.

Cite

Johannes Günther, Elias Reichensdörfer, Patrick M Pilarski, Klaus Diepold (2020). Interpretable PID parameter tuning for control engineering using general dynamic neural networks: An extensive comparison. Plos One.

Cite

Craig Sherstan, Shibhansh Dohare, James MacGlashan, Johannes Günther, Patrick M Pilarski (2020). Gamma-nets: Generalizing value estimation over timescale. Proceedings of the AAAI Conference on Artificial Intelligence.

Cite

Johannes Günther, Nadia M Ady, Alex Kearney, Michael R Dawson, Patrick M Pilarski (2020). Examining the use of temporal-difference incremental delta-bar-delta for real-world predictive knowledge architectures. Frontiers in Robotics and AI.

Cite

Katya Kudashkina, Patrick M Pilarski, Richard S Sutton (2020). Document-editing assistants and model-based reinforcement learning as a path to conversational AI. arXiv preprint arXiv:2008.12095.

Cite

Aı̈da M Valevicius, Quinn a Boser, Craig S Chapman, Patrick M Pilarski, Albert H Vette, Jacqueline S Hebert (2020). Compensatory strategies of body-powered prosthesis users reveal primary reliance on trunk motion and relation to skill level. Clinical Biomechanics.

Cite

Michael Dawson, Heather Williams, Glyn Murgatroyd, Jacqueline Hebert, Patrick Pilarski (2020). BrachIOPlexus: Myoelectric training software for clinical and research applications. MEC20 Symposium.

Cite

Ben W Hallworth, Ahmed W Shehata, Michael R Dawson, Florian Sperle, Mathilde Connan, Werner Friedl, Bernhard Vodermayer, Claudio Castellini, Jacqueline S Hebert, Patrick M Pilarski (2020). A TRANSRADIAL MODULAR ADAPTABLE PLATFORM FOR EVALUATING PROSTHETIC FEEDBACK AND CONTROL STRATEGIES. MEC Symposium.

Cite

Alex Kearney, Patrick M Pilarski (2019). When is a prediction knowledge?. arXiv preprint arXiv:1904.09024.

Cite

Dylan JA Brenneis, Michael R Dawson, Hiroki Tanikawa, Jacqueline S Hebert, Jason P Carey, Patrick M Pilarski (2019). The effect of an automatically levelling wrist control system. 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

Cite

Javier L Castellanos-Cruz, Mahdi Tavakoli, Patrick M Pilarski, Kim Adams (2019). Supporting Play by Applying Haptic Guidance Along a Surface Learnt from Single Motion Trajectories. 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

Cite

Jacqueline S Hebert, Quinn a Boser, Aı̈da M Valevicius, Hiroki Tanikawa, Ewen B Lavoie, Albert H Vette, Patrick M Pilarski, Craig S Chapman (2019). Quantitative eye gaze and movement differences in visuomotor adaptations to varying task demands among upper-extremity prosthesis users. JAMA network open.

Cite

Javier Castellanos Cruz, Maria F Gomez Medina, Mandi Tavakoli, Patrick M Pilarski, Kim Adams (2019). Predicting the toys that children and participants with cerebral palsy want to reach while controlling a haptic telerobotic system. ASSISTIVE TECHNOLOGY.

Cite

Javier L Castellanos-Cruz, Marı́a F Gómez-Medina, Mahdi Tavakoli, Patrick M Pilarski, Kim Adams (2019). Predicting the toys that children and participants with cerebral palsy want to reach while controlling a haptic telerobotic system. Rehabilitation Engineering and Assistive Technology Society of North America Annual Conference. Toronto, Canada.

Cite

Johannes Günther, Alex Kearney, Nadia M Ady, Michael Rory Dawson, Patrick M Pilarski (2019). Meta-learning for Predictive Knowledge Architectures: A Case Study Using TIDBD on a Sensor-rich Robotic Arm.. AAMAS.

Cite

Alex Kearney, Vivek Veeriah, Jaden Travnik, Patrick M Pilarski, Richard S Sutton (2019). Learning feature relevance through step size adaptation in temporal-difference learning. arXiv preprint arXiv:1903.03252.

Cite

Patrick M Pilarski, Andrew Butcher, Michael Johanson, Matthew M Botvinick, Andrew Bolt, Adam SR Parker (2019). Learned human-agent decision-making, communication and joint action in a virtual reality environment. The 4th Multidisciplinary Conference on Reinforcement Learning and Decision Making, July 7-10, 2019, McGill University, Montreal, Quebec, Canada; also arXiv preprint arXiv:1905.02691.

Cite

Heather E Williams, Quinn a Boser, Patrick M Pilarski, Craig S Chapman, Albert H Vette, Jacqueline S Hebert (2019). Hand function kinematics when using a simulated myoelectric prosthesis. 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

Cite

Johannes Günther, Elias Reichensdörfer, Patrick M Pilarski, Klaus Diepold (2019). General Dynamic Neural Networks for explainable PID parameter tuning in control engineering: An extensive comparison. CoRR.

Cite

Heather E Williams, Craig S Chapman, Patrick M Pilarski, Albert H Vette, Jacqueline S Hebert (2019). Gaze and Movement Assessment (GaMA): Inter-site validation of a visuomotor upper limb functional protocol. PLoS One.

Cite

Adam SR Parker, Ann L Edwards, Patrick M Pilarski (2019). Exploring the impact of machine-learned predictions on feedback from an artificial limb. 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

Cite

Dammika P Manage, Jana Lauzon, Christina M Jones, Patrick J Ward, Linda M Pilarski, Patrick M Pilarski, Lynn M McMullen (2019). Detection of pathogenic Escherichia coli on potentially contaminated beef carcasses using cassette PCR and conventional PCR. BMC microbiology.

Cite

Javier L Castellanos-Cruz, Marı́a F Gómez-Medina, Mahdi Tavakoli, Patrick M Pilarski, Kim Adams (2019). Comparison of attentive and explicit eye gaze interfaces for controlling haptic guidance of a robotic controller. Journal of Medical Robotics Research.

Cite

Maria F Gomez Medina, Javier Castellanos Cruz, Adriana M Rios Rincon, Patrick M Pilarski, Kim Adams (2019). Comparison between two different prompting conditions when children use a lego robot to perform a set of tasks. ASSISTIVE TECHNOLOGY.

Cite

Aı̈da M Valevicius, Quinn a Boser, Ewen B Lavoie, Craig S Chapman, Patrick M Pilarski, Jacqueline S Hebert, Albert H Vette (2019). Characterization of normative angular joint kinematics during two functional upper limb tasks. Gait & posture.

Cite

Ewen B Lavoie, Aı̈da M Valevicius, Quinn a Boser, Ognjen Kovic, Albert H Vette, Patrick M Pilarski, Jacqueline S Hebert, Craig S Chapman (2018). Using synchronized eye and motion tracking to determine high-precision eye-movement patterns during object-interaction tasks. Journal of vision.

Cite

Alex Kearney, Vivek Veeriah, Jaden B Travnik, Richard S Sutton, Patrick M Pilarski (2018). Tidbd: Adapting temporal-difference step-sizes through stochastic meta-descent. arXiv preprint arXiv:1804.03334.

Cite

Jaden B Travnik, Kory W Mathewson, Richard S Sutton, Patrick M Pilarski (2018). Reactive Reinforcement Learning in Asynchronous Environments. Frontiers in Robotics and AI.

Cite

Javier L Castellanos-Cruz, Marı́a F Gómez-Medina, Mahdi Tavakoli, Patrick M Pilarski, Kim Adams (2018). Preliminary testing of a telerobotic haptic system and analysis of visual attention during a playful activity. 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

Cite

Johannes Gunther, Alex Kearney, Michael R Dawson, Craig Sherstan, Patrick M Pilarski (2018). Predictions, Surprise, and Predictions of Surprise in General Value Function Architectures. AAAI 2018 Fall Symposium on Reasoning and Learning in Real-World Systems for Long-Term Autonomy.

Cite

Michael Wininger, Panagiotis Artemiadis, Claudio Castellini, Patrick Pilarski (2018). Peripheral Nervous System-Machine Interfaces. Frontiers Media SA.

Cite

Darin Hunt, Curtis Figley, Dammika P Manage, Jana Lauzon, Rachel Figley, Linda M Pilarski, Lynn M McMullen, Patrick M Pilarski (2018). Monitoring food pathogens: novel instrumentation for cassette PCR testing. PLoS One.

Cite

Sandy H Huang, Martina Zambelli, Yuval Tassa, Jackie Kay, Murilo F Martins, Patrick M Pilarski, Raia Hadsell (2018). Leveraging Physical Models for Gentle Manipulation. Modeling the Physical World: Perception, Learning, and Control, NeurIPS 2018 Workshop.

Cite

Dylan JA Brenneis, Michael R Dawson, Glyn Murgatroyd, Jason P Carey, Patrick M Pilarski (2018). Initial investigation of a self-adjusting wrist control system to maintain prosthesis terminal device orientation relative to the ground reference frame. 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

Cite

Craig Sherstan, Marlos C Machado, Patrick M Pilarski (2018). Incrementally Added GVFs are Learned Faster with the Successor Representation. Lifelong Learning: A Reinforcement Learning Approach (LLARLA-2018), FAIM 2018 Workshop (ICML/AAMAS).

Cite

Craig Sherstan, James MacGlashan, Patrick M Pilarski (2018). Generalizing Value Estimation over Timescale. FAIM workshop on Prediction and Generative Modeling in Reinforcement Learning.

Cite

Alex Kearney, Anna Koop, Craig Sherstan, Johannes Günther, Richard S Sutton, Patrick M Pilarski, Matthew E Taylor (2018). Evaluating Predictive Knowledge. AAAI 2018 Fall Symposium on Reasoning and Learning in Real-World Systems for Long-Term Autonomy.

Cite

Gautham Vasan, Patrick M Pilarski (2018). Context-Aware Learning from Demonstration: Using Camera Data to Support the Synergistic Control of a Multi-Joint Prosthetic Arm. 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

Cite

Quinn a Boser, Aı̈da M Valevicius, Ewen B Lavoie, Craig S Chapman, Patrick M Pilarski, Jacqueline S Hebert, Albert H Vette (2018). Cluster-based upper body marker models for three-dimensional kinematic analysis: Comparison with an anatomical model and reliability analysis. Journal of biomechanics.

Cite

Aı̈da M Valevicius, Quinn a Boser, Ewen B Lavoie, Glyn S Murgatroyd, Patrick M Pilarski, Craig S Chapman, Albert H Vette, Jacqueline S Hebert (2018). Characterization of normative hand movements during two functional upper limb tasks. PLoS One.

Cite

Sandy H Huang, Martina Zambelli, Yuval Tassa, Jackie Kay, Murilo F Martins, Patrick M Pilarski, Raia Hadsell (2018). Achieving Gentle Manipulation with Deep Reinforcement Learning. Deep Reinforcement Learning Workshop, NeurIPS 2018.

Cite

Craig Sherstan, Marlos C Machado, Patrick M Pilarski (2018). Accelerating learning in constructive predictive frameworks with the successor representation. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

Cite

Patrick M Pilarski, Jacqueline S Hebert (2017). Upper and Lower Limb Robotic Prostheses. Robotic Assistive Technologies: Principles and Practice.

Cite

Jaden B Travnik, Patrick M Pilarski (2017). Representing high-dimensional data to intelligent prostheses and other wearable assistive robots: A first comparison of tile coding and selective Kanerva coding. 2017 International Conference on Rehabilitation Robotics (ICORR).

Cite

Kory Wallace Mathewson, Patrick M Pilarski (2017). Reinforcement learning based embodied agents modelling human users through interaction and multi-sensory perception. 2017 AAAI Spring Symposium Series.

Cite

Michael Wininger, Panagiotis Artemiadis, Claudio Castellini, Patrick Pilarski (2017). Peripheral nervous system-machine interfaces (PNS-MI). Frontiers in Neurorobotics.

Cite

Gautham Vasan, Patrick M Pilarski (2017). Learning from Demonstration: Teaching a Myoelectric Prosthesis with an Intact Limb via Reinforcement Learning. Proc. IEEE Int. Conf. on Rehab. Robotics (ICORR).

Cite

Dylan JA Brenneis, Michael R Dawson, Patrick M Pilarski (2017). DEVELOPMENT OF THE HANDI HAND: AN INEXPENSIVE, MULTI-ARTICULATING, SENSORIZED HAND FOR MACHINE LEARNING RESEARCH IN MYOELECTRIC CONTROL. MEC ‘17: Myoelectric Controls Symposium.

Cite

Nadia M Ady, Patrick M Pilarski (2017). Comparing Reinforcement Learning Methods for Computational Curiosity through Behavioural Analysis. RLDM.

Cite

Patrick M Pilarski, Richard S Sutton, Kory W Mathewson, Craig Sherstan, Adam SR Parker, Ann L Edwards (2017). Communicative capital for prosthetic agents. arXiv preprint arXiv:1711.03676.

Cite

Roberto Vega, Touqir Sajed, Kory Wallace Mathewson, Kriti Khare, Patrick M Pilarski, Russell Greiner, Gildardo Sanchez-Ante, Javier Mauricio Antelis (2017). Assessment of feature selection and classification methods for recognizing motor imagery tasks from electroencephalographic signals.. Artif. Intell. Res..

Cite

Kory W Mathewson, Patrick M Pilarski (2017). Actor-critic reinforcement learning with simultaneous human control and feedback. arXiv preprint arXiv:1703.01274.

Cite

Harm Van Seijen, A Rupam Mahmood, Patrick M Pilarski, Marlos C Machado, Richard S Sutton (2016). True online temporal-difference learning. Journal of Machine Learning Research.

Cite

Patrick M Pilarski, Craig Sherstan (2016). Steps Toward Knowledgeable Neuroprostheses. The 6th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob 2016).

Cite

Kory W Mathewson, Patrick M Pilarski (2016). Simultaneous control and human feedback in the training of a robotic agent with actor-critic reinforcement learning. arXiv preprint arXiv:1606.06979.

Cite

Ann L Edwards, Jacqueline S Hebert, Patrick M Pilarski (2016). Machine Learning and Unlearning to Autonomously Switch Between the Functions of a Myoelectric Arm. The 6th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob 2016).

Cite

Craig Sherstan, Adam White, Marlos C Machado, Patrick M Pilarski (2016). Introspective agents: Confidence measures for general value functions. Artificial General Intelligence: 9th International Conference, AGI 2016, New York, NY, USA, July 16-19, 2016, Proceedings 9.

Cite

Johannes Günther, Patrick M Pilarski, Gerhard Helfrich, Hao Shen, Klaus Diepold (2016). Intelligent laser welding through representation, prediction, and control learning: An architecture with deep neural networks and reinforcement learning. Mechatronics.

Cite

Vivek Veeriah, Patrick M Pilarski, Richard S Sutton (2016). Face valuing: Training user interfaces with facial expressions and reinforcement learning. arXiv preprint arXiv:1606.02807.

Cite

Ann L Edwards, Michael R Dawson, Jacqueline S Hebert, Craig Sherstan, Richard S Sutton, K Ming Chan, Patrick M Pilarski (2016). Application of real-time machine learning to myoelectric prosthesis control: A case series in adaptive switching. Prosthetics and orthotics international.

Cite

Patrick M Pilarski, Richard S Sutton, Kory W Mathewson (2015). Prosthetic Devices as Goal-Seeking Agents. Second Workshop on Present and Future of Non-Invasive Peripheral-Nervous-System Machine Interfaces: Progress in Restoring the Human Functions (PNS-MI).

Cite

Patrick Pilarski, Ann L Edwards, K Ming Chan (2015). Novel Control Strategies for Arm Prostheses: A Partnership between Man and Machine. The Japanese Journal of Rehabilitation Medicine.

Cite

Patricia a Toniolo, Patrick M Pilarski, Christian Bach, James D Griffin, Sophia Adamia (2015). MicroRNAs as potential therapeutic agents for AML: Targeting the AML1-ETO Oncogene by pre-miR-520 and-373. Cancer Research.

Cite

Harm Van Seijen, A Rupam Mahmood, Patrick M Pilarski, Richard S Sutton (2015). An empirical evaluation of true online td ($$$backslash$lambda$$). arXiv preprint arXiv:1507.00353.

Cite

Craig Sherstan, Joseph Modayil, Patrick M Pilarski (2015). A collaborative approach to the simultaneous multi-joint control of a prosthetic arm. 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

Cite

Adam SR Parker, Ann L Edwards, Patrick M Pilarski (2014). Using learned predictions as feedback to improve control and communication with an artificial limb: Preliminary findings. arXiv preprint arXiv:1408.1913.

Cite

Claudio Castellini, Panagiotis Artemiadis, Michael Wininger, Arash Ajoudani, Merkur Alimusaj, Antonio Bicchi, Barbara Caputo, William Craelius, Strahinja Dosen, Kevin Englehart, Others (2014). Proceedings of the first workshop on peripheral machine interfaces: Going beyond traditional surface electromyography. Frontiers in neurorobotics.

Cite

Sophia Adamia, Michal Bar-Natan, Benjamin Haibe-Kains, Patrick M Pilarski, Christian Bach, Samuel Pevzner, Teresa Calimeri, Herve Avet-Loiseau, Laurence Lode, Sigitas Verselis, Others (2014). NOTCH2 and FLT3 gene mis-splicings are common events in patients with acute myeloid leukemia (AML): new potential targets in AML. Blood, The Journal of the American Society of Hematology.

Cite

Craig Sherstan, Patrick M Pilarski (2014). Multilayer General Value Functions for Robotic Prediction and Control. 2014 IROS Workshop on AI and Robotics.

Cite

Johannes Günther, Patrick M Pilarski, Gerhard Helfrich, Hao Shen, Klaus Diepold (2014). First steps towards an intelligent laser welding architecture using deep neural networks and reinforcement learning. Procedia Technology.

Cite

Michael R Dawson, Craig Sherstan, Jason P Carey, Jacqueline S Hebert, Patrick M Pilarski (2014). Development of the Bento Arm: An Improved Robotic Arm for Myoelectric Training and Research. MEC ‘14: Myoelectric Controls Symposium.

Cite

Anna J Koop, Alexandra Kearney, Michael Bowling, Patrick M Pilarski (2014). Dealing with Changing Contexts in Myoelectric Control. MEC ‘14: Myoelectric Controls Symposium.

Cite

Patrick M Pilarski (2014). Aligning homeostatic and heterostatic Perspectives. Constructivist Foundations.

Cite

Ann L Edwards, Michael R Dawson, Jacqueline S Hebert, Richard S Sutton, K Ming Chan, Patrick M Pilarski (2014). Adaptive Switching in Practice: Improving Myoelectric Prosthesis Performance through Reinforcement Learning. MEC ‘14: Myoelectric Controls Symposium.

Cite

Sophia Adamia, Benjamin Haibe-Kains, Patrick M Pilarski, Michal Bar-Natan, Samuel Pevzner, Herve Avet-Loiseau, Laurence Lode, Sigitas Verselis, Edward a Fox, John Burke, Others (2014). A genome-wide aberrant RNA splicing in patients with acute myeloid leukemia identifies novel potential disease markers and therapeutic targets. Clinical cancer research.

Cite

Ann L Edwards, Alexandra Kearney, Michael Rory Dawson, Richard S Sutton, Patrick M Pilarski (2013). Temporal-difference learning to assist human decision making during the control of an artificial limb. arXiv preprint arXiv:1309.4714.

Cite

Patrick M Pilarski, Travis B Dick, Richard S Sutton (2013). Real-time Prediction Learning for the Simultaneous Actuation of Multiple Prosthetic Joints. 2013 IEEE International Conference on Rehabilitation Robotics (ICORR).

Cite

Simon Grange, Kris Chettiar, Mateen Arestu, Patrick Pilarski, Peter Smitham, Marilena Loizidou, GAVIN JELL (2013). Nanotechnology and medical devices: Risk, regulation and ‘meta’ registration. World Journal of Engineering.

Cite

Kris Chettiar SIMON GRANGE, Peter Smitham, Patrick Pilarski, Marilena Loizidou, GAVIN JELL (2013). Nanotechnology & Medical Devices: Risk, Regulation and ‘Meta’Registration. World Journal of Engineering.

Cite

Patrick M Pilarski, Liping Qi, Martin Ferguson-Pell, Simon Grange (2013). Determining the Time until Muscle Fatigue using Temporally Extended Prediction Learning. 18th International Functional Electrical Stimulation Society Conference (IFESS).

Cite

Linda M Pilarski, Carina S Debes Marun, Lorri D Martin, Christopher P Venner, Patrick M Pilarski, Andrew R Belch (2013). B lymphocytes as cancer stem cells in multiple myeloma. The Journal of OncoPathology.

Cite

Sophia Adamia, Patrick M Pilarski, Michal Bar-Natan, Richard M Stone, James D Griffin (2013). Alternative splicing in chronic myeloid leukemia (CML): a novel therapeutic target?. Current cancer drug targets.

Cite

Patrick M Pilarski, Michael R Dawson, Thomas Degris, Jason P Carey, K Ming Chan, Jacqueline S Hebert, Richard S Sutton (2013). Adaptive Artificial Limbs: A Real-time Approach to Prediction and Anticipation. IEEE Robotics and Automation Magazine.

Cite

Sophia Adamia, Patrick M Pilarski, Andrew R Belch, Linda M Pilarski (2013). Aberrant splicing, hyaluronan synthases and intracellular hyaluronan as drivers of oncogenesis and potential drug targets. Current Cancer Drug Targets.

Cite

Linda Pilarski, Carina Debes-Marun, Patrick Pilarski, Christopher Backhouse, Vincent Sieben, Govind Kaigala (2012). Cell Analysis On Microfluidic Chips.

Cite

Ashique Rupam Mahmood, Richard S Sutton, Thomas Degris, Patrick M Pilarski (2012). Tuning-free step-size adaptation. 2012 IEEE international conference on acoustics, speech and signal processing (ICASSP).

Cite

Liping Qi, Martin Ferguson-Pell, Simon Grange, Patrick Pilarski (2012). Pushrim kinetics and coordination patterns of shoulder muscles during surface and incline wheelchair propulsion. 17th International Functional Electrical Stimulation Society Conference 2012 (IFESS).

Cite

K Chettiar, P Pilarski, S Grange, P Smitham, GAVIN JELL, M Loizidou, M Arestu (2012). Nanotechnology & Medical Devices: Risk, Regulation and ‘Meta’Registration.

Cite

Thomas Degris, Patrick M Pilarski, Richard S Sutton (2012). Model-Free Reinforcement Learning with Continuous Action in Practice. 2012 American Control Conference (ACC).

Cite

Patrick M Pilarski, Michael R Dawson, Thomas Degris, Jason P Carey, Richard S Sutton (2012). Dynamic switching and real-time machine learning for improved human control of assistive biomedical robots. 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

Cite

Patrick M Pilarski, Richard S Sutton (2012). Between Instruction and Reward: Human-Prompted Switching. AAAI Fall Symposium on Robots Learning Interactively from Human Teachers.

Cite

Thomas Degris, Patrick M Pilarski, Richard S Sutton (2012). Apprentissage par Renforcement sans Modèle et avec Action Continue. 7èmes Journées Francophones Planification, Décision, et Apprentissage pour la conduite de systèmes (JFPDA 2012).

Cite

Joseph Modayil, Adam White, Patrick M Pilarski, Richard S Sutton (2012). Acquiring a Broad Range of Empirical Knowledge in Real Time by Temporal-Difference Learning. IEEE International Conference on Systems, Man, and Cybernetics.

Cite

Patrick M Pilarski, Michael R Dawson, Thomas Degris, Farbod Fahimi, Jason P Carey, Richard S Sutton (2011). Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning. 2011 IEEE international Conference on Rehabilitation Robotics (ICORR).

Cite

Richard S Sutton, Joseph Modayil, Michael Delp, Thomas Degris, Patrick M Pilarski, Adam White, Doina Precup (2011). Horde: a scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction. 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS).

Cite

Patrick M Pilarski, Christopher J Backhouse (2010). Towards robust cellular image classification: theoretical foundations for wide-angle scattering pattern analysis. Biomedical Optics Express.

Cite

Joseph Modayil, Patrick M Pilarski, Adam White, Thomas Degris, Richard S Sutton (2010). Off-Policy Knowledge Maintenance for Robots. Robotics: Science and Systems Workshop — Towards Closing the Loop: Active Learning for Robotics.

Cite

Linda M Pilarski, Patrick M Pilarski, Andrew R Belch (2010). Multiple myeloma may include microvessel endothelial cells of malignant origin. Leukemia & lymphoma.

Cite

Sophia Adamia, Patrick M Pilarski, Andrew R Belch, Linda M Pilarski (2009). Genetic Abnormalities in Waldenström's Macroglobulinemia. Clinical Lymphoma and Myeloma.

Cite

Patrick M Pilarski, Xuan-Tao Su, D Moira Glerum, Christopher J Backhouse (2009). Computational analysis of mitochondrial placement and aggregation effects on wide-angle cell scattering patterns. Biomedical Applications of Light Scattering III.

Cite

Patrick M Pilarski, Xuan-Tao Su, D Moira Glerum, Christopher J Backhouse (2008). Rapid simulation of wide-angle scattering from mitochondria in single cells. Optics express.

Cite

Linda M Pilarski, Eva Baigorri, Michael J Mant, Patrick M Pilarski, Penelope Adamson, Heddy Zola, Andrew R Belch (2008). Multiple myeloma includes phenotypically defined subsets of clonotypic CD20+ B cells that persist during treatment with rituximab. Clinical Medicine. Oncology.

Cite

Sophia Adamia, Amanda a Reichert, Hemalatha Kuppusamy, Jitra Kriangkum, Anirban Ghosh, Jennifer J Hodges, Patrick M Pilarski, Steven P Treon, Michael J Mant, Tony Reiman, Others (2008). Inherited and acquired variations in the hyaluronan synthase 1 (HAS1) gene may contribute to disease progression in multiple myeloma and Waldenstrom macroglobulinemia. Blood.

Cite

Sophia Adamia, Amanda Reichert, Anirban Ghosh, Jennifer Hodges, Patrick Pilarski, Steven Treon, Michael J Mant, Tony Reiman, Andrew R Belch, Linda M Pilarski (2007). Gerraline and somatic mutations in the hyaluronan synthase-1 (HAS1) gene may contribute to oncogenesis in multiple myeloma (MM) and Waldenstrom's macroglobulinemia (WM). BLOOD.

Cite

S Adamia, A Reichert, A Ghosh, J Hodges, P Pilarski, S Treon, MJ Mant, T Reiman, AR Belch, LM Pilarski (2007). Germline and Somatic Mutations in the Hyaluronan Synthase-1 (HAS1) Gene May Contribute to Oncogenesis in Multiple Myeloma (MM) and Waldenstrom's Macroglobulinemia (WM). Blood.

Cite

VJ Sieben, CS Debes Marun, PM Pilarski, GV Kaigala, LM Pilarski, CJ Backhouse (2007). FISH and chips: chromosomal analysis on microfluidic platforms. IET nanobiotechnology.

Cite

PM Pilarski, VJ Sieben, C Debes Marun, CJ Backhouse (2007). Computer vision for fish screening in myeloma. HAEMATOLOGICA-THE HEMATOLOGY JOURNAL.

Cite

A Ranjit Prakash, S Adamia, V Sieben, P Pilarski, LM Pilarski, CJ Backhouse (2006). Small volume PCR in PDMS biochips with integrated fluid control and vapour barrier. Sensors and Actuators B: Chemical.

Cite

Carina S Debes Marun, Vincent Sieben, Patrick M Pilarski, Tony Reiman, Andrew R Belch, Christopher J Backhouse, Linda M Pilarski (2006). FISH and Chips: Novel, Point of Care Technology To Detect Chromosomal Abnormalities.. Blood.

Cite

Sophia Adamia, Jennifer Hodges, Patrick M Pilarski, Steven Treon, Michael J Mant, Tony Reiman, Andrew R Belch, Linda M Pilarski (2006). Accumulation of Inherited and Acquired Mutations in Hyaluronan Synthase1 Gene May Contribute Oncogenesis in Multiple Myeloma and Waldenstrom's Macroglobulinemia.. Blood.

Cite

Patrick M Pilarski, Christopher J Backhouse (2006). A method for cytometric image parameterization. Optics Express.

Cite

LM Pilarski, S Adamia, CA Maxwell, PM Pilarski, T Reiman, AR Belch (2005). Hyaluronan synthases and RHAMM as synergistic mediators of malignancy in B lineage cancers. Hyaluronan: Structure, Metabolism, Biological Activities, Therapeutic Applications.

Cite

Patrick M Pilarski, Sophia Adamia, Christopher J Backhouse (2005). An adaptable microvalving system for on-chip polymerase chain reactions. Journal of Immunological Methods.

Cite

Tanya Mirzayans, Nitin Parimi, Patrick Pilarski, Chris Backhouse, Loren Wyard-Scott, Petr Musilek (2005). A swarm-based system for object recognition. Neural Network World.

Cite

Linda M Pilarski, Tony Reiman, Patrick M Pilarski, F William Orr, Andrew R Belch (2004). The malignant hierarchy in multiple myeloma: Relationships between malignant cells and bone disease. Bone Metastasis and Molecular Mechanisms: Pathophysiology.

Cite

Linda M Pilarski, Sophia Adamia, Patrick M Pilarski, Ranjit Prakash, Jana Lauzon, Christopher J Backhouse (2004). Improved diagnosis and monitoring of cancer using portable microfluidics platforms. 2004 International Conference on MEMS, NANO and Smart Systems (ICMENS'04).

Cite

S Adamia, PM Pilarski, R Prakash, J Lauzon, CJ Backhouse, LM Pilarski (2003). Microsystems and cancer: Improved detection of disease related genes in myeloma patients using microfluidics platforms.. Blood.

Cite