年份 | 2018 |
学科 | 机器人与智能机器 ROBOTICS AND INTELLIGENT MACHINES |
国家/州 | TX, United States of America |
Looking through Walls with Artificial Intelligence: An Innovative Solution for Real-Time Retrieval of the Human Figure behind Visual Obstruction
Overcoming the visual barrier and developing “see-through vision” has been one of mankind’s long-standing dreams. Unlike visible light, Radio Frequency (RF) signals penetrate opaque obstructions and reflect highly off humans. This project created a breakthrough artificial intelligence model that can be trained to reconstruct continuous video of a 15-point human skeleton even through visual occlusion using RF signals. The AI training process adopted a student/teacher learning procedure inspired by the Feynman Technique for Learning. Video frames and RF data were first collected simultaneously using a co-located setup containing an optical camera and an RF antenna array transceiver. Next, the video frames were processed with a computer-vision-based gait analysis “teacher” module to generate ground-truth human skeletons for each frame. Then, the same type of skeleton was predicted from corresponding RF data using a “student” deep-learning model consisting of a Residual Convolutional Neural Network (CNN), Region Proposal Network (RPN), and Recurrent Neural Network with Long-Short Term Memory (RNN-LSTM) that 1) extracted spatial features from RF images, 2) detected all people present in a scene, and 3) aggregated information over multiple time-steps, respectively. After reducing error between teacher-provided ground-truths and student-created predictions over thousands of training iterations, the model was shown to be capable of accurately and completely predicting the pose of any human behind visual obstruction solely using RF signals. Primary academic contributions include the novel many-to-many imaging methodology, unique RPN/RNN-LSTM integration, newly proposed objective function, and original training pipeline. A simulator was also created.
高中生科研 英特尔 Intel ISEF
资讯 · 课程 · 全程指导
请扫码添加微信好友
英特尔国际科学与工程大奖赛,简称 "ISEF",由美国 Society for Science and the Public(科学和公共服务协会)主办,英特尔公司冠名赞助,是全球规模最大、等级最高的中学生的科研科创赛事。ISEF 的学术活动学科包括了所有数学、自然科学、工程的全部领域和部分社会科学。ISEF 素有全球青少年科学学术活动的“世界杯”之美誉,旨在鼓励学生团队协作,开拓创新,长期专一深入地研究自己感兴趣的课题。
>>> 实用链接汇总 <<<
· 数学 · 物理 · 化学 · 生物 · 计算机 · 工程 ·
Studies in which the use of machine intelligence is paramount to reducing the reliance on human intervention.
Biomechanics (BIE): Studies and apparatus which mimic the role of mechanics in biological systems.
Cognitive Systems (COG): Studies/apparatus that operate similarly to the ways humans think and process information. Systems that provide for increased interaction of people and machines to more naturally extend and magnify human expertise, activity, and cognition.
Control Theory (CON): Studies that explore the behavior of dynamical systems with inputs, and how their behavior is modified by feedback. This includes new theoretical results and the applications of new and established control methods, system modelling, identification and simulation, the analysis and design of control systems (including computer-aided design), and practical implementation.
Machine Learning (MAC): Construction and/or study of algorithms that can learn from data.
Robot Kinematics (KIN): The study of movement in robotic systems.
Other (OTH): Studies that cannot be assigned to one of the above subcategories. If the project involves multiple subcategories, the principal subcategory should be chosen instead of Other.
© 2024. All Rights Reserved. 沪ICP备2023009024号-1