A tensorflow implementation of VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera.
For the caffe model/weights required in the repository: please contact the author of the paper.
#### Install python dependencies: ``` pip3 install -r requirements.txt --user ``` #### Install caffe dependencies ``` sudo dnf install protobuf-devel leveldb-devel snappy-devel opencv-devel boost-devel hdf5-devel glog-devel gflags-devel lmdb-devel atlas-devel python-lxml boost-python3-devel ``` #### Setup Caffe ``` git clone https://github.com/BVLC/caffe.git cd caffe ``` #### Configure Makefile.config (Include python3 and fix path) #### Build Caffe ``` sudo make all sudo make runtest sudo make pycaffe sudo make distribute sudo cp .build_release/lib/ /usr/lib64 sudo cp -a distribute/python/caffe/ /usr/lib/python3.7/site-packages/ ```
models/caffe_model
.init_weights.py
to generate tensorflow model.run_estimator.py
is a script for video stream.run_estimator_ps.py
is a multiprocessing version script. When 3d plotting function shuts down in run_estimator.py
mentioned above, you can try this one.run_pic.py
is a script for picture.benchmark.py
is a class implementation containing all the elements needed to run the model.run_estimator_robot.py
additionally provides ROS network and/or serial connection for communication in robot controlling.train.py
is not complete yet (I failed to reconstruct the model: ( So do not use it. Also pulling requests are welcomed.[Tips] To run the scripts for video stream:
click left mouse button to initialize the bounding box implemented by a simple HOG method;
trigger any keyboard input to exit while running.
run_estimator.py
shuts down. Use run_estimator_ps.py
instead.materials/joint_index.xlsx
):
For MPI-INF-3DHP dataset, refer to my another repository.