Animator Tutorial - Revision history

Facegood: /* FAQ */

2024-12-17T08:49:42Z

FAQ

← Older revision		Revision as of 08:49, 17 December 2024
Line 351:		Line 351:
	=== FAQ ===		=== FAQ ===

	===== ~~'''~~Animation Jitter~~'''~~ =====		===== Animation Jitter =====
	If abnormal mouth jitter occurs in the calculated facial animation, please follow the following settings to reduce the impact of depth information on facial animation.		If abnormal mouth jitter occurs in the calculated facial animation, please follow the following settings to reduce the impact of depth information on facial animation.

Line 360:		Line 360:
	[[File:Animation Jitter2.png\|center\|frameless\|1280x1280px]]		[[File:Animation Jitter2.png\|center\|frameless\|1280x1280px]]

	===== ~~'''~~Is it possible to record videos in other software?~~'''~~ =====		===== Is it possible to record videos in other software? =====
	Livedrive Android can also perform dual-camera video recording.		Livedrive Android can also perform dual-camera video recording.

	===== ~~'''~~When processing identity data, an error occurred due to inconsistent video frame rates.~~'''~~ =====		===== When processing identity data, an error occurred due to inconsistent video frame rates. =====
	The reason is that when using Livedrive Android for recording, there is a slight decimal deviation between two videos, such as one being 60.25fps and the other 60.03fps.		The reason is that when using Livedrive Android for recording, there is a slight decimal deviation between two videos, such as one being 60.25fps and the other 60.03fps.

	The solution：In the mh_ingest_convert.py script, there is a calibration process for the frame rates of the two videos. You can comment out these two lines to complete the subsequent tasks without any issues.		The solution：In the mh_ingest_convert.py script, there is a calibration process for the frame rates of the two videos. You can comment out these two lines to complete the subsequent tasks without any issues.

	===== ~~'''~~If you find that the depth information in Unreal Engine is too poor~~'''~~ =====		===== If you find that the depth information in Unreal Engine is too poor =====
	It is likely due to the calibration video not being produced properly. I suggest remaking the calibration video.		It is likely due to the calibration video not being produced properly. I suggest remaking the calibration video.

Facegood: /* FAQ */

2024-12-17T08:49:10Z

FAQ

← Older revision		Revision as of 08:49, 17 December 2024
Line 351:		Line 351:
	=== FAQ ===		=== FAQ ===

	* '''Animation Jitter'''		===== '''Animation Jitter''' =====

	If abnormal mouth jitter occurs in the calculated facial animation, please follow the following settings to reduce the impact of depth information on facial animation.		If abnormal mouth jitter occurs in the calculated facial animation, please follow the following settings to reduce the impact of depth information on facial animation.

Line 360:		Line 359:
	[[File:Animation Jitter1.png\|center\|frameless\|2560x2560px]]		[[File:Animation Jitter1.png\|center\|frameless\|2560x2560px]]
	[[File:Animation Jitter2.png\|center\|frameless\|1280x1280px]]		[[File:Animation Jitter2.png\|center\|frameless\|1280x1280px]]
	* '''Is it possible to record videos in other software?'''

			===== '''Is it possible to record videos in other software?''' =====
	Livedrive Android can also perform dual-camera video recording.		Livedrive Android can also perform dual-camera video recording.

	* '''When processing identity data, an error occurred due to inconsistent video frame rates.'''		===== '''When processing identity data, an error occurred due to inconsistent video frame rates.''' =====

	The reason is that when using Livedrive Android for recording, there is a slight decimal deviation between two videos, such as one being 60.25fps and the other 60.03fps.		The reason is that when using Livedrive Android for recording, there is a slight decimal deviation between two videos, such as one being 60.25fps and the other 60.03fps.

	The solution：In the mh_ingest_convert.py script, there is a calibration process for the frame rates of the two videos. You can comment out these two lines to complete the subsequent tasks without any issues.		The solution：In the mh_ingest_convert.py script, there is a calibration process for the frame rates of the two videos. You can comment out these two lines to complete the subsequent tasks without any issues.

	* '''If you find that the depth information in Unreal Engine is too poor'''		===== '''If you find that the depth information in Unreal Engine is too poor''' =====

	It is likely due to the calibration video not being produced properly. I suggest remaking the calibration video.		It is likely due to the calibration video not being produced properly. I suggest remaking the calibration video.

Facegood: /* FAQ */

2024-08-14T08:26:12Z

FAQ

← Older revision		Revision as of 08:26, 14 August 2024
Line 358:		Line 358:
	# Check Depth 'Map Influence option' and change the tab to 'None'		# Check Depth 'Map Influence option' and change the tab to 'None'
	# Recalculate animator performance animation		# Recalculate animator performance animation
			[[File:Animation Jitter1.png\|center\|frameless\|2560x2560px]]
			[[File:Animation Jitter2.png\|center\|frameless\|1280x1280px]]
	* '''Is it possible to record videos in other software?'''		* '''Is it possible to record videos in other software?'''

Facegood: /* Video Tutorial */

2024-08-14T07:45:36Z

Video Tutorial

← Older revision		Revision as of 07:45, 14 August 2024
Line 18:		Line 18:
	# https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/stereo-camera-calibration-and-tools		# https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/stereo-camera-calibration-and-tools

	==== Video Tutorial ====		=== Video Tutorial ===
	<youtube width="960" height="540">_b2CGFdKVic</youtube>		<youtube width="960" height="540">_b2CGFdKVic</youtube>

Facegood: /* Video Tutorial */

2024-08-14T07:45:21Z

Video Tutorial

← Older revision		Revision as of 07:45, 14 August 2024
Line 19:		Line 19:

	==== Video Tutorial ====		==== Video Tutorial ====
	<youtube width="960" height="540">~~t6Qgsm5PQwU~~</youtube>		<youtube width="960" height="540">_b2CGFdKVic</youtube>

	=== Set up Python and your system environment ===		=== Set up Python and your system environment ===

Facegood at 07:45, 14 August 2024

2024-08-14T07:45:06Z

← Older revision		Revision as of 07:45, 14 August 2024
Line 17:		Line 17:
	# https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/capture-guidelines#usingastereoheadmount		# https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/capture-guidelines#usingastereoheadmount
	# https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/stereo-camera-calibration-and-tools		# https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/stereo-camera-calibration-and-tools

			==== Video Tutorial ====
			<youtube width="960" height="540">t6Qgsm5PQwU</youtube>

	=== Set up Python and your system environment ===		=== Set up Python and your system environment ===

Facegood: /* Process the Calibration data (converting the footage to image sequences) */

2024-08-14T07:43:15Z

Process the Calibration data (converting the footage to image sequences)

← Older revision		Revision as of 07:43, 14 August 2024
Line 131:		Line 131:

	'''<u>Otherwise, you will get this error. Pick any format from 'png_gray', 'png_rgb24', 'jpg_copy', 'jpg_lossy'</u>'''		'''<u>Otherwise, you will get this error. Pick any format from 'png_gray', 'png_rgb24', 'jpg_copy', 'jpg_lossy'</u>'''
			[[File:Python code1.png\|center\|frameless\|1883x1883px]]

	==== Process the Identity data (converting the footage to image sequences) ====		==== Process the Identity data (converting the footage to image sequences) ====
Line 236:		Line 237:
	==== Examine the calibration quality ====		==== Examine the calibration quality ====
	During the calibration process, check the output command line. If the '''mse value''' exceeds 1, it indicates that the calibration quality is low.		During the calibration process, check the output command line. If the '''mse value''' exceeds 1, it indicates that the calibration quality is low.
			[[File:Python code2.png\|center\|frameless\|1220x1220px]]

	=== Ingest Structure ===		=== Ingest Structure ===

Facegood: /* Install Python Dependencies */

2024-08-14T07:40:43Z

Install Python Dependencies

← Older revision		Revision as of 07:40, 14 August 2024
Line 42:		Line 42:

	* And then type "pip install -r requirements.txt" to install the python environment.		* And then type "pip install -r requirements.txt" to install the python environment.
			[[File:Python env.png\|center\|frameless\|1092x1092px]]

	=== Capturing ===		=== Capturing ===
Line 47:		Line 48:
	==== Capture Guidelines ====		==== Capture Guidelines ====
	Capture Guidelines include details on camera settings, lighting conditions, framing, and other technical aspects necessary to achieve the desired quality and consistency in the captured footage. Following capture guidelines ensures that the footage meets the required standards for further processing and production.		Capture Guidelines include details on camera settings, lighting conditions, framing, and other technical aspects necessary to achieve the desired quality and consistency in the captured footage. Following capture guidelines ensures that the footage meets the required standards for further processing and production.
			[[File:Capture Guidelines1.png\|center\|frameless\|1121x1121px]]
			[[File:Capture Guidelines2.png\|center\|frameless\|1250x1250px]]

	* Specific calibration footage should be taken at the start and the end of a capture session to bookend the shoot.		* Specific calibration footage should be taken at the start and the end of a capture session to bookend the shoot.
Line 55:		Line 58:

	<u>Hold the head of the helmet with your left hand, hold the calibration plate on your forehead, and move within the '''performer's face''' area.</u>		<u>Hold the head of the helmet with your left hand, hold the calibration plate on your forehead, and move within the '''performer's face''' area.</u>
			[[File:Capture Guidelines3.png\|center\|frameless\|1248x1248px]]

	=== Data Processing ===		=== Data Processing ===

Facegood: /* EPIC Reference Tutorial */

2024-08-14T07:21:11Z

EPIC Reference Tutorial

← Older revision		Revision as of 07:21, 14 August 2024
Line 11:		Line 11:
	You can also access those tutorials to have better knowledge of the whole pipeline.		You can also access those tutorials to have better knowledge of the whole pipeline.

	# ~~<nowiki>~~https://www.youtube.com/watch?v=qPhn28Jk3Mo~~</nowiki>~~		# https://www.youtube.com/watch?v=qPhn28Jk3Mo
	# ~~<nowiki>~~https://www.youtube.com/watch?v=d3k9rfA9xjs~~</nowiki>~~		# https://www.youtube.com/watch?v=d3k9rfA9xjs
	# ~~<nowiki>~~https://www.youtube.com/watch?v=-2DH4nX7wT8~~</nowiki>~~		# https://www.youtube.com/watch?v=-2DH4nX7wT8
	# ~~<nowiki>~~https://www.youtube.com/watch?v=Nkb4DEoZ_NY~~</nowiki>~~		# https://www.youtube.com/watch?v=Nkb4DEoZ_NY
	# ~~<nowiki>~~https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/capture-guidelines#usingastereoheadmount~~</nowiki>~~		# https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/capture-guidelines#usingastereoheadmount
	# ~~<nowiki>~~https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/stereo-camera-calibration-and-tools~~</nowiki>~~		# https://dev.epicgames.com/documentation/en-us/metahuman/metahuman-for-unreal-engine/stereo-camera-calibration-and-tools

	=== Set up Python and your system environment ===		=== Set up Python and your system environment ===

Facegood at 07:20, 14 August 2024

2024-08-14T07:20:26Z

Show changes