0% found this document useful (0 votes)
5 views

Manual

The JavPlayer Manual provides instructions for installing, using, and uninstalling the JavPlayer software, which allows users to play and process videos, including VR content. Key features include recording, capturing, and processing videos with various settings, as well as integration with external tools like TecoGAN and DeepCreamPy for enhanced video quality. Users are advised against distributing videos created with JavPlayer without permission from the copyright holder.

Uploaded by

hugoemcha63
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
5 views

Manual

The JavPlayer Manual provides instructions for installing, using, and uninstalling the JavPlayer software, which allows users to play and process videos, including VR content. Key features include recording, capturing, and processing videos with various settings, as well as integration with external tools like TecoGAN and DeepCreamPy for enhanced video quality. Users are advised against distributing videos created with JavPlayer without permission from the copyright holder.

Uploaded by

hugoemcha63
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 15

JavPlayer Manual Ver.1.

02

Please do not sell, distribute or publish videos created using JavPlayer without
the permission of the copyright holder.

Install
Extract zip to a location that does not contain double-byte characters in the full path and execute
JavPlayer.exe.

Uninstall
Delete the extracted folder.
If you delete JavPlayer.sdj, user settings can not be able to restore.

Data Save
The content of the setting panel is auto-saved to "JavPlayer/JavPlayer.sdj".
Save will be executed when start playback or quit the application.
*In the case of capture, it is saved for each target application, not for each video.

Terms
Cell The rectangles that make up the mosaic.
2D-mode Normal video playback mode. VR video is also played back in 2D mode at the beginning.
3D-mode This mode is for rendering VR videos. You can change the orientation of the camera.
VR-mode This is a mode to watch VR videos using goggles.
Equirectangular A conversion format for projecting VR images on a sphere.
ProcessingSettings Parameters for mosaic reduction processing. Adjust to enhance the effect.
Marker Dividers placed on the seek bar to switch processing settings.
Swipe Operation to slide the mouse while pressing the left button.
MosaicReduction Non-AI super resolution processing by JavPlayer.
Decensoring AI super resolution processing by external tool.
Basic Operation

① Record movies during playback or capture.


② Capture the screen of the DMM player etc in real time.
③ Open the file browser.
④ Execute the decensoring process. You need to install DeepCreamPy in advance.
⑤ Switch the VR mode. You need to select the division pattern in the 3D-View settings panel in advance.
⑥ Open the Key Assignment panel.
⑦ Open the Environment Settings panel.
⑧ Open the 3D-View Settings panel.
⑨ Open the Screen Settings panel.
⑩ Open the Color Correction panel.
⑪ Open the Processing Settings panel.
⑫ Pause / Resume *Same as double-click the screen
⑬ Move the handle and seek.*Horizontal swipe allowed
⑭ Move the handle and adjust volume. *Mouse wheel allowed

Drag and drop the movie file to the window of this application and play it.
The window size will be adjusted automatically according to the movie.
You can also display still images (jpg, png).

If you press the Esc key while in the VR mode, file browser or key assignment, the original screen will be
restored.
Toolbar

It is displayed above the seek bar only when the 'toolbar' is ON in the environment settings panel.
It includes buttons related to screenshot, loop(record) range, play speed, marker editing, etc.
You can assign keys to all functions.

Range specification

If you set the range with the toolbar buttons or the keyboard, only that part will be played repeatedly.
If only the start point is specified, the end of the movie will be the end point.
If only the end point is specified, the beginning of the movie will be the start point.
It returns to the start point at the moment past the end point, but before the start point it plays normally.
Loop is not executed during pause.
It is also used to specify the range to record.
File Browser

Double-click the file to start playback


The folder of the played video will be added to the left folder link. *up to 8

Opening and closing with shortcut keys (default: F key) is convenient when using a file browser frequently.

Sequential Playback
Video switching (default: F7 key, F8 key) is a function to play videos in the same folder continuously.
Intended to be used while wearing goggles in VR mode, but it can also be used for still images (png, jpg).
You can also load the last file after rebooting.

If you drag and drop multiple videos together, they will be treated as a video group.
The target of video switching is limited to files in a group and can be used as a simple playlist.
Dropping a single file or loading from the file browser will ungroup it.
Key Assignment

You can assign up to 2 keys or buttons for each function.


The default is to use a combination of keyboard(101) and pad(Xbox360).
Please change according to your environment.

Skipping will be executed continuously if you keep pressing.


It will be canceled if the start (end) of the range is set continuously at the same position.
Pressing the start and end setting keys simultaneously cancels both.
Process cancellation is a function to check the original mosaic, and it wScreenshots will be stored in
"JavPlayer/ScreenShot/*_ XXX.png".

When you reset the camera, the goggle wearer's gaze direction will be in the front.
If it is executed only once, it will be reset to the horizontal state.
It will be reset in an inclined state if it is executed twice in a row (if it is facing down, the bottom is front).
Holding down the Shift key while zooming will change the camera's altitude.
Skip(Move playback point) will be executed continuously if you press and hold.
Capturing

Please start the target application and press the capture button.
The default target is DMM, DUGA, MGS, VLC player.
To capture other applications, please select in the list.

In order to improve image quality, bring the window size of the target closer to the movie.
It automatically retries even if the target window is lost by minimizing or resizing.
Capture is ended by pressing the stop button or start playing a movie.
*DMM Movie Player (UWP ver.) is not able to be captured.

In Windows 7, the capture function does not work properly.


If you can not capture, please discontinue use.

VR-Mode
You can switch to VR mode only if you have selected a split pattern in the view settings.
Even when wearing goggles, you can switch to VR mode by executing reset (default: R key, pad button 7).

It is necessary to install SteamVR and connect the corresponding goggles.


Not only OculusRift and HTC-Vive but also OculusGo etc. connected to a PC can be used.
The operation test was performed with a smartphone and its goggle.
The software used is RiftCat2.0 (Windows) and VRidge2.0 (Android).

3D GUI is not implemented yet.


It is inconvenient without the game pad, but no problem.

There are various forms of VR video mosaics, and some of them can not be reduced at all.
It will not be a problem if the mosaic always looks like a square when playing in 2D mode of JavPlayer or a
usual video player.
The image deformation process by the switch on the upper right of the processing setting panel is
effective for some videos.
Environment Settings

① If you set it to 30 fps, capture delay will increase.


90 is for Oculus Rift and HTC Vive
② Even if you turn off the toolbar, you can do all the operations with the keyboard shortcut.

Screen Settings

① If the video contains a black border, press the measurement button and then press the apply button.
If you measure on a bright screen the correct value will be set usually.
If the capture target contains a non-black frame such as a status bar, you need to input manually.
② Select the aspect ratio of the screen.
While playing VR video in 2D mode, this setting will be ignored.
Color Settings

① You can adjust the brightness of the screen when you move R,G,B while holding down the Shift key.
If you leave the parameters on this panel as default, load will be slightly reduced.

3D-View Settings

① This setting is for detecting distorted or tilted mosaics. Normally set to 0.


When it is set to 1 or more, the slider for range setting (for upper and lower) is displayed.
② When VR video is loaded, it will be TopBottom or SideBySide.
If the automatic judgment is incorrect or if it is a fisheye type, set it manually.
Specifying a division disables mosaic reduction in 2D mode.
③ Set the zoom factor. The standard viewing angle follows the goggles.
④ If you switch to 3D mode, camera orientation can be controlled with the right drag (default key assign).
Please make mosaic processing settings in 3D mode about VR videos.
The panel can not be opened in 3D incompatible state such as capturing or still image display.
Processing Settings

It is usually applied to the whole video.


If you divide the section with the marker (described later), you can set multiple and switch at any timing.
① Parts close to the specified color will be protected from processing.
It is effective in case of the lattice pattern of the white window is misjudged as mosaic.
Do not specify skin color, brown, black, etc.
② The part that looks like stripes will not be processed.
Not only the background but also some mosaics may be excluded.
③ Perform mosaic judgment in high resolution.
It is effective for fine mosaic videos and VR videos, but processing load will increase significantly.
The button does not appear for low resolution videos below HD.
④ Deform the entire equi-rectangler image to detect the mosaic.
Not necessary if the mosaic looks rectangular in 2D mode.
The button is displayed only in TopBottom or SideBySide (non fisheye) videos.
⑤ The selected picture quality is reflected in the automatic adjustment of sensitivity and accuracy.
If the mosaic is not processed and remains, try reducing the value.
Normally 0 (automatic adjustment OFF) is not used.
⑥ Setting a large value makes it easier to identify fine mosaics, but increase false positives.
It can be set only when the automatic adjustment is OFF.
⑦ Smaller values make it easier to identify blurred mosaics, but increase false positives.
It can be set only when the automatic adjustment is OFF.
⑧ Adjust the intensity of the paint filter.
Although it can reduce the mosaic without blurring, there is a problem that distortion occurs.
While recording in TG mode, this setting is ignored and maximum.
⑨ Adjust application rate of super resolution filter.
The higher the value, the sharper the image, but the vibration of the processed part increases.
While recording in TG mode, this setting is ignored and maximum.
⑩ Set the cell size of mosaic.
Normally the auto is set, but manual is effective only in the section where automatic judgment fails.
Processing Settings by section
Normally processing settings are applied to the whole movie, but you can also create sections by placing
markers.
・To reduce misidentification of the mosaic area, set the accuracy for each scene.
・Manually designate only the part where the mosaic roughness can not be measured correctly.
Setting the details as above will give you more effect.
*To see the result of automatic measurement about roughness of mosaic, turn on Disp infos in
environment settings.

Move the slider handle to the position you wish to divide and then press the Add Marker button on the
toolbar or the shortcut key ('A' by default) to create a section.

Move the slider handle to section 2 and change the parameter.

If you copy('C') in section1 and paste('V) to section3, only section2 will be set differently.
Preparation for Recording
The addition of audio requires FFmpeg unless the record setting is 'Fast-Normal'.
https://ffmpeg.zeranoe.com/builds/
Please install in advance and add the path of the bin folder to environment variable.
You can use it even if ffmpeg.exe is placed in the same folder as JavPlayer.exe.

Preparation for Capture Recording


You need a stereo mixer to record while capturing.
For Windows 10, right click on the speaker icon in the task tray and select the sound and set it.

Since the volume of the speaker output is reflected in the recording level, it is necessary to record with the
volume increased.
As it seems that the stereo mixer may become invalid while using the headphones, please deal with it
according to your environment.

Check for preparation

You can check whether ffmpeg and stereo mixer can be used by pressing this button immediately after
startup.
Recording

Recording is impossible on Windows7 because the installed encoder does not support Windows7!
Normally, only the set range is recorded, but if not set, the whole movie is recorded.
If you do not enter Width, the recording size will be the same as the original movie.
When the recording mode is Fast (real time), frame dropping may occur depending on the performance of
the PC and the area of the video.
When the recording mode is Slow (frame advance), it takes several times longer, but frame dropping does
not occur.
Normally audio data will be extracted and combined by FFmpeg after silent recording.
You need to install TecoGAN (described later) to use recording modes other than 'Normal'.
The output destination is "JavPlayer/Movie/OriginalName _XXX.mp4".
*During recording, the frame rate is changed regardless of usersetting.

Capture Recording
Because it can not advance frame by single step to be captured, it is restricted to Fast only.
Because it can not wait for the execution of the external program, it is restricted to Normal only.

Since you can not set the range, you need to manually press the end button.
Both capture and recording are high load, so frame dropping tends to occur more than usual.
It is better to reduce the target window or output resolution (the value of Width).

Streaming
Copy the URL of a playable video and paste it into JavPlayer (default is 'P') then streaming will start.
Please note that there is no function to extract the movie embedded in the web page and URL of the
video is necessary.
Videos of streaming sites prohibiting playback by external players can not be played.

Stream Recording
It can be executed by the same procedure as ordinary recording, but frame loss increases in Fast mode
and it takes a huge time in Slow mode.
It is recommended to record after downloading.
TecoGAN
It is a video super-resolution algorithm under development by MengyuChu, YouXie, LauraLeal-Taixe, and
NilsThuerey.
https://github.com/thunil/TecoGAN
You need a CPU (SandyBridge or later) that can use the AVX instruction set for execution.
You need Windows10 (64bit) or Windows8 (64bit) for execution.

You can expect much better results than JavPlayer's super-resolution if mosaics have less flicker.
However, due to the very high load, you need to create videos in advance.

The procedure to use is as follows.


1) Download TecoGAN for Windows.
https://drive.google.com/uc?id=1eLTQLi9cB1cD0lJK88H5_822L5o2UKnd&export=download
2) Unzip and copy tgmain.exe and the model folder into “JavPlayer/TG/”.
3) Play video on JavPlayer and change the recording mode from 'Normal' to 'TG01'.
4) Set the speed to Slow and start recording.

After installation, contents will look like this.

If your PC is equipped with a CUDA compatible GPU and 2G or more VRAM, I recommend GPU version
several times faster.
https://drive.google.com/uc?id=1ZDCbjW5eefKFg3BFBu58bLx9S5wUti_k&export=download
Since tgmain-cuda.exe is used in preference to tgmain.exe, there is no problem if both exist.
You also need to install CUDA in advance.
https://developer.nvidia.com/cuda-downloads

Even if you use the GPU version, the processing (png extraction, encoding, etc.) that JavPlayer is
responsible for will not become fast.
To make this part faster, change the speed setting from Slow to Fast.
Occasionally there is a delay in the progress of the frame, but with enough PC processing power it is no
problem.
I confirmed that it has a great effect on videos that are unsuitable for frame-by-frame advance (mainly
wmv and mkv).
Normally, if you do not specify the range will be recorded until the end, but in TG mode will be recorded
only 5 seconds.
You can create a video of any length by setting the range.

Selecting 'TG01+AF' as the recording mode enables the flicker reduction filter.
Use it only for videos that have a strong flickering mosaic as it will blur the processed part.

JavPlayer has 'Super-resolution for still images to double size' for real-time processing.
In TG mode, this is replaced with 'Super-resolution for videos to quadruple size' of the external program.
Parts other than super resolution (measurement of the area and roughness of the mosaic, composition of
the processed image, etc.) are shared.
If mosaic can not be reduce in normal playback, mosaic can not be removed even in TG mode recording.
Please give up if the mosaic remains even if you change the processing settings.

Recording in TG-mode can not be performed under the following conditions.


– Capturing
– During VR video playback
– During still image display

In the current version, a watermark is displayed on the screen to prevent fraud.


When decensoring using AI becomes well known, it may be removed.

Collaboration with TecoGAN is in testing phase.


Executable files and models may be updated separately from JavPlayer.
Check @Javski2 on Twitter.
DeepCreamPy
Remove the mosaic by an external program called DeepCreamPy.
DeepCreamPy is a color illustration complement tool under development by deeppomf.
https://github.com/deeppomf/DeepCreamPy
https://github.com/deeppomf/DeepCreamPy/blob/master/docs/INSTALLATION_BINARY.md
*It is only for 64bit windows

I do not recommend it at this point because you can not get good results.
Decensoring process is done by DeepCreamPy, JavPlayer just prepares and displays the image.

The procedure to use is as follows.


1) Install Visual C++ Redistributable for Visual Studio 2015 Update 3 if necessary.
2) Download the windows binary.
3) Unzip and copy decensor.exe and models folder into “JavPlayer/DCP/”.
4) Play the video with JavPlayer and press the desensoring button at the top of the screen.

After installation, DCP folder will look like below.

When the button is focused, the target area for decensoring will be filled with green.
If it is not covered enough, increase the area parameter in processing settings and then execute.

It takes more than 10 seconds to complete after pressing the button.


After completion, please try to change the application rate by vertical swipe.
Cancel the mosaic reduction process if you wish to compare with the original condition.
When the screen is redrawn by resuming or seeking, the display is ended.

You might also like