HTML5: Use Canvas to process Video in real time
Document content
The XHTML document used in this article is as follows.
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<style>
body {
background: black;
color:#CCCCCC;
}
#c2 {
background-image: url(foo.png);
background-repeat: no-repeat;
}
p {
float: left;
border :1px solid #444444;
padding:10px;
margin: 10px;
background:#3B3B3B;
}
</style>
<script type="text/javascript;version=1.8" src="main.js"></script>
</head>
<body onload="processor.doLoad()">
<p>
<video id="video" src="video.ogv" controls="true"/>
</p>
<p>
<canvas id="c1" width="160" height="96"/>
<canvas id="c2" width="160" height="96"/>
</p>
</body>
</html>The key parts of the above code are as follows:
1. Create two canvas elements with IDs c1 and c2 respectively. c1 is used to display the original video of the current frame, c2 is used to display the video after performing chroma-keying special effects; c2 is preloaded with a static image, which will be used to replace the background color part of the video.
2. The JavaScript code is imported from the main.js file; this script uses the features of JavaScript 1.8, so when importing the script, the version is specified in line 22.
3. When the web page is loaded, the processor.doLoad() method in main.js will run.
JavaScript code
The JS code in main.js contains three methods.
Initialize chroma-key
The doLoad() method is called when the XHTML document is initially loaded. The purpose of this method is to prepare the required variables for the chroma-key processing code and set up an event listener so that we can detect when the user starts playing the video.
doLoad: function() {
this.video = document.getElementById("video");
this.c1 = document.getElementById("c1");
this.ctx1 = this.c1.getContext("2d");
this.c2 = document.getElementById("c2");
this.ctx2 = this.c2.getContext("2d");
let self = this;
this.video.addEventListener("play", function() {
self.width = self.video.videoWidth / 2;
self.height = self.video.videoHeight / 2;
self.timerCallback();
}, false);
},This code obtains references to the video element and two canvas elements in the XHTML document, and also obtains references to the graphics context of the two canvases. These will be used when we implement the chroma-keying effect.
addEventListener() listens to the video element and is called when the user presses the play button on the video. In order to handle user playback, this code takes the width and height of the video, halves it (we will halve the size of the video when performing the chroma-keying effect), and then calls the timerCallback() method to initiate video capture and visual effects calculations .
Timer callback
The timer callback function is called when the video starts playing (when the "play" event occurs), and is then responsible for its own periodic call to implement keying special effects for each frame of video. .
timerCallback: function() {
if (this.video.paused || this.video.ended) {
return;
}
this.computeFrame();
let self = this;
setTimeout(function () {
self.timerCallback();
}, 0);
},The callback function first checks whether the video is playing; if not, the callback function does nothing and returns immediately.
Then call the computeFrame() method, which performs chroma-keying special effects on the current video frame.
The last thing the callback function does is call setTimeout() to allow it to be re-called as soon as possible. In a real environment, you might set the call frequency based on the frame rate of the video.
Processing video frame data
The computeFrame() method, as shown below, is actually responsible for grabbing the data of each frame and executing chroma-keying special effects.
computeFrame: function() {
this.ctx1.drawImage(this.video, 0, 0, this.width, this.height);
let frame = this.ctx1.getImageData(0, 0, this.width, this.height);
let l = frame.data.length / 4;
for (let i = 0; i < l; i++) {
let r = frame.data[i * 4 + 0];
let g = frame.data[i * 4 + 1];
let b = frame.data[i * 4 + 2];
if (g > 100 && r > 100 && b < 43)
frame.data[i * 4 + 3] = 0;
}
this.ctx2.putImageData(frame, 0, 0);
return;
}When it is called, the video element will display the most recent video frame data as follows:
In line 2, the video frame is Copied into the graphics context of the first canvas ctx1, specify the height and width values as half the frame size we saved earlier. Note that you can draw the current video frame by passing the video element to the drawImage() method of the drawing context. The result is:
The third line of code obtains a copy of the original image data of the current video frame by calling the getImageData() method of the first canvas context. It provides raw 32-bit pixel image data so we can manipulate it. Line 4 of code calculates the total number of pixels in the image by dividing the total length of the frame image data by 4.
Line 6 of code scans all pixels in a loop, obtains the red, green, and blue values of each pixel, and compares it with the predefined background color. These background colors will use the background image imported in foo.png replace.
For each pixel that is detected as background, its alpha value is replaced with zero, indicating that the pixel is completely transparent. As a result, the background portion of the final image is 100% transparent, so that when it is drawn into the context of the target on line 13, the effect is that the content is superimposed on the static background.
The resulting image looks like this:
# Do this repeatedly while the video plays, so that frame by frame is processed, rendering the chroma -Key special effects.
For more HTML5: Using Canvas to process Video in real time, please pay attention to the PHP Chinese website!
Hot AI Tools
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Undress AI Tool
Undress images for free
Clothoff.io
AI clothes remover
AI Hentai Generator
Generate AI Hentai for free.
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
1359
52
Table Border in HTML
Sep 04, 2024 pm 04:49 PM
Guide to Table Border in HTML. Here we discuss multiple ways for defining table-border with examples of the Table Border in HTML.
Nested Table in HTML
Sep 04, 2024 pm 04:49 PM
This is a guide to Nested Table in HTML. Here we discuss how to create a table within the table along with the respective examples.
HTML margin-left
Sep 04, 2024 pm 04:48 PM
Guide to HTML margin-left. Here we discuss a brief overview on HTML margin-left and its Examples along with its Code Implementation.
HTML Table Layout
Sep 04, 2024 pm 04:54 PM
Guide to HTML Table Layout. Here we discuss the Values of HTML Table Layout along with the examples and outputs n detail.
HTML Ordered List
Sep 04, 2024 pm 04:43 PM
Guide to the HTML Ordered List. Here we also discuss introduction of HTML Ordered list and types along with their example respectively
Moving Text in HTML
Sep 04, 2024 pm 04:45 PM
Guide to Moving Text in HTML. Here we discuss an introduction, how marquee tag work with syntax and examples to implement.
HTML Input Placeholder
Sep 04, 2024 pm 04:54 PM
Guide to HTML Input Placeholder. Here we discuss the Examples of HTML Input Placeholder along with the codes and outputs.
How do you parse and process HTML/XML in PHP?
Feb 07, 2025 am 11:57 AM
This tutorial demonstrates how to efficiently process XML documents using PHP. XML (eXtensible Markup Language) is a versatile text-based markup language designed for both human readability and machine parsing. It's commonly used for data storage an
