How to push the video stream of Hikvision camera SDK to the front-end Vue project for real-time playback?

Hikvision Camera SDK Video Streaming Live Playback in Vue Project

This article introduces how to stream the video obtained by Hikvision camera SDK through the streaming media server (zlmediakit) and finally play in the Vue front-end project in real time. The entire process does not rely on cloud video services, and the camera is directly connected to the local computer.

System architecture and implementation ideas

The system adopts a three-layer architecture:

1. Hikvision camera and backend (Spring Boot): Use Hikvision SDK to obtain camera video streaming.
2. Streaming Media Server (ZLMediaKit): As a middleware, it receives video streams pushed by the backend and forwards them.
3. Front-end (Vue): Pull RTSP stream from ZLMediaKit for playback.

Backend (Java) implementation details

The backend uses the Spring Boot framework, and the core logic is to push the video data of the Hikvision SDK callback to ZLMediaKit. The code snippet is as follows:

 @Service
public class HikvisionServiceImpl implements HikvisionService {

    // ... Other codes...

    @PostConstruct
    public void register() {
        // Initialize HikvisionClient client = new HikvisionClient();
        client.initPipedStream();
        client.clientInit();
        client.action(); // Start preview and get video stream data through callback}

    // Hikvision SDK callback function class RealDataCallback implements HCNetSDK.FRealDataCallBack_V30 {
        @Override
        public void invoke(int lRealHandle, int dwDataType, ByteByReference pBuffer, int dwBufSize, Pointer pUser) {
            if (dwDataType == HCNetSDK.NET_DVR_STREAMDATA) {
                if (dwBufSize > 0) {
                    ByteBuffer buffer = pBuffer.getPointer().getByteBuffer(0, dwBufSize);
                    byte[] bytes = new byte[dwBufSize];
                    buffer.rewind();
                    buffer.get(bytes);
                    executor.execute(() -> pushToZLMediaKit(bytes)); // Push to ZLMediaKit
                }
            }
        }
    }

    private void pushToZLMediaKit(byte[] data) {
        // Push data to ZLMediaKit, this part needs to be implemented according to ZLMediaKit's API.
        // The data may need to be encoded (e.g. H.264) and sent over the network to the ZLMediaKit server.
        // ... ZLMediaKit push code...
    }
}

The pushToZLMediaKit method is key, and the received video data needs to be pushed to the specified streaming server address according to the ZLMediaKit API document. This may involve data format conversion (e.g., converting raw data to H.264 streams).

Front-end (Vue) implementation details

The front-end uses the Vue framework and combines a suitable video player library such as flv.js or hls.js to play RTSP streams obtained from ZLMediaKit.

 // Vue component code snippet<template>
  <video ref="videoPlayer" autoplay></video>
</template>

<script>
import flvjs from 'flv.js'; // 或hls.js

export default {
  mounted() {
    this.initPlayer();
  },
  methods: {
    initPlayer() {
      const rtspUrl = '/api/rtspStream'; // 后端提供的RTSP流地址接口
      fetch(rtspUrl)
        .then(response => response.json())
        .then(data => {
          const flvPlayer = flvjs.createPlayer({
            type: 'flv',
            url: data.rtspUrl // 获取到的RTSP流地址
          });
          flvPlayer.attachMediaElement(this.$refs.videoPlayer);
          flvPlayer.load();
          flvPlayer.play();
        })
        .catch(error => console.error('Error fetching RTSP URL:', error));
    }
  }
};
</script>

/api/rtspStream is a backend interface that returns the RTSP stream address generated in ZLMediaKit.

Complete solution supplement

In order to achieve stable video streaming, the backend may need to use FFmpeg for transcoding to convert the original video stream output by Hikvision SDK to a format supported by ZLMediaKit (such as FLV). The backend needs to continuously write data to the response stream, while the frontend parses and plays through libraries such as flv.js. This requires careful processing of network transmission and data buffering to ensure smooth video playback. Error handling and resource release are also crucial.

The above is the detailed content of How to push the video stream of Hikvision camera SDK to the front-end Vue project for real-time playback?. For more information, please follow other related articles on the PHP Chinese website!