文献 跟踪算法:以跟踪图像中2D目标为例 定义: 为第i帧图像序列,B为目标轮廓点集合。…
- User
文献 跟踪算法:以跟踪图像中2D目标为例 定义: 为第i帧图像序列,B为目标轮廓点集合。 整个算法分为几个阶段:获取目标初试状态信息,在不同半径区域内搜索边界点,更新目标中心点。 第一阶段:获取第一帧图像 中要跟踪目标的中心位置 。 第二阶段:在不同半径区域内搜索边界点 从第二帧图像 开始,首先获取帧图像的尺寸大小 ,令 ,定义半径区域集合 ,对于每一个半径 均有如下操作: 在以c为圆点, 为半径的区域内,求该区域内所有像素灰度的一阶导数和二阶导数, 一阶导数计算如下,其中 表示该点的像素灰度值:
二阶导数计算如下:
将二阶导数组成矩阵H:
该矩阵H有两个特征值,当两个特征值都很大时,表示被检测点为边界点,将该边界点并入集合B。 直至所有半径区域内的边界点全部搜索完,得到集合B。 第三阶段:更新目标中心点 根据广义哈夫变换从目标的轮廓点集合求出轮廓的参考点,将该参考点作为当前帧目标的中心位置。进入下一帧训练跟踪目标。 求轮廓参考点的算法: 在所在轮廓内部取一个参考点(p,q),对于任意一个轮廓点(x,y),令从(x,y)到(p,q)的矢量为r,r与X轴正向的夹角为 ,画出过轮廓点(x,y)的切线和法线,令法线与X轴正向的夹角(梯度角)为 。这样每个轮廓点都对应一个梯度角 ,而一个 可能对应多个轮廓点。 基于上述定义,参考点的坐标可基于轮廓点的坐标计算出来:
具体步骤为: (1) 在参数空间中建立累加数组 置数组A=0。 (2) 对于轮廓上的各点(x,y),先算出其梯度角 ,再由公式算出p和q,据此对A进行累加: 。 (3) 利用A中的最大值得到所求轮廓得参考点,整个目标轮廓的位置就可以确定了。 用英语翻译上述文本。
- Assistant
Tracking Algorithm: Taking 2D Object Tracking in Images as an Example Definition: Let i be the frame index of the image sequence, and B be the set of contour points of the target. The algorithm can be divided into several stages: obtaining initial state information of the target, searching for boundary points in different radius regions, and updating the center point of the target. First Stage: Obtain the initial position of the target to be tracked in the first frame image. Second Stage: Search for boundary points in different radius regions Starting from the second frame image, first obtain the size of the frame image, let R, and define a set of radius regions. For each radius , the following operations are performed: In the region with c as the center point and R as the radius, calculate the first-order derivative and second-order derivative of the grayscale of all pixels in the region. The first-order derivative is calculated as follows, where represents the grayscale value of the pixel at that point:
The second-order derivative is calculated as follows:
Form the second-order derivative into a matrix H:
This matrix H has two eigenvalues. When both eigenvalues are large, it indicates that the detected point is a boundary point and it is added to the set B. Repeat this process for all radius regions until all boundary points in the regions are searched, and the set B is obtained. Third Stage: Update the center point of the target Using the Generalized Hough Transform, obtain the reference point of the contour from the set of contour points of the target, and use this reference point as the current frame's center position of the target. Proceed to track the next frame. Algorithm for obtaining the contour reference point: Take a reference point (p,q) inside the contour. For any contour point (x,y), let r be the vector from (x,y) to (p,q), and let be the angle between r and the positive X-axis. Draw the tangent and normal line passing through the contour point (x,y), and let be the angle between the normal line and the positive X-axis (gradient angle). In this way, each contour point corresponds to a gradient angle , and one can correspond to multiple contour points. Based on the above definition, the coordinates of the reference point can be calculated based on the coordinates of the contour points:
The specific steps are as follows: (1) Establish an accumulation array in the parameter space and set A = 0. (2) For each point (x,y) on the contour, first calculate its gradient angle , then calculate p and q using the formula, and add them to A: . (3) Use the maximum value in A to obtain the desired reference point of the contour, and the position of the entire target contour can be determined.
- User
- 一般的框架:先讲方法的分类,再分析问题,然后讲自己要做的东西,提出自己的方法思路,再讲算法,配合流程图和框图表达方法。
- 方法可以先讲理论,讲为什么要这样做,但算法是直接执行,不讲理论。用公式表达、定义问题时看论文的规范用法。
- 介绍方法时细节要讲清楚。先从图像的矩阵形式开始介绍,然后分析图像中目标的位置、轮廓(边界)如何表达,再介绍边界特征,最后介绍如何搜索目标的位置和边界。
- 介绍图像的矩阵形式时,要表述清楚是什么矩阵,像素矩阵还是灰度矩阵。
- 分析图像中目标的位置和边界,明确用直角坐标系还是极坐标系,位置坐标应该放在哪里?对目标边界的表达应该是一个函数而不是简单的集合B,该目标函数不必有解析式,只是限制一对一对的边界点,表明函数是由一对一对边界点组成的,但要不要拟合成函数可以后续在思考。
- 介绍边界特征时,要描述不同的图像(亮度矩阵、灰度矩阵、色彩矩阵、远红外、激光图像等)各自的边界特征是什么样的(例如灰度梯度的跳变就是边界),为什么二阶导数的海森矩阵的两个特征值最大就代表边界?找出边界的判定条件?就是要从底层看物体成形的图像是什么样的,再分析哪一种图像好,为什么好?
- 要把所有的边界特征都找出来,包括别人方法用的边界特征。注意其他人在光照、遮挡、噪声等干扰情况下的处理方法。
- 搜索目标位置和边界。第一种搜索方式:第一步是目标检测,从一般的角度,第一轮不知道目标的边界,在大范围内搜索目标,后续假定一个物体在相邻帧的移动不会很远。后续在前一帧的位置附近搜索,但可能搜索的边界点的重叠性会比较高,要选择哪一个点正确,但利用从原点发散的方式搜索重叠性会比较小,所以或许极坐标系比较适合。
- 第二种搜索方式,假定在第一帧搜索到了边界f(x,y),在第二帧上进行两个循环迭代:固定角度,半径以步长20%递增,总会搜索到边界点,然后固定搜索到边界点的半径值,角度以步长5°递增继续搜索边界点。最后找到边界函数f(x,y)的每个边界点。 用英语翻译上述文本。
- Assistant
- General framework: Start by classifying the methods, analyzing the problem, and then introducing what you will do and proposing your method approach. Then, explain the algorithm using flowcharts and diagrams.
- The method can be explained theoretically, discussing why it is done this way, but the algorithm is executed directly, without discussing the theory. Use formulas to express ideas and use standard terminology when defining the problem based on research papers.
- When introducing the method, explain the details clearly. Start by explaining the image matrix representation, then analyze how the position and contour (boundary) of the object in the image are expressed. Then, introduce the boundary features, and finally explain how to search for the position and boundary of the object.
- When introducing the matrix representation of the image, clarify whether it is a pixel matrix or a grayscale matrix.
- When analyzing the position and boundary of the object in the image, clearly state whether a Cartesian coordinate system or polar coordinate system should be used. Where should the position coordinates be placed? The expression of the object boundary should be a function rather than a simple set B. This objective function does not necessarily need to have an analytical expression, but it should indicate that the function consists of pairs of boundary points. The question of whether or not the function should be fitted can be considered later.
- When introducing the boundary features, describe the characteristics of different types of images (brightness matrix, grayscale matrix, color matrix, thermal infrared, laser images, etc.) and explain what the boundary features are for each type (for example, grayscale gradient jumps indicate boundaries). Explain why the two largest eigenvalues of the Hessian matrix of the second-order derivative represent boundaries. Determine the criteria for boundary detection. It is important to analyze the underlying representation of object formation from the bottom-up perspective and consider which type of image is better and why.
- Identify all the boundary features, including those used by other methods. Pay attention to how other researchers handle interference such as lighting, occlusion, and noise.
- Search for the position and boundary of the object. The first search method: The first step is object detection. Initially, the boundary of the object is unknown, so the search is conducted in a large area. In subsequent frames, it is assumed that the object will not move far from its neighboring frames. Subsequent searches are done near the previous frame's position, but there may be a higher overlap of the search boundary points. Choosing the correct point becomes crucial. However, using a search pattern that radiates from the origin may have less overlap, making a polar coordinate system more suitable.
- The second search method assumes that the boundary f(x,y) is found in the first frame. In the second frame, two looping iterations are performed: fix the angle and increment the radius by 20% until a boundary point is found, then fix the radius of the found boundary point and continue searching for boundary points by incrementing the angle by 5°. Finally, find each boundary point of the boundary function f(x,y).
這些要素,可以通過下列這些步驟實現: These elements can be achieved through the following steps:
- User
- 一般的框架:先讲方法的分类,再分析问题,然后讲自己要做的东西,提出自己的方法思路,再讲算法。配合流程图和框图表达方法。翻译上述文本
- Assistant
- General framework: Start by discussing the classification of methods, analyze the problem, and then introduce what you will do and propose your method approach, followed by explaining the algorithm. Use flowcharts and diagrams to illustrate the process.
这个一般的框架包括以下几个步骤:首先,对方法进行分类,然后对问题进行分析,接着介绍自己要做的内容,提出自己的方法思路,并详细讲解算法。通过使用流程图和框图来展示方法的实现过程。
- User
- 介绍边界特征时,要描述不同的图像(亮度矩阵、灰度矩阵、色彩矩阵、远红外、激光图像等)各自的边界特征是什么样的(例如灰度梯度的跳变就是边界),为什么二阶导数的海森矩阵的两个特征值最大就代表边界?找出边界的判定条件?就是要从底层看物体成形的图像是什么样的,再分析哪一种图像好,为什么好?翻译这段文本
- Assistant
- When introducing boundary features, describe the characteristics of different types of images (brightness matrix, grayscale matrix, color matrix, thermal infrared, laser images, etc.) and explain what their respective boundary features look like (e.g., a jump in grayscale gradient indicates a boundary). Additionally, explain why the two largest eigenvalues of the Hessian matrix in the second-order derivative represent boundaries. Determine the criteria for boundary detection. This involves examining the underlying image formation process at the lowest level and analyzing which type of image is more suitable and why.
介绍边界特征时,需要描述不同类型图像(亮度矩阵、灰度矩阵、色彩矩阵、远红外、激光图像等)各自的边界特征是什么样的(例如灰度梯度的跳变表示边界)。此外,还需要解释为什么二阶导数的海森矩阵的两个最大特征值表示边界。找出边界的判定条件。这涉及从最底层考虑物体成形的图像是什么样的,然后分析哪种类型的图像更适合,以及为什么更适合。