SearcharxivSearch

arXiv subjects

Beyza Kalkanli

Publications and source records attributed to Beyza Kalkanli.

4 recordsLinked to original sources

Polarization-Based Eye Tracking with Personalized Siamese Architectures

Head-mounted devices integrated with eye tracking promise a solution for natural human-computer interaction. However, they typically require per-user calibration for optimal performance due to inter-person variability. A differential personalization approach using Siamese architectures learns relative gaze displacements and reconstructs absolute gaze from a small set of calibration frames. In this paper, we benchmark Siamese personalization on polarization-enabled eye tracking. For benchmarking, we use a 338-subject dataset captured with a polarization-sensitive camera and 850 nm illumination. We achieve performance comparable to linear calibration with 10-fold fewer samples. Using polarization inputs for Siamese personalization reduces gaze error by up to 12% compared to near-infrared (NIR)-based inputs. Combining Siamese personalization with linear calibration yields further improvements of up to 13% over a linearly calibrated baseline. These results establish Siamese personalization as a practical approach enabling accurate eye tracking.

cs.CV

Tubular Curvature Filter: Pointwise Curvature Calculation for Tubular Objects in Images

Purpose: Accurate estimation of blood vessel tortuosity from medical images is an extremely important and challenging task. It is particularly relevant in the context of retinopathy of prematurity (ROP), where the staging of disease severity and consequent therapeutic approaches are heavily informed by the presence and prominence of vessel tortuosity. Existing methods based on centerline or skeleton curvature fail to capture curvature gradients across a rotating tubular structure, thereby limiting their effectiveness in the case of ROP. Methods: This paper defines local tubular curvature and presents the Tubular Curvature Filter (TCF) method, which locally calculates the acceleration of curve bundles traversing a tubular object parallel to its centerline. This is achieved by examining the directional rate of change in the eigenvectors of the Hessian matrix of a tubular intensity function in space. TCF implicitly calculates the local tubular curvature without the need to explicitly segment or extracting the centerline of the tubular object. Results: Experimental results demonstrate that TCF provides accurate estimates of local curvature at any point inside tubular structures. Results on 2D and 3D images show that TCF discerns curvature differences between the inner and outer sides of curved tubular objects, while centerline-based approaches cannot. Conclusion: Our findings highlight that TCF's ability to discern between the inner and outer sides of curved tubular objects is particularly useful in medical fields that require vasculature curvature analysis from images, especially where vascular structures often have non-uniform diameters, such as in ROP.

eess.IV

Polarization-resolved imaging improves eye tracking

Polarization-resolved near-infrared imaging adds a useful optical contrast mechanism to eye tracking by measuring the polarization state of light reflected by ocular tissues in addition to its intensity. In this paper we demonstrate how this contrast can be used to enable eye tracking. Specifically, we demonstrate that a polarization-enabled eye tracking (PET) system composed of a polarization--filter--array camera paired with a linearly polarized near-infrared illuminator can reveal trackable features across the sclera and gaze-informative patterns on the cornea, largely absent in intensity-only images. Across a cohort of 346 participants, convolutional neural network based machine learning models trained on data from PET reduced the median 95th-percentile absolute gaze error by 10--16\% relative to capacity-matched intensity baselines under nominal conditions and in the presence of eyelid occlusions, eye-relief changes, and pupil-size variation. These results link light--tissue polarization effects to practical gains in human--computer interaction and position PET as a simple, robust sensing modality for future wearable devices.

cs.CV

Dependency-aware Maximum Likelihood Estimation for Active Learning

Active learning aims to efficiently build a labeled training set by strategically selecting samples to query labels from annotators. In this sequential process, each sample acquisition influences subsequent selections, causing dependencies among samples in the labeled set. However, these dependencies are overlooked during the model parameter estimation stage when updating the model using Maximum Likelihood Estimation (MLE), a conventional method that assumes independent and identically distributed (i.i.d.) data. We propose Dependency-aware MLE (DMLE), which corrects MLE within the active learning framework by addressing sample dependencies typically neglected due to the i.i.d. assumption, ensuring consistency with active learning principles in the model parameter estimation process. This improved method achieves superior performance across multiple benchmark datasets, reaching higher performance in earlier cycles compared to conventional MLE. Specifically, we observe average accuracy improvements of 6%, 8.6%, and 10.5% for k=1, k=5, and k=10 respectively, after collecting the first 100 samples, where entropy is the acquisition function and k is the query batch size acquired at every active learning cycle. Our implementation is publicly available at: https://github.com/neu-spiral/DMLEforAL

cs.LG