Statistical Modelling 22 (5) (2022), 457–476

Semi-supervised clustering of time-dependent categorical sequences with application to discovering education-based life patterns

Yingying Zhang,
Department of Mathematics and Statistics,
University of South Alabama,
Mobile, AL,
USA.

Volodymyr Melnykov,
Department of Information Systems,
Statistics, and Management Science,
The University of Alabama,
Tuscaloosa, AL,
USA.
e-mail: vmelnykov@ua.edu

Igor Melnykov,
Department of Mathematics and Statistics,
University of Minnesota Duluth,
Duluth, MN,
USA.

Abstract:

A new approach to the analysis of heterogeneous categorical sequences is proposed. The first-order Markov model is employed in a finite mixture setting with initial state and transition probabilities being expressed as functions of time. The expectation–maximization algorithm approach to parameter estimation is implemented in the presence of positive equivalence constraints that determine which observations must be placed in the same class in the solution. The proposed model is applied to a dataset from the British Household Panel Survey to evaluate the association between the education background and life outcomes of study participants. The analysis of the survey data reveals many interesting relationships between the level of education and major life events.

Keywords:

semi-supervised clustering, Time-dependent categorical sequences, EM algorithm, variable selection

Downloads:

R package in preparation.


back