Early brain maturational processes such as myelination manifest as changes in the relative appearance of white-gray matter tissue classes in MR images. Imaging modalities such as T1W (T1-Weighted) and T2W (T2-Weighted) MRI each display specific patterns of appearance change associated with distinct neurobiological components of these maturational processes. In this paper we present a framework to jointly model multimodal appearance changes across time for a longitudinal imaging dataset, resulting in quantitative assessment of the patterns of early brain maturation not yet available to clinicians. We measure appearance by quantifying contrast between white and gray matter in terms of the distance between their intensity distributions, a method demonstrated to be relatively stable to interscan variability. A multivariate nonlinear mixed effects (NLME) model is used for joint statistical modeling of this contrast measure across multiple imaging modalities. The multivariate NLME procedure considers correlations between modalities in addition to intra-modal variability. The parameters of the logistic growth function used in NLME modeling provide useful quantitative information about the timing and progression of contrast change in multimodal datasets. Inverted patterns of relative white-gray matter intensity gradient that are observable in T1W scans with respect to T2W scans are characterized by the SIR (Signal Intensity Ratio). The CONTDIR (Contrast Direction) which measures the direction of the gradient at each time point relative to that in the adult-like scan adds a directional attribute to contrast. The major contribution of this paper is a framework for joint multimodal temporal modeling of white-gray matter MRI contrast change and estimation of subject-specific and population growth trajectories. Results confirm qualitative descriptions of growth patterns in pediatric radiology studies and our new quantitative modeling scheme has the potential to advance understanding of variability of brain tissue maturation and to eventually differentiate normal from abnormal growth for early diagnosis of pathology.