The thin membrane of glial cells lining the ventricles of the brain and the central canal of the spinal cord.