Ravens' Smith leaves after brother's death