At approximately day 1

Thyroid gland secretions and serum thyroxine concentrations begin to increase.

Reference [PubMed Link]

Fisher DA, Klein AH. 1981. Thyroid development and disorders of thyroid function in the newborn. N Engl J Med 304(12):702-712.