The primary custody loss could happen if the Changeling star doesn't attempt to improve her relationship with Pitt.
"The judge told the actress in part: "...not having a relationship with their father is harmful to them".
The legal documents state that Angie must give Brad their children's cell phone numbers so he can call anytime he wants.
A source told Hollywood Life that Jolie is upset and added: "Angelina is emotional and concerned over Brad's increase in custody, and the time he will be spending with their children this summer".
While Jolie, 43, is ordered to keep her distance during Pitt's time with the children, there will be a child therapist present when Pitt - who was investigated for child abuse shortly after his 2016 split from Jolie, but was later cleared - spends time with the kids.
Jolie had accused Pitt of hitting their now 16-year-old son, Maddox, on a flight from France to Los Angeles.
Angelina Jolie and Brad Pitt at the 2014 Film Independent Spirit Awards at Santa Monica Beach
Nearly two years after their much-publicised split, former Hollywood super-couple Brad Pitt and Angelina Jolie are still working out the finer details of a custody arrangement for their six kids - Maddox, 16, Pax, 14, Zahara, 13, Shiloh, 12, and Knox and Vivienne, 9.
Angelina Jolie brings her six children to The Breadwinner premiere in September 2017.
The court also outlined a detailed summer visitation schedule for the couple.
Angelina also opened up in an interview with Vanity Fair, saying that she is adjusting to her new lifestyle and being a single mother. Pitt will spend time with each child at least twice during this period and will designate one or two of the children for each visit in advance.
The therapist will meet with the children before and after each two-day period. Then from June 27 through July 1, he will get custody of them for 10 hours per day. From 8 July to 14 July, he can see the children for four hours a day. Jolie is responsible for the children traveling back to Los Angeles and Pitt will be responsible for getting them back to London afterward.
A rep for Pitt had no comment.
Justify back at Churchill as fans bask in Triple Crown glory
Gronkowski , named for and partly owned by New England Patriots tight end Rob Gronkowski , returned $13.80 and $7. The Triple Crown victor arrived at Churchill Downs in Louisville, Ky., on Monday for rest and relaxation.