“You have walked hand and hand with me as I continue to get my emotions, mind, body and soul in tact,” Justin Bieber wrote to Hailey Baldwin on Instagram

Justin Bieber isn’t shy about making his love for wife Hailey Baldwin known.

On Monday, the 25-year-old star captioned an Instagram photo of Baldwin, 22, from a past Maxim photo shoot with a poem he wrote for her, explaining that he wanted to “publicly honor” her and wish her good luck on her shoot for the day.

“Sunlight falls into the Abyss Just like i fall into your lips,” Bieber began the poem. “Waves crash onto the shore My love for you grows more and more Sound of the crickets a true meditation I think about you, Gods greatest creation.”

“As i fall into this blissful state I ponder on how you’re my one true SOULMATE,” he continued. “Its getting dark [too] dark to see A chilling breeze embraces me The smell of camomile fresh from the garden My life is a movie that both of us star in. Speaking of stars I’m starting to see some They light up the sky, reminds me of my freedom How big and how vast our world is around us So grateful for god we were lost but he found us So i write the poem with him always in mind Things all around us Just get better with time.”

Hailey Baldwin (L) and Justin Bieber. HAILEY BALDWIN/INSTAGRAM

He concluded the poem with a sweet message directed to Baldwin, writing: “I fall more in love with you every day! You have walked hand and hand with me as I continue to get my emotions, mind, body and soul in tact! You have given me so much strength, support, encouragement and joy. I just wanted to publicly honor you, and remind you that the best is yet to come! Have a great shoot today my love!”

Bieber and Baldwin, who wed in September 2018, officially moved into their new Beverly Hills house together last week.

“This is their first house together as a married couple, so it’s a big deal,” a source told PEOPLE. “They worked with a designer to furnish the house. It’s a fun project for them.”

The couple’s latest milestone in their marriage comes amid Bieber’s decision to prioritize his mental health.

“Justin is still receiving treatments and working on his health. Sharing his struggles and thoughts with fans seems to have been very beneficial to him,” the source said. “He seems to feel less pressure and is able to focus on his health in peace.”

BROADIMAGE/REX/SHUTTERSTOCK

On Wednesday, Bieber shared a selfie on his Instagram Story during a therapy session. “It’s cool to have a healthy mind and emotions,” he captioned the photo.

Just days before, Bieber wrote to his fans explaining that he would return to music after repairing some of his “deep-rooted issues” in treatment.

“So I read a lot of messages saying that you want an album .. I’ve toured my whole teenage life, and early 20s, I realized and as you guys probably saw I was unhappy last tour and I don’t deserve that and you don’t deserve that,” he wrote. “You pay money to come and have a lively energetic fun light concert and I was unable emotionally to give you that near the end of the tour.”

Bieber also noted that prioritizing his mental health came from the desire to “sustain” his marriage to Baldwin and live up to the expectations he had created for himself as a future father.

“Hailey is able to support Justin in a way that no one else has been able to,” a Bieber source previously told PEOPLE. “She only comes from a place of love. She doesn’t want anything from him except for him to be able to be the best person and husband. Justin is overwhelmingly grateful for how patient and supportive Hailey is.”