In what was their sixth attempt this summer, Smith and Yates pressed through a throng of reporters and picked up the marriage license they'd been seeking since the U.S. Supreme Court legalized same-sex marriage in June.

They emerged holding hands shortly after the courthouse opened at 8 a.m., as opponents booed and supporters cheered and chanted, "Love wins!"

"We're just really ... happy right now to finally get married and have it recognized here," Yates, who proposed to Smith this summer after a nine-year relationship, said shortly before getting the license.

County Clerk Kim Davis had refused to give licenses to same-sex couples after the Supreme Court decision -- Smith and Yates alone were denied five times, they say -- on grounds that issuing the licenses would violate her Christian convictions against same-sex marriage.

But a federal judge ordered her to jail Thursday, ruling that she was in contempt of court for refusing to issue the licenses and not allowing her deputies to distribute them for her.

U.S. District Judge David Bunning said Davis would remain behind bars until she complies. Five of her deputies agreed Thursday to issue marriage licenses in her absence, allowing Smith and Yates -- and any other couple -- to pick theirs up Friday.

How long will Davis stay in jail? Her supporters say she intends to remain there at least until there is a compromise. Mat Staver, Davis' attorney, has said his client would issue licenses if her name and title were not on them.

Davis' husband, Joe, told reporters Friday that his wife was willing to stay in jail until that proposed compromise happened.

"As long as it takes," Joe Davis said. "Hopefully (Gov. Steve) Beshear will have the guts to do his job."

Who is Kim Davis?

Deputies take over

Beshear welcomed the news that Davis' deputies agreed to issue the licenses.

"The future of the Rowan County Clerk continues to be a matter between her and the courts. Deputy clerks have said they will commence issuing marriage licenses beginning (Friday)," he said. "It appears that the citizens of Rowan County will now have access to all the services from the clerk's office to which they are entitled."

In court papers, attorneys for Davis argued that she is unable to comply with the court orders because issuing same-sex marriage licenses "irreparably and irreversibly violates her conscience."

Related: Court clerk who won't issue marriage licenses has been divorced three times

But American Civil Liberties Union attorneys contended that Davis has no legal basis to avoid performing her duties as a government clerk.

Kim Davis case: Some GOP candidates rally around her

And a federal prosecutor said it was time for Davis and her county to comply.

"Government officials are free to disagree with the law, but not disobey it," U.S. Attorney Kerry B. Harvey said in a statement. "The County Clerk has presented her position through the federal court system, all of the way to the U.S. Supreme Court. It is time for the Clerk and the County to follow the law."

Bunning said he, too, was religious, but he explained that when he took his oath to become a judge, that oath trumped his personal beliefs, CNN affiliate WKYT-TV reported.

"Her good faith belief is simply not a viable defense," Bunning said.

Jailing was 'not what everyone was hoping for'

Staver, founder of Liberty Counsel, which represented Davis, said he was "stunned" by Thursday's ruling ordering Davis to jail.

"Knowing Kim Davis and her strong Christian resolve and convictions, she may be jailed behind bars, but her conscience remains free," he told CNN's "The Lead with Jake Tapper" on Thursday.

Yates, who received the marriage license with Smith on Friday, said he, too, was shocked by Davis' jailing.

"That's not what everyone was hoping for," Yates said, adding that same-sex marriage supporters were instead hoping Davis would be fined or that she would resign. "It was a shock, but there have been so many things that we didn't anticipate."

Smith said the license denials had taken an emotional toll. During the fifth and final time that he and Yates were rejected, people were protesting against them outside the courthouse, Smith said.

"We had our hearts broken. That's upsetting enough, and you come out the door and they start cheering and clapping, and I just started crying. I couldn't stop for a while -- I was pretty upset," Smith said.

The couple looked wary as journalists surrounded them as they left the courthouse Friday. One said he didn't anticipate being the first to get the license, but instead believed two other couples had intended to arrive before them.

They said they were happy and elated before asking reporters to make way so they could leave.

A different person

Some scoff at the clerk, suggesting she's a hypocrite because she's been divorced three times.

Davis said she's a different person since becoming a Christian 4½ years ago.

"I am not perfect," she said in a statement. "No one is. But I am forgiven."

CNN's Eliott C. McLaughlin, Catherine E. Shoichet, Sonia Moghe, Alexandra Field, Ariane de Vogue and Jeremy Diamond contributed to this report.