The R&B singer performed songs from her debut full-length, Shea Butter Baby.