Folding chair with cane seat and back