Justice C. Haley Bunn was sworn into office Wednesday afternoon in a private ceremony so she could begin work on the West Virginia Supreme Court.