This paper explores the factors affecting EFL speaking skills as well as speaking performance with a review of literature. Based on this review, the paper argues that the quality of speaking instruction needs to be mainly focused on through improving the teaching techniques with creating links between teacher-guided learning and learners-initiated activities outside class. Finally, the paper concludes with insights into the teaching and learning of EFL speaking skills in the Japanese context.