Speaking in English language is a skill that students need to learn because it is crucial to develop their English language ability. The use of English in various activities, associations or Large events can help improve students’ speaking skills in enhancing their English. However, this implementation has not improved English speaking skills, especially for non-English students. This research aims to find out more about difficulties and factors for students in speaking English. The participant of this study is 1st semester of Non-English Department students especially for Language Class in the University of Darussalam Gontor. This research used a qualitative descriptive method using a participant of one class with total 33 students. The research instruments were interviews, class observations and documentation. In this case, the researcher used purposive sampling to 10 students as the subjects. The findings from this research indicated that students have difficulties in speaking English and they need help in improving their English-speaking skills, because there are several factors that hinder them. Keywords: Difficulties, Speaking, Non-English Department Students