I am too dependent on subtitles..i don't know what to do?

so here's the thing..i am from a non english speaking country..i have been watching lots of english movies for over 3 years now..atleast about 400 movies in an effort to perfect my english..so first i tried without the subs,but golly, it was so hard to keep up..then i kept using subs..now i am too dependent..i tried without the subs(the movie "yellow handkerchief"no subs were available) a few days ago..i paused, went back and played it again..even if do that a million times,i just can't come to terms with their accent..its like a secret code or something..and everytime there is a new word to learn,like atleast 20 words describe more or less the same meaning.."So i can make a fine conversation even if i can't remember too many words,but when it is used by people,well it would be embarrassing if i can't interpret"...then i always wonder how english speaking people are able to remember so many words..the problem though is in our language the vocabulary is so confined and we use words rather awkwardly,to be honest...some of the people here pretend they can understand without the subs but they are just kidding themselves..many of you guys would perhaps think this is trivial..many here wouldn't wanna admit..but gosh,i just can't get over it,for christsakes!!!