Thanks for reply. In the end it really looks like a controller issue. I tried one trick I found on youtube to simply blow into the analog stick to move the dust out. And miroucasly it worked. Still some issues, but just sporadicaly. When it gets worse i will maybe dismabntle it and clean with alcohol ot buy new one.
I wasnt aware that these issues are so common. And since the controller was quite new and looked after i didnt expect the issue to be here. Maybe its a combination of booth-game sensutivity and controller tolerances...