So it was difficult in some parts to do but I finally managed to do it. I had to change the needle size to 2,5 mm, even though on this particular yarn was written that its suitable for needles 4 mm. I found it strange because the gauge was way too big and everything was too transparent. I used 2,5 mm needle and all went smooth after :)