WithPivot removed during transformation

I have a many to many relation with additional fields. 

It works fine until I try to query a item or collection with additional fields.

Return the "pure" raw item the additional pivot fields are there.

Using  return $this->response->item($company, $this->getTransformer()); the additional fields wont appear.

