I don't Know about that u can add column to primary key constraint.
But one solution may be
desable primary key constraint
create another PK index including all columuns that u want.
and drop previous disable Pk constraint

try it out

Kuckoo