Refresh token endpoint returning invalid credentials

Hello, I need help with my directus user authentication with nuxt… I am using SDK

return createDirectus(base).with(rest()).with(authentication('json'))

Then in my server route I am calling

const refreshToken = getCookie(event, 'refresh_token');
const response = await directus.request(refresh('json', refreshToken))

But directus is giving me:

"Invalid user credentials."

when calling this. Any ideas why? Could this be because of HTTP Only sameSite option? (I am storing both access and refresh tokens in HttpOnly cookies)