Clarify rounding on VEC_UNSIGNED*, VEC_SIGNED*, and VEC_FLOAT* description #21

Closed
opened 8 years ago by wschmidt-ibm · 1 comments
wschmidt-ibm commented 8 years ago (Migrated from github.com)

VEC_UNSIGNED*, VEC_SIGNED* description isn't clear on how the FP values are converted to integer values.
Similarly, for VEC_FLOATE, and FLOATO, it isn't clear on the rounding used to convert from vector double to vector float.

From what I obtained from Ian:

vec_signed and vec_unsigned round toward zero. If the fp value can't be represented because it's too low or too high then they saturate to the smallest or largest valid integer.

vec_floate and vec_floato round to the current rounding mode RN in the FPSCR.

VEC_UNSIGNED*, VEC_SIGNED* description isn't clear on how the FP values are converted to integer values. Similarly, for VEC_FLOATE, and FLOATO, it isn't clear on the rounding used to convert from vector double to vector float. From what I obtained from Ian: vec_signed and vec_unsigned round toward zero. If the fp value can't be represented because it's too low or too high then they saturate to the smallest or largest valid integer. vec_floate and vec_floato round to the current rounding mode RN in the FPSCR.
wschmidt-ibm commented 8 years ago (Migrated from github.com)

Looks like we clarified this for vec_signed and vec_unsigned, but not for the others.

Looks like we clarified this for vec_signed and vec_unsigned, but not for the others.
Sign in to join this conversation.
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: systemsoftware/ELFv2-ABI#21
Loading…
There is no content yet.