decimal rounding down when supposed to be up?

Discussion in 'SolidWorks' started by mfgsol, Jan 31, 2006.

  1. mfgsol

    mfgsol Guest

    i have a dim at 11.8750 set to 2 place and it shows 11.87. what gives?
    am i missing something here. is this a bug?
     
    mfgsol, Jan 31, 2006
    #1
  2. mfgsol

    mfgsol Guest

    i did not type it myself, never do, the model geometry is 11.87498 so
    the 2nd 8 rounds the 9 to 0 and the 4 to a 5 and then should round the
    7 to an 8 if i set it to 2 place, unless i was asleep back in what 3rd
    or 4th grade? ;0)
     
    mfgsol, Jan 31, 2006
    #2
  3. mfgsol

    mfgsol Guest

    how does that make sense, what i learned was 5 and above rounds up 4
    and below rounds down if a 9 rounds a 4 to a 5 then it rounds the next
    numbers as well all the back towards the decimal. does this not apply
    to solidworks?
     
    mfgsol, Jan 31, 2006
    #3
  4. Maybe another way of looking at it is that where you have 11.87498, and your
    last significant place is at 2 decimal places, then what's the value of the
    digits below that point? In this case, those digits would be 498, which is
    less than 5, so therefore your last significant digit doesn't get pushed up.

    WT
     
    Wayne Tiffany, Jan 31, 2006
    #4
  5. mfgsol

    mfgsol Guest

    got it. i just had another guy go over it with me too. apparently i am
    a complete fn dumbass that really was sleeping. i have always done it
    my way 5-9 rounds up, 0-4 rounds down. I STAND CORRECTED. hmmmm
    something to think about.
     
    mfgsol, Jan 31, 2006
    #5
  6. mfgsol

    TOP Guest

    It isn't 5 though, it is 4. SW is rounding from the number it keeps
    internally, not the previous display of digits.
     
    TOP, Jan 31, 2006
    #6
  7. mfgsol

    ken Guest

    And if your following ANSI (possibly ISO) dimensioning standards, only
    dimensions that have a odd number preceding the 5 get rounded up, other wise
    it doesn't. For instance, .875 rounded to 2 digits is .88, while .625 is
    ..62 :) Hope that helps confuse things further :)

    Ken
     
    ken, Feb 1, 2006
    #7
  8. mfgsol

    CS Guest

    What you are doing is complicating the rounding process

    11.87498
    rounds up to 11.875 at 3 and 4 places

    but at 2 places it rounds down to 11.87

    what you are doing to over complicate is you are rounding to 3 places
    and then rounding again to 2

    the deal is 11.87498 .00498 is less than .005 so it rounds down when
    limited to 2 places. It still follows the same rule just it is only
    evaluating the rule one time you are evaluating it 2 or 3 times.
     
    CS, Feb 1, 2006
    #8
  9. mfgsol

    bob zee Guest

    you are right - 5-9 rounds up, 0-4 rounds down. you just need to stop
    looking at all of the digits past the one next to the digit you want to
    round.

    this will be difficult because bob z. knows how paranoid you are.
    :~)>

    bob z.
    p.s. smaller and smaller...
     
    bob zee, Feb 1, 2006
    #9
  10. mfgsol

    j Guest

    Must have been because when we were in 3rd or 4th grade, they were using
    abacuss's or slide rules to do calculations and never got past 3 decimal
    places.
     
    j, Feb 2, 2006
    #10
Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments (here). After that, you can post your question and our members will help you out.