+ Reply to Thread
Results 1 to 2 of 2

Thread: spatial join math error

  1. #1
    John Warden
    Join Date
    Dec 2009
    Posts
    3
    Points
    0
    Answers Provided
    0


    0

    Post spatial join math error

    I am performing a spatial join in which I sum the values for one polygon layer and assign that data to another polygon layer it intersects. For summed values of 7 or more digits, the calculated value is missing the first digit. For example, the join summation shows an answer such as 756,324, when the actual correct answer is 7,563,241. Any answer with 6 digits or less is correct.

    Any thoughts as to the cause, or a solution?

  2. #2
    Dan Evans
    Join Date
    Apr 2011
    Posts
    82
    Points
    40
    Answers Provided
    5


    0

    Default Re: spatial join math error

    Are you using shapefiles? If so, you have to define the Precision and Scale for the fields in question in the shapefile properties. Precision is the total number of significant digits, and scale is the number of decimal places. If the field is an integer then obviously there is only the precision to set. Try setting the precision of your fields to 7 or more.

    Hope that helps...

    Dan

    Quote Originally Posted by johnwarden View Post
    I am performing a spatial join in which I sum the values for one polygon layer and assign that data to another polygon layer it intersects. For summed values of 7 or more digits, the calculated value is missing the first digit. For example, the join summation shows an answer such as 756,324, when the actual correct answer is 7,563,241. Any answer with 6 digits or less is correct.

    Any thoughts as to the cause, or a solution?

+ Reply to Thread

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts