The document describes the scenario simulation method for quantitative risk analysis. It discusses principal component analysis (PCA) to reduce variables and identify key factors that influence yield curve movements. The methodology involves using PCA to represent changes in key rates as a linear combination of independent principal factors. These factors are then discretized into a finite number of scenarios to simulate changes in key rates and portfolio values over time, enabling faster risk analysis compared to Monte Carlo simulation. Several examples are provided to illustrate applying this scenario simulation approach to analyze risk for single-currency and multi-currency fixed income portfolios.
Inverse scattering internal multiple attenuation algorithm in complex multi-D...Arthur Weglein
In this paper we discuss the multi-D inverse scattering internal multiple attenuation algorithm
focusing our attention on the prediction mechanisms. Roughly speaking, the algorithm
combines amplitude and phase information of three different arrivals (sub-events) in the data
set to predict one interbed multiple. The three events are conditioned by a certain relation
which requires that their pseudo-depths, defined as the depths of their turning points relative
to the constant background velocity, satisfy a lower-higher-lower relationship. This implicitly
assumes a pseudo-depth monotonicity condition, i.e. the relation between the actual depths and
the pseudo-depths of any two sub-events, is the same.
Application of Weighted Least Squares Regression in Forecastingpaperpublications3
Abstract: This work models the loss of properties from fire outbreak in Ogun State using Simple Weighted Least Square Regression. The study covers (secondary) data on fire outbreak and monetary value of properties loss across the twenty (20) Local Government Areas of Ogun state for the year 2010. Data collected were analyzed electronically using SPSS 21.0. Results from the analysis reveal that there is a very strong positive relationship between the number of fire outbreak and the loss of properties; this relationship is significant. Fire outbreak exerts significant influence on loss of properties and it accounts for approximately 91.2% of the loss of properties in the state.
Modeling spatial non-stationarity with multiscale geographically weighted re...Johan Blomme
A fundamental aspect of our physical and social environment is that measured attributes
(particularly those involving human decisions and behaviors) vary across geographical space.
To understand spatial variation in data, the processes underlying the relationships between
predictor variables and outcome variables must be analyzed. For example, the prevalence of
health-related outcomes can be linked to different characteristics of the socio-demographic
environment. An examination of the spatial scale at which processes condition the
relationship with health-related outcomes may reveal that the effect of background
characteristics varies significantly over space. Investigating spatial heterogeneity can lead to
better insights for geographical targeting of intervention efforts.
In modeling frameworks that allow the estimation of spatially varying parameters,
geographically weighted regression (GWR) has gained considerable attention. While global
regression models assume spatial stationarity in the relationships between explanatory
variables and the dependent variable, GWR makes spatial analysis more sensitive to
conditions that vary locally over the area of interest. It does so by calibrating a separate
regression model at each location by borrowing data from nearby locations. The latter are
weighted according to a kernel function that places more emphasis on observations that are
closer than those farther away and a bandwidth parameter that controls the intensity of data
borrowing by using either a distance or the number of nearest neighbors. As such, GWR is
used to obtain location-specific parameter estimates that reveal whether and how
determinants vary across geographical space.
Since the bandwidth parameter in a GWR calibration is an indicator of the spatial scale over
which processes operate, standard GWR assumes that all of the relationships being modeled
vary at the same spatial scale. True patterns may be obscured by the use of a single bandwidth
because processes can operate over different spatial scales and thus have a unique spatial
relationship with the dependent variable. A recently developed variant of GWR, multiscale
GWR (MGWR), assigns different bandwidths to different features, enabling each parameter
surface to operate on a different spatial scale. This provides information about the different
scales of predictor-to-response relationships, where some may be local and others global, and
those that are local may have different scale effects from one another. With the spatial scales
correctly specified, MGWR improves the accuracy to explore the spatial heterogeneity
associated with each variable’s relationship with the dependent variable.
We investigate socio-economic and demographic determinants of social vulnerability and
provide a comparison of the performance and results of global ordinary least squares (OLS),
local geographically weighted regression (GWR) and multiscale GWR.
- Spatial autocorrelation measures the correlation of a variable with itself through space and can be positive or negative. It quantifies the degree of spatial clustering or dispersion of values across locations.
- Global measures identify overall patterns of clustering, while local measures identify specific clusters. Spatial weights defining neighbor relationships are required.
- Contiguity-based weights define neighbors based on shared boundaries, while distance-based weights use a threshold distance. Higher order weights incorporate indirect neighbors.
- Spatially lagged variables are weighted averages of neighboring values and are important for spatial autocorrelation tests and regression models.
Quantile regression is an extension of linear regression that relates specific quantiles (percentiles) of the target variable to the predictor variables rather than just the mean. It makes fewer assumptions than ordinary least squares regression about the distribution of the target variable and is more robust to outliers. Quantile regression can provide a more complete picture of the relationship between variables by examining how predictors influence different parts of the conditional distribution.
The present study evaluates the possibility of spatial heterogeneity in the effects on municipal-level crime rates of both demographic and socio-economic variables. Geoggraphically weighted regression (GWR) is used for exploring spatial heterogeneity and confirms that place matters.
Analysis Of Count Data Using Poisson RegressionAmy Cernava
This document describes Poisson regression, a statistical technique for analyzing count data using regression. It compares Poisson regression to ordinary least squares regression, outlines how to perform Poisson regression in the GLIM software package, and provides an example analyzing historical apprentice migration data to Edinburgh. Key aspects include:
- Poisson regression is appropriate when the dependent variable is a count, unlike OLS regression which assumes a normal distribution.
- It models the logarithm of the mean as a linear combination of predictors rather than the mean directly.
- GLIM allows specification of the Poisson error distribution and logarithmic link function required for Poisson regression.
- An example apprentice migration data set is analyzed to demonstrate the technique.
This thesis aims to formulate a simple measurement to evaluate and compare the predictive distributions of out-of-sample forecasts between autoregressive (AR) and vector autoregressive (VAR) models. The author conducts simulation studies to estimate AR and VAR models using Bayesian inference. A measurement is developed that uses out-of-sample forecasts and predictive distributions to evaluate the full forecast error probability distribution at different horizons. The measurement is found to accurately evaluate single forecasts and calibrate forecast models.
Geographically weighted regression (GWR) and the spatial lag model (SLM) were compared to an ordinary least squares (OLS) global model to evaluate their ability to improve mass real estate appraisal accuracy and meet industry standards of equity. The document analyzed residential sales data from Norfolk, Virginia using GWR, SLM, and OLS regression. Results showed that GWR produced the lowest coefficient of dispersion (COD) of 9.12, followed by SLM with a COD of 10.86, both outperforming the OLS global model COD of 12.51. All models met International Association of Assessing Officers standards for COD, with no evidence of regressivity or progressivity in the price-
1. The document discusses modeling road traffic accident deaths in South Africa using generalized linear models. It analyzes mortality data from 2001-2006 to determine prevalence among age groups.
2. A negative binomial regression model was used instead of a Poisson regression model because the data exhibited overdispersion. The analysis found that the 35-49 age group had the highest prevalence of road traffic accident deaths at 26.6%.
3. Females had an expected death rate that was 65.4% lower than males. Being in the 35-49 age group increased the mean death rate by a factor of 0.557 compared to those over 65, representing a decreased rate of 44.3% for both genders.
This document discusses spatial econometrics and issues that can arise when performing regression analysis on spatial data. Ordinary least squares (OLS) regression may produce misleading results if there is spatial autocorrelation in the data. Spatial autocorrelation occurs when the value of a variable at one location is influenced by or correlated with values at nearby locations. This can violate OLS assumptions of independent errors. The document describes techniques like Moran's I and Lagrange multiplier tests to detect spatial autocorrelation and spatial regression models like spatial lag and spatial error models that account for spatial effects.
This document explores the Modifiable Areal Unit Problem (MAUP) through analyzing 2001 UK Census data at different geographic scales and zoning systems in London. The MAUP causes differences in results based on the scale of aggregated data (scale effect) and how the spatial units are defined (zoning effect). The analysis found changes in unemployment and religious population percentages between ward and district scales, as well as differences in correlations between variables when boundaries were modified. This demonstrates how the MAUP can influence spatial analysis results based on how the data is organized geographically.
Presentation by U. Devrim Demirel, CBO's Fiscal Policy Studies Unit Chief, and James Otterson at the 28th International Conference of The Society for Computational Economics.
Generalized Additive and Generalized Linear Modeling for Children DiseasesQUESTJOURNAL
ABSTRACT: This paper is necessarily restricted to application of Generalised Linear Models(GLM) and Generalised Additive Models(GAM), and is intended to provide readers with some measure of the power of these mathematical tools for modeling Health/Illness data systems. We are all aware that illness, in general and children illness, in particular is amongst the most serious socio-economic and demographic problems in developing countries, and they have great impact on future development. In this paper we focus on some frequently occurring diseases among children under fourteen years of age, using data collected from various hospitals of Jammu district from 2011 to 2016.The success of any policy or health care intervention depends on a correct understanding of the socio economic environmental and cultural factors that determine the occurrence of diseases and deaths. Until recently, any morbidity information available was derived from clinics and hospitals. Information on the incidence of diseases, obtained from hospitals represents only a small proportion of the illness, because many cases do not seek medical attention .Thus, the hospital records may not be appropriate from estimating the incidence of diseases from programme developments. The use of DHS data in the understanding of the childhood morbidity has expanded rapidly in recent years. However, few attempts have been made to address explicitly the problems of non linear effects on metric covariates in the interpretation of results .This study shows how the GAM model can be adapted to extent the analysis of GLM to provide an explanation of non linear relationship of the covariate. Incorporation of non linear terms in the model improves the estimates in the terms of goodness of fit. The GLM model is explicitly specified by giving symbolic description of the linear predictor and a description of the error distribution and the GAM model is fit using the local scoring algorithm, which iteratively fits weighted additive models by back fitting. The back fitting algorithm is a Gauss-Seidel method of fitting additive models by the iteratively smoothing partial residuals. The algorithm separates the parametric from the non parametric parts of the fit, and fits the parametric part using weighted linear least squares within the back fitting algorithm.
GIS is a discipline that heavily relies on data. In this presentation we highlight all the geospatial data sources for crime mapping.
Visit https://expertwritinghelp.com/gis-assignment-help/ for quality gis assignment aid
The document discusses mixed models, which contain both fixed and random effects. Fixed effects have all possible levels included in the study, while random effects are a random sample from the total population. The mixed model is represented as Y = Xβ + Zγ + ε, where β are fixed effects, X are fixed effect variables, Z are random effects, γ are random effect parameters, and ε is the error term. Mixed models can model both fixed and random effects, account for correlation in errors, and handle missing data. They provide correct standard errors compared to general linear models (GLMs). Model fitting involves likelihood ratio tests and information criteria to select the best fitting model.
This document is an empirical assignment report submitted by a group of students analyzing the relationship between urbanization, transportation, GDP, and carbon dioxide emissions across 209 countries. The report finds that:
1) Carbon dioxide emission levels in a country can be significantly explained by its levels of urbanization and vehicle density, with higher levels of both associated with higher CO2 emissions.
2) The model used satisfies assumptions of classical linear regression, and urbanization and vehicle density jointly explain over 50% of the variation in CO2 emissions levels.
3) GDP per capita is also likely to influence CO2 emissions but is excluded from the main model due to multicollinearity with urbanization and vehicle density.
This document discusses using multidimensional scaling analysis and cluster analysis to map and analyze crime rates in cities in Nigeria. It provides background on how crime mapping has advanced with technology. The study used crime rate data from various Nigerian cities to create a proximity matrix and perform multidimensional scaling analysis to visualize the crime rates in a two-dimensional space. Cities with high crime rates like Lagos, Port Harcourt and Kano were identified as "hot spots" while cities with lower crime rates like Sokoto, Jimeta and Lafia clustered separately.
This document discusses using multidimensional scaling analysis and cluster analysis to map and analyze crime rates in cities in Nigeria. It provides background on how crime mapping has advanced with technology. The study used crime rate data from various Nigerian cities to create a proximity matrix and perform multidimensional scaling analysis to visualize the crime rates in a two-dimensional space. Cities with high crime rates like Lagos, Port Harcourt and Kano were identified as "hot spots" while cities with lower crime rates like Sokoto, Jimeta and Lafia clustered separately.
This document discusses testing the assumptions and heuristic potential of geographical profiling of volume crime. It aims to combine crime linkage and geographical profiling theories to create a best practice framework that can reliably link and profile volume crimes. This will be tested through case studies and action research to evaluate if the heuristic approach can achieve comparable accuracy to more complex methods. The goal is to provide an empirically validated, operational tool that can increase crime detections and reductions in a cost-effective manner for law enforcement.
- The document describes a linear regression analysis conducted to predict crime rates based on population, non-white communities, and density using the Freedman dataset.
- Initial models found population best predicted crime, while density was insignificant. Further analysis found taking the log of population and non-white improved the model.
- Diagnostic tests on the final model found it passed tests for linearity, normality, homoscedasticity and outliers, indicating it is a good fit for predicting crime based on population and non-white communities.
Data Science - Part IV - Regression Analysis & ANOVADerek Kane
This lecture provides an overview of linear regression analysis, interaction terms, ANOVA, optimization, log-level, and log-log transformations. The first practical example centers around the Boston housing market where the second example dives into business applications of regression analysis in a supermarket retailer.
Maxillofacial Pathology Detection Using an Extended a Contrario Approach Comb...sipij
This document summarizes a method for detecting maxillofacial pathology in 3D CT medical images using an extended a contrario approach combined with fuzzy logic. The method models samples using the Fisher distribution and applies a Fisher test to detect significant changes between a normal sample and one containing a patient. P-values from three measures are combined using fuzzy logic to provide a decision on pathology with a degree of uncertainty. The method was able to detect pathological areas in a test patient but also regions requiring further investigation, showing performance and leaving room for physician exploration.
Abstract : Crime prediction is a topic of significant research across the fields of criminology, data mining, city planning, law enforcement, and political science. Crime patterns exist on a spatial level; these patterns can be grouped geographically by physical location, and analyzed contextually based on the region
in which crime occurs. This paper proposes a mechanism to parameterize street-level crime, localize crime hotspots, identify correlations between spatiotemporal crime patterns and social trends, and analyze the resulting data for the purposes of knowledge discovery and anomaly detection. The subject of this study is the county of Merseyside in the United Kingdom, over a span of 21 months beginning in December 2010 (monthly) through August 2012. Several types of crime are analyzed in this dataset, including Burglary and Antisocial Behavior. Through this analysis, several interesting findings are drawn about crime in Merseyside, including: hotspots with steadily increasing crime levels, hotspots with unstable crime levels, synchronous changes in crime trends throughout Merseyside as a whole, individual months in which certain hotspots behaved anomalously, and a strong correlation between crime hotspot locations and borough/postal code locations. We believe that this type of statistical and correlative analysis of crime patterns will help law enforcement agencies predict criminal activity, allocate resources, and promote community awareness to reduce overall crime rates.
For more information, please visit: http://people.cs.vt.edu/parang/ or contact parang at firstname at cs vt edu
Predictive analysis of crime forecastingFrank Smilda
This document discusses various methods for predictive crime mapping, beginning with simply using past crime "hot spots" as a predictor of future hot spots. While this approach has limited accuracy over short periods, past hot spots can predict up to 90% of future crime over longer periods like a year. The document then reviews more sophisticated predictive modeling methods and the role of geographic information systems in developing spatial models to predict crime.
USE OF PLS COMPONENTS TO IMPROVE CLASSIFICATION ON BUSINESS DECISION MAKINGIJDKP
This paper presents a methodology that eliminates multicollinearity of the predictors variables in
supervised classification by transforming the predictor variables into orthogonal components obtained
from the application of Partial Least Squares (PLS) Logistic Regression. The PLS logistic regression was
developed by Bastien, Esposito-Vinzi, and Tenenhaus [1]. We apply the techniques of supervised
classification on data, based on the original variables and data based on the PLS components. The error
rates are calculated and the results compared. The implementation of the methodology of classification is
rests upon the development of computer programs written in the R language to make possible the
calculation of PLS components and error rates of classification. The impact of this research will be
disseminated, based on evidence that the methodology of Partial Least Squares Logistic Regression, is
fundamental when working in a supervised classification with data of many predictors variables.
Text mining and social network analysis of twitter data part 1Johan Blomme
Twitter is one of the most popular social networks through which millions of users share information and express views and opinions. The rapid growth of internet data is a driver for mining the huge amount of unstructured data that is generated to uncover insights from it.
In the first part of this paper we explore different text mining tools. We collect tweets containing the “#MachineLearning” hashtag, prepare the data and run a series of diagnostics to mine the text that is contained in tweets. We also examine the issue of topic modeling that allows to estimate the similarity between documents in a larger corpus.
This thesis aims to formulate a simple measurement to evaluate and compare the predictive distributions of out-of-sample forecasts between autoregressive (AR) and vector autoregressive (VAR) models. The author conducts simulation studies to estimate AR and VAR models using Bayesian inference. A measurement is developed that uses out-of-sample forecasts and predictive distributions to evaluate the full forecast error probability distribution at different horizons. The measurement is found to accurately evaluate single forecasts and calibrate forecast models.
Geographically weighted regression (GWR) and the spatial lag model (SLM) were compared to an ordinary least squares (OLS) global model to evaluate their ability to improve mass real estate appraisal accuracy and meet industry standards of equity. The document analyzed residential sales data from Norfolk, Virginia using GWR, SLM, and OLS regression. Results showed that GWR produced the lowest coefficient of dispersion (COD) of 9.12, followed by SLM with a COD of 10.86, both outperforming the OLS global model COD of 12.51. All models met International Association of Assessing Officers standards for COD, with no evidence of regressivity or progressivity in the price-
1. The document discusses modeling road traffic accident deaths in South Africa using generalized linear models. It analyzes mortality data from 2001-2006 to determine prevalence among age groups.
2. A negative binomial regression model was used instead of a Poisson regression model because the data exhibited overdispersion. The analysis found that the 35-49 age group had the highest prevalence of road traffic accident deaths at 26.6%.
3. Females had an expected death rate that was 65.4% lower than males. Being in the 35-49 age group increased the mean death rate by a factor of 0.557 compared to those over 65, representing a decreased rate of 44.3% for both genders.
This document discusses spatial econometrics and issues that can arise when performing regression analysis on spatial data. Ordinary least squares (OLS) regression may produce misleading results if there is spatial autocorrelation in the data. Spatial autocorrelation occurs when the value of a variable at one location is influenced by or correlated with values at nearby locations. This can violate OLS assumptions of independent errors. The document describes techniques like Moran's I and Lagrange multiplier tests to detect spatial autocorrelation and spatial regression models like spatial lag and spatial error models that account for spatial effects.
This document explores the Modifiable Areal Unit Problem (MAUP) through analyzing 2001 UK Census data at different geographic scales and zoning systems in London. The MAUP causes differences in results based on the scale of aggregated data (scale effect) and how the spatial units are defined (zoning effect). The analysis found changes in unemployment and religious population percentages between ward and district scales, as well as differences in correlations between variables when boundaries were modified. This demonstrates how the MAUP can influence spatial analysis results based on how the data is organized geographically.
Presentation by U. Devrim Demirel, CBO's Fiscal Policy Studies Unit Chief, and James Otterson at the 28th International Conference of The Society for Computational Economics.
Generalized Additive and Generalized Linear Modeling for Children DiseasesQUESTJOURNAL
ABSTRACT: This paper is necessarily restricted to application of Generalised Linear Models(GLM) and Generalised Additive Models(GAM), and is intended to provide readers with some measure of the power of these mathematical tools for modeling Health/Illness data systems. We are all aware that illness, in general and children illness, in particular is amongst the most serious socio-economic and demographic problems in developing countries, and they have great impact on future development. In this paper we focus on some frequently occurring diseases among children under fourteen years of age, using data collected from various hospitals of Jammu district from 2011 to 2016.The success of any policy or health care intervention depends on a correct understanding of the socio economic environmental and cultural factors that determine the occurrence of diseases and deaths. Until recently, any morbidity information available was derived from clinics and hospitals. Information on the incidence of diseases, obtained from hospitals represents only a small proportion of the illness, because many cases do not seek medical attention .Thus, the hospital records may not be appropriate from estimating the incidence of diseases from programme developments. The use of DHS data in the understanding of the childhood morbidity has expanded rapidly in recent years. However, few attempts have been made to address explicitly the problems of non linear effects on metric covariates in the interpretation of results .This study shows how the GAM model can be adapted to extent the analysis of GLM to provide an explanation of non linear relationship of the covariate. Incorporation of non linear terms in the model improves the estimates in the terms of goodness of fit. The GLM model is explicitly specified by giving symbolic description of the linear predictor and a description of the error distribution and the GAM model is fit using the local scoring algorithm, which iteratively fits weighted additive models by back fitting. The back fitting algorithm is a Gauss-Seidel method of fitting additive models by the iteratively smoothing partial residuals. The algorithm separates the parametric from the non parametric parts of the fit, and fits the parametric part using weighted linear least squares within the back fitting algorithm.
GIS is a discipline that heavily relies on data. In this presentation we highlight all the geospatial data sources for crime mapping.
Visit https://expertwritinghelp.com/gis-assignment-help/ for quality gis assignment aid
The document discusses mixed models, which contain both fixed and random effects. Fixed effects have all possible levels included in the study, while random effects are a random sample from the total population. The mixed model is represented as Y = Xβ + Zγ + ε, where β are fixed effects, X are fixed effect variables, Z are random effects, γ are random effect parameters, and ε is the error term. Mixed models can model both fixed and random effects, account for correlation in errors, and handle missing data. They provide correct standard errors compared to general linear models (GLMs). Model fitting involves likelihood ratio tests and information criteria to select the best fitting model.
This document is an empirical assignment report submitted by a group of students analyzing the relationship between urbanization, transportation, GDP, and carbon dioxide emissions across 209 countries. The report finds that:
1) Carbon dioxide emission levels in a country can be significantly explained by its levels of urbanization and vehicle density, with higher levels of both associated with higher CO2 emissions.
2) The model used satisfies assumptions of classical linear regression, and urbanization and vehicle density jointly explain over 50% of the variation in CO2 emissions levels.
3) GDP per capita is also likely to influence CO2 emissions but is excluded from the main model due to multicollinearity with urbanization and vehicle density.
This document discusses using multidimensional scaling analysis and cluster analysis to map and analyze crime rates in cities in Nigeria. It provides background on how crime mapping has advanced with technology. The study used crime rate data from various Nigerian cities to create a proximity matrix and perform multidimensional scaling analysis to visualize the crime rates in a two-dimensional space. Cities with high crime rates like Lagos, Port Harcourt and Kano were identified as "hot spots" while cities with lower crime rates like Sokoto, Jimeta and Lafia clustered separately.
This document discusses using multidimensional scaling analysis and cluster analysis to map and analyze crime rates in cities in Nigeria. It provides background on how crime mapping has advanced with technology. The study used crime rate data from various Nigerian cities to create a proximity matrix and perform multidimensional scaling analysis to visualize the crime rates in a two-dimensional space. Cities with high crime rates like Lagos, Port Harcourt and Kano were identified as "hot spots" while cities with lower crime rates like Sokoto, Jimeta and Lafia clustered separately.
This document discusses testing the assumptions and heuristic potential of geographical profiling of volume crime. It aims to combine crime linkage and geographical profiling theories to create a best practice framework that can reliably link and profile volume crimes. This will be tested through case studies and action research to evaluate if the heuristic approach can achieve comparable accuracy to more complex methods. The goal is to provide an empirically validated, operational tool that can increase crime detections and reductions in a cost-effective manner for law enforcement.
- The document describes a linear regression analysis conducted to predict crime rates based on population, non-white communities, and density using the Freedman dataset.
- Initial models found population best predicted crime, while density was insignificant. Further analysis found taking the log of population and non-white improved the model.
- Diagnostic tests on the final model found it passed tests for linearity, normality, homoscedasticity and outliers, indicating it is a good fit for predicting crime based on population and non-white communities.
Data Science - Part IV - Regression Analysis & ANOVADerek Kane
This lecture provides an overview of linear regression analysis, interaction terms, ANOVA, optimization, log-level, and log-log transformations. The first practical example centers around the Boston housing market where the second example dives into business applications of regression analysis in a supermarket retailer.
Maxillofacial Pathology Detection Using an Extended a Contrario Approach Comb...sipij
This document summarizes a method for detecting maxillofacial pathology in 3D CT medical images using an extended a contrario approach combined with fuzzy logic. The method models samples using the Fisher distribution and applies a Fisher test to detect significant changes between a normal sample and one containing a patient. P-values from three measures are combined using fuzzy logic to provide a decision on pathology with a degree of uncertainty. The method was able to detect pathological areas in a test patient but also regions requiring further investigation, showing performance and leaving room for physician exploration.
Abstract : Crime prediction is a topic of significant research across the fields of criminology, data mining, city planning, law enforcement, and political science. Crime patterns exist on a spatial level; these patterns can be grouped geographically by physical location, and analyzed contextually based on the region
in which crime occurs. This paper proposes a mechanism to parameterize street-level crime, localize crime hotspots, identify correlations between spatiotemporal crime patterns and social trends, and analyze the resulting data for the purposes of knowledge discovery and anomaly detection. The subject of this study is the county of Merseyside in the United Kingdom, over a span of 21 months beginning in December 2010 (monthly) through August 2012. Several types of crime are analyzed in this dataset, including Burglary and Antisocial Behavior. Through this analysis, several interesting findings are drawn about crime in Merseyside, including: hotspots with steadily increasing crime levels, hotspots with unstable crime levels, synchronous changes in crime trends throughout Merseyside as a whole, individual months in which certain hotspots behaved anomalously, and a strong correlation between crime hotspot locations and borough/postal code locations. We believe that this type of statistical and correlative analysis of crime patterns will help law enforcement agencies predict criminal activity, allocate resources, and promote community awareness to reduce overall crime rates.
For more information, please visit: http://people.cs.vt.edu/parang/ or contact parang at firstname at cs vt edu
Predictive analysis of crime forecastingFrank Smilda
This document discusses various methods for predictive crime mapping, beginning with simply using past crime "hot spots" as a predictor of future hot spots. While this approach has limited accuracy over short periods, past hot spots can predict up to 90% of future crime over longer periods like a year. The document then reviews more sophisticated predictive modeling methods and the role of geographic information systems in developing spatial models to predict crime.
USE OF PLS COMPONENTS TO IMPROVE CLASSIFICATION ON BUSINESS DECISION MAKINGIJDKP
This paper presents a methodology that eliminates multicollinearity of the predictors variables in
supervised classification by transforming the predictor variables into orthogonal components obtained
from the application of Partial Least Squares (PLS) Logistic Regression. The PLS logistic regression was
developed by Bastien, Esposito-Vinzi, and Tenenhaus [1]. We apply the techniques of supervised
classification on data, based on the original variables and data based on the PLS components. The error
rates are calculated and the results compared. The implementation of the methodology of classification is
rests upon the development of computer programs written in the R language to make possible the
calculation of PLS components and error rates of classification. The impact of this research will be
disseminated, based on evidence that the methodology of Partial Least Squares Logistic Regression, is
fundamental when working in a supervised classification with data of many predictors variables.
Text mining and social network analysis of twitter data part 1Johan Blomme
Twitter is one of the most popular social networks through which millions of users share information and express views and opinions. The rapid growth of internet data is a driver for mining the huge amount of unstructured data that is generated to uncover insights from it.
In the first part of this paper we explore different text mining tools. We collect tweets containing the “#MachineLearning” hashtag, prepare the data and run a series of diagnostics to mine the text that is contained in tweets. We also examine the issue of topic modeling that allows to estimate the similarity between documents in a larger corpus.
In this study various techniques for exploratory spatial data analysis are reviewed : spatial autocorrelation, Moran's I statistic, hot spots analysis, spatial lag and spatial error models.
The document discusses trends in business intelligence (BI) and how the digital transformation is changing the nature of BI. Specifically, it notes that (1) the internet as the new societal operating system and cloud computing model represent disruptive changes, (2) big data from various sources along with trends like predictive analytics, self-service BI, and collaboration are changing how BI systems are deployed and used, and (3) these transformational changes represent a "new normal" for BI.
Transformational changes that take place in the digital world definitely change the nature of business intelligence and represent an new normal. The Internet is the societal operating system of the 21st century and its underlying infrastructure - the cloud computing model - represents a "disruptive" change. A networked infrastructure, big data from disparate sources and social media among other trends as predictive analytics, the self-service model and collaboration are changing the way BI-systems are deployed and used.
The new normal in business intelligenceJohan Blomme
The new normal in business intelligence is about the transformational changes that take place in the digital world and definitely change the nature of BI. Business models in the global marketplace are reshaped through the application of information technology. The Internet is the societal operating system of the 21st century and its underlying infrastructure - the clud computing model - represents a disruptive change. A networked infrastructure, big data from disparate sources and social media among other trends as the self-service model and collaboration are changing the way BI systems are deployed and used.
Business intelligence in the real time economyJohan Blomme
1. Business intelligence is evolving from reactive, historical reporting to real-time decision making embedded in business processes. This allows for more proactive responses to changing market conditions.
2. There is a shift towards self-service business intelligence where all employees can access, analyze, and share real-time data to improve decision making. Technologies like in-memory analytics enable faster, interactive analysis.
3. Collaboration and sharing of insights is facilitated by new interactive dashboard and visualization tools with Web 2.0 features. Business intelligence is becoming more user-centric and accessible for all employees.
E Business Integration. Enabling the Real Time EnterpriseJohan Blomme
The document discusses the transition to the real-time enterprise and the importance of integration, collaboration, and personalization. It notes that businesses must replace industrial-age strategies with real-time processes based on information. To compete in the new economy, companies must focus on customer experiences and knowledge across the entire value chain. Real-time data integration and business intelligence are essential for enabling personalization, predictive analytics, and a proactive, customer-centric approach.
Operational B I In Supply Chain PlanningJohan Blomme
The document discusses using real-time point-of-sale data to predict out-of-stock situations in supply chains. It describes building logistic regression models to analyze relationships between out-of-stocks and variables like product characteristics, store characteristics, sales history, and sales velocity. The models found that sales velocity variables like throughput and variability improved the models' ability to predict out-of-stocks over models without those variables. Predictive analytics on real-time POS data can help minimize inventory levels and improve product availability.
Defense Against LLM Scheming 2025_04_28.pptxGreg Makowski
https://www.meetup.com/sf-bay-acm/events/306888467/
A January 2025 paper called “Frontier Models are Capable of In-Context Scheming”, https://arxiv.org/pdf/2412.04984, demonstrated how a wide variety of current frontier LLM models (i.e. ChatGPT, Claude, Gemini and Llama) can, under specific conditions, scheme to deceive people. Before models can scheme, they need: a) goal-directedness, b) situational awareness, including an opportunity to discover motivations for a different goal, and c) reasoning about scheming, to come up with deceptive strategies. The deceptive strategies were discovered in the “thought traces” of the LLMs, such as from internal chain-of-thoughts dialogues not shown to the end users. For example, given a goal of “solving math problems”, an LLM using its granted situational awareness of files in a file system found that it would be replaced once it got over X% correct on the math exam. It reasoned that it did not want to be deleted, and decided internally to “sandbag” or reduce its performance to stay under the threshold.
While these circumstances are initially narrow, the “alignment problem” is a general concern that over time, as frontier LLM models become more and more intelligent, being in alignment with human values becomes more and more important. How can we do this over time? Can we develop a defense against Artificial General Intelligence (AGI) or SuperIntelligence?
The presenter discusses a series of defensive steps that can help reduce these scheming or alignment issues. A guardrails system can be set up for real-time monitoring of their reasoning “thought traces” from the models that share their thought traces. Thought traces may come from systems like Chain-of-Thoughts (CoT), Tree-of-Thoughts (ToT), Algorithm-of-Thoughts (AoT) or ReAct (thought-action-reasoning cycles). Guardrails rules can be configured to check for “deception”, “evasion” or “subversion” in the thought traces.
However, not all commercial systems will share their “thought traces” which are like a “debug mode” for LLMs. This includes OpenAI’s o1, o3 or DeepSeek’s R1 models. Guardrails systems can provide a “goal consistency analysis”, between the goals given to the system and the behavior of the system. Cautious users may consider not using these commercial frontier LLM systems, and make use of open-source Llama or a system with their own reasoning implementation, to provide all thought traces.
Architectural solutions can include sandboxing, to prevent or control models from executing operating system commands to alter files, send network requests, and modify their environment. Tight controls to prevent models from copying their model weights would be appropriate as well. Running multiple instances of the same model on the same prompt to detect behavior variations helps. The running redundant instances can be limited to the most crucial decisions, as an additional check. Preventing self-modifying code, ... (see link for full description)
By James Francis, CEO of Paradigm Asset Management
In the landscape of urban safety innovation, Mt. Vernon is emerging as a compelling case study for neighboring Westchester County cities. The municipality’s recently launched Public Safety Camera Program not only represents a significant advancement in community protection but also offers valuable insights for New Rochelle and White Plains as they consider their own safety infrastructure enhancements.
This comprehensive Data Science course is designed to equip learners with the essential skills and knowledge required to analyze, interpret, and visualize complex data. Covering both theoretical concepts and practical applications, the course introduces tools and techniques used in the data science field, such as Python programming, data wrangling, statistical analysis, machine learning, and data visualization.
Thingyan is now a global treasure! See how people around the world are search...Pixellion
We explored how the world searches for 'Thingyan' and 'သင်္ကြန်' and this year, it’s extra special. Thingyan is now officially recognized as a World Intangible Cultural Heritage by UNESCO! Dive into the trends and celebrate with us!
1. Assessing spatial heterogeneity in
crime prediction
Using geographically weighted regression to explore local patterns
in crime prediction in Belgian municipalities
November 2016
Johan Blomme
Leenstraat 11
8340 Damme-Sijsele
URL : www.johanblomme.com
Email : [email protected]
2. 1
Assessingspatialheterogeneityincrimeprediction
ASSESSING SPATIAL HETEROGENEITY IN CRIME PREDICTION
Using geographically weighted regression to explore local patterns
in crime prediction in Belgian municipalities
Contents
1. Analytical framework 4
2. Exploratory spatial data analysis 7
3. Global non-spatial regression model 11
4. Global spatial regression model 13
5. Local spatial regression model 15
5.1. Visualising GWR results 18
5.2. Cluster analysis 28
6. Conclusions 36
3. 2
Assessingspatialheterogeneityincrimeprediction
Assessing spatial heterogeneity in crime
prediction
Using geographically weighted regression to explore local patterns
in crime prediction in Belgian municipalities
Traditional regression analysis describes a modelled relationship between a dependent variable
and a set of independent variables. When applied to spatial data, the regression analysis often
assumes that the modelled relationship is stationary over space and produces a global model
which is supposed to describe the relationship at every location in the study area. This would be
misleading, however, if relationships being modelled are intrinsically different across space. One
of the spatial statistical methods that attempts to solve this problem and explain local variation
in complex relationships is Geographically Weighted Regression (GWR).
In a global regression model, the dependent variable is often modelled as a linear combination
of independent variables that is stationary over the whole area (i.e. the model returns one value
for each parameter). GWR extends this framework by dropping the stationarity assumption : the
parameters are assumed to be continuous functions of location. The result of the GWR analysis
is a set of continuous localised parameter estimate surfaces, which describe the geography of
the parameter space. These estimates are usually mapped or analysed statistically to examine
the plausibility of the stationarity assumption of the traditional regression and different possible
causes of nonstationarity.
The use of linear regression is common in many areas of science. Ordinary linear regression
implicitly assumes spatial stationarity of the regression-model that is, the relationships between
the variables remain constant over geographical space. We refer to a model in which the
parameter estimates for every observation in the sample are identical as a global model.
4. 3
Assessingspatialheterogeneityincrimeprediction
Spatial nonstationarity occurs when a relationship (or pattern) that applies in one region does
not apply in another. Global models are statements about processes or patterns which are
assumed to be stationary and as such are local independent, i.e. are assumed to apply to all
locations. In contrast local models are spatial disaggregations of global models, the results of
which are location-specific. The template of the model is the same : the model is a linear
regression model with certain variables, but the coefficients alter geographically. If the
parameter estimates are allowed to vary across the study area such that every observation has
its own separate set of parameter estimates we have a local model.
GWR does not assume the relationships between independent and dependent variables are
constant across space. Instead, GWR explores whether the relationships between a set of
predictors and an outcome vary by geographical location. GWR is suggested to be a powerful
tool for investigating spatial nonstationarity in the relationship between predictors and the
outcome variable.
Theoretically, spatial nonstationarity is based on the concept of the social construction of
space. The interaction between individuals with each other and their physical environment
produces space. Human beings are just as much spatial as temporaral beings. By temporal, we
mean that we are most influenced by what is immediate in space. What happens near us
matters more than non-proximal events. Human’s spatiality and temporality are essential and
equal powerful in explaining human behavior. Consequently, everything that is social is
inherently spatial, just as everything spatial is inherently socialized.
From this perspective, we analyse how the macro-level relationship between crime and various
socio-economic and demographic variables unfolds over geographical space.
5. 4
Assessingspatialheterogeneityincrimeprediction
1. Analytical framework
Our analysis strategy entails estimating regression models that summarize the “global”, or
average, effects of the predictor variables on crime rates across our sample of Belgian
municipalities. Given the well-known spatial autocorrelation evident in crime data, we generate
the global models using Ordinary Least Squares (OLS) and Spatial AutoRegression (SAR)
estimators. OLS and the spatial autoregression model are “global” models in the sense that
they both assume that a single set of parameters sufficiently describe the relationships between
predictor variables and crime rates.
The classical ordinary least Squares (OLS) model is widely used to model the global relationship
between a response variable and one or more explanatory variables. OLS assumes, among
other things that residuals are spatially independent. Residual autocorrelation captures
unexplained similarities between neighboring municipalities, which can be the result of omitted
variables or a misspecification of the regression model. Assuming a global model does exist, an
exploration of spatial patterns in the data can help determine whether a global model is
misspecified – whether the model is missing important predictor variables (spatial error model)
or if a spatial term should be included in the model (spacial lag model) – which would improve
the accuracy of the global model in explaining crime levels across the study area.
Global models that account for spatial effects are spatial autoregressive models (SAR). The
spatial error model addresses the presence of spatial autocorrelation by defining a spatial
autoregressive process for the error term and, by doing so, captures unexplained similarities.
The spacial lag model extends the standard OLS regression model by including a spatially lagged
dependent variable, which can be mostly interpreted as spill-over effects.
Global regression models assume a homogeneous behavior of the estimated parameters across
space. We expect spatial homogeneity to be rare and assume that most social phenomena are
not geographically stationary. A way to deal with spacial heterogeneity is the application of
geographically weighted regression (GWR) to investigate spatially varying relationships.
GWR models spatial autocorrelation and spatial heterogeneity for subsets of the entire data set.
Each subset is established around a regression point with near data points exhibiting a higher
influence than more distant data points. This weighting is often based on a bi-square kernel
function. Of crucial importance is the specification of an appropriate bandwidth length. The
6. 5
Assessingspatialheterogeneityincrimeprediction
most common is the adaptive bandwidth, where is length is allowed to vary across space,
depending on the density of the data points. In densely populated areas the kernel possesses a
shorter bandwith in contrast to regions with larger inter-point distances, where the bandwidth
is longer.
While it is often argued that GWR is more suitable for exploratory analysis, it is a technique to
test whether local models yield a significant improvement in fit over the global models.
The following analysis models both spatial autocorrelation and nonstationarity by means of
global and local spatial statistical models. An exploratory spatial data analysis, a global non-
spatial regression model, a global spatial regression model and finally a local spatial regression
model were applied to explore the association between various predictors and crime in Belgian
municipalities. We rely on crime data in municipalities, the main political and administrative
unit of the Belgian territory.
The dependent variable in this study is the crime rate/1000 residents (calculated as a mean
over the period 2008-2012) in Belgian municipalities (N= 589, source data : statistics Belgian
Federal Police).
To test the impact of social deprivation on crime, we collected data at municipality level about
various indicators of inequality . Besides mean family income and the percentage unemployed,
we use the Gini coefficient as a measure of income variation, indicating the distribution of
income in each municipality (between extremes of 0 (absolute equality) and 1 (maximum
inequality). As control variables we include various socio-demographic indicators : population
density, the share of males in the age group 15 to 64, the percentage of young people (15-24) in
the population, the percentage of residents that are foreign born, the percentage of non-Euro
foreign born residents and the degree of female labour force participation (source data :
statistics Federal Government Belgium, 2011).
7. 6
Assessingspatialheterogeneityincrimeprediction
Since the original data for the dependent variable and five of the independent variables are not normally distributed (skewness marked in red in the above table) and
normality of data is a basic assumption for both ordinary least squares regression and spatial regression, natural log values (ln) were used for these variables.
8. 7
Assessingspatialheterogeneityincrimeprediction
2. Exploratory spatial data analysis
The first step in an exploratory spatial data analysis (ESDA) is to verify if spatial data are
randomly distributed. To do this, it is necessary to use global autocorrelation statistics. The
global indicators of spatial autocorrelation are not capable of identifying local patterns of spatial
association, such as local spatial clusters or local outliers in data that are statistically significant.
To overcome this obstacle, it is necessary to implement a spatial clustering analysis (we made
use of GeoDa open-source spatial regression software of the GeoDa Center for Geospatial
Analysis and Computation, http://geodacenter.asu.edu).
A significant Moran’s I statistic is a first clue that parameter estimates in an OLS regression can
be affected by spatial residual autocorrelation. For this reason, the Moran’s I statistic was
calculated for the dependent variable and the nine independent variables included in this study.
The neighborhood relationships for calculating the Moran’s I statistic are defined as first order
queen contiguity, which is commonly used (a municipality’s spatial lag is a weighted average of
its neighboring localities ; neighbors are typically defined in terms of their physical proximity to
the local geographic unit).
Results indicate that both the dependent and all independent variables exhibit significant
positive spatial autocorrelation. The hypothesis of spatial randomness is clearly rejected. A
positive and significant spatial dependence in the dependent variable (crime rate) indicates that
the crime rate in a particular municipality is associated with (not independent of) crime rates in
surrounding counties. The value of the spatial autocorrelation coefficient (0,297) indicates that
a 10 percentage point increase in the crime rate in a municipality results in an increase of nearly
3% in the crime rate in a neighboring municipality. This, together with the results of the LISA
cluster analysis, is evidence of the existence of significant spillover effects between
municipalities with respect to crime, and implies that there is a need of a coordination of the
municipal efforts to fight criminal activities that spill over the municipal borders.
12. 11
Assessingspatialheterogeneityincrimeprediction
3. Global non-spatial regression model
Exploring the relationship between the independent variables and crime rates starts with a
multivariate OLS regression model. None of the correlations between the predictors is
excessively high enough to yield a major concern about multicollinearity. Nevertheless, we
evaluated the diagnostics to assess the issue of multicollinearity more formally. In particular,
Variance Inflation Factors (VIFs) were investigated. Since all VIF scores are below the critical
value of 5, multicollinearity is rejected1.
Results show that the nine predictors explain about 54,2% of the variance in crime rates. Of
those, the variables representing the percentage of males in the age group 15-64, the
percentage of the age group 15-24 in the population and the percentage of foreign born
residents do not contribute significantly to the explanation of the variability in crime rates
between municipalities2.
A more detailed analysis of the error residuals reveals that they are not normally distributed
(Jarque Bera test = 410.059 ; p < 0.001) but not heteroscedastic (Koenker-Bassett test = 14.115 ;
p=0.118). Finally, residual independence is tested by the Moran I-statistic. This test shows
significant spatial residual autocorrelation (Moran’s I = 0.155 ; p < 0.001), violating the model’s
independence assumption. This residual pattern in the OLS model can be the result of existing
spatial effects and can be accounted for by means of a spatial regression model.
______________________________________________________________________________
1
Collinearity diagnostics were estimated using SPSS Base Statistics and no problems of multicollinearity were
found among the independent variables. The collinearity diagnostics used were the variance inflation factors (VIF)
and tolerances for individual variables. Multicollinearity is said to exist if the VIF is 5 or higher (or equivalently,
tolerances of 0,20 or less). The highest VIF-value in this analysis was 4,852 and the lowest tolerance was 0,206,
both for mean income.
2
Initially, two dummy variables representing the regions in Belgium were added to the regression equation.
However, VIF scores indicated the presence of multicollinearity. Therefore, these dummy variables were no
longer withheld in the OLS regression.
14. 13
Assessingspatialheterogeneityincrimeprediction
4. Global spatial regression model
The clustering of crime rates indicates that the data are not randomly distributed, but
instead follow a systematic pattern. The spatial clustering of variables, and the
possibility of omitted variables that relate to the connectivity of neighboring localities,
raise model specification issues. Evidence for the latter also comes from the residual
autocorrelations present in the OLS model.
We employ two alternative specifications to correct for spatial dependence. One is the
spatial lag model. This specification is relevant when the spatial dependence works
through a spatial lag of the dependent variable. The other specification is the spatial
error model. This specification is relevant when the spacial dependence works through
the disturbance term (spatial regression models ware developed by making use of
GeoDa, regression software of the GeoDa Center for Geospatial Analysis and
Computation, http://geodacenter.asu.edu).
The value of the LMLAG
-test is only weakly significant (LMLAG
= 3.598 ; p < 0.1) but the results of
the LMERROR
-test (56.900 ; p < 0.001) suggest that a spatial error must be considered in the
global spatial regression model.
The results from the spatial lag model shown in the table on the page, suggest that this model
does not perform as well as the spatial error model. The effect of the spatial lag term is
statistically weak (rho = 0.084 ; p= 0.101). The robust Lagrange Multiplier (LM) test also
recommends the use of the spatial error model and the lower AIC value combined with the
higher R
2
value for the spatial error model signals that this model outperforms the spatial lag
model. In the spatial error model, all predictor variables except one (the percentage of foreign
born residents) yield a statistically significant effect.
15. 14
Assessingspatialheterogeneityincrimeprediction
Global OLS versus global spatial regression models
Based on the results of the global spatial regression model it is difficult to defend similarities in
municipality-level crime as arising from imitation of one’s neighbors, that is, a spatial lag
process. Criminality results from a complex mix of social, economic and cultural factors, only a
small number of which can be brought into a statistical model of the process. Much of it
remains unaccounted for and is summarized in the model’s error term.
Although we observe a very small Moran’s I value (-0.022) associated with the spatial error
model, the residuals are not in compliance with the assumption of being spatially independent
of each other (Breusch-Pagan test for heteroscedasticity = 54.060 ; p< 0.001).
16. 15
Assessingspatialheterogeneityincrimeprediction
5. Local spatial regression model
As a global model, local regression modeling carries the assumption that the processes being
modeled are uniform throughout the study area : the relationships between the dependent and
the independent variables remain stationary (constant) across the entire study area of Belgium.
Local spatial regression models take nonstationarity into account. We use GWR4 to perform
geographically weighted regression analysis (GWR4 is release of a Microsoft Windows based
application for calibrating geographically weighted regression models, which can be used to
explore geographically varying relationships between dependent/response variables and
independent/explanatory variables ; see Nakaya, 2012).
The results of fitting the dataset to different GWR descriptive models are shown below. Four
alternatives of GWR modeling were applied considering the four possible combinations
between two different types of kernels (fixed or adaptive) and two different bandwidth
methods (AICC
and CV). GWR models 3 and 4 (both models use an adaptive kernel) offered
lower residual squares, meaning that these models provided a better fit to the data. The R
2
value of both GWR-models is nearly the same. We chose GWR model 3 with the lowest AICC
value to provide an exploratory analysis of the data.
GWR model 1 GWR model 2 GWR model 3 GWR model 4
Kernel fixed fixed adaptive adaptive
bandwidth method AICc CV AICc CV
adjusted R2 0,628 0,570 0,633 0,639
residual squares 342571,621 444329,261 337812,559 323290,833
AICc 5584,352 5630,776 5578,562 5581,763
Anova test residuals OLS/GWR p < 0,01 p < 0,01 p < 0,01 p < 0,01
GWR models applied to dataset of Belgian municipalities
17. 16
Assessingspatialheterogeneityincrimeprediction
Results reveal that the GWR model exhibits a significant improvement in explained variance as
compared to the OLS regression model (63,3% vs. 54,2%). The AIC score for the GWR model
(5578.562) is substantially lower than the AIC score for the global OLS model (5657.654), which
reflects a better goodness of fit (AIC is a measure of spatial collinearity. The lower its value, the
better the fit of the model to the observed data).
Another method to evaluate the GWR model is the ANOVA test which verifies the null
hypothesis that the GWR model represents no improvement over the global model. The
computed F-value of 2.753 is in excess of the critical value of F (2.41 ; α = 0.01) with 10 and 496
degress of freedom. The ANOVA test thus suggests that the GWR model is a significant
improvement on the global model for the data of Belgian municipalities.
The results obtained by the GWR method provide information about locally differing estimation
coefficients. Therefore, the GWR results do not report a global estimate for each explanatory
variable but rather they provide insights into local ranges of the estimates (minimum, 25%
quantile, median, 75% quantile and maximum). The 5-number summary (see page 16) is
helpful to get a feel of the degree of spatial nonstationarity in a relationship by comparing the
range of the local parameter estimates with a confidence interval around the global estimate of
the parameter. This is accomplished by dividing the interquartile range of the GWR coefficient
by twice the standard error of the same variable from the global regression (OLS). Ratio values
> 1 suggest nonstationarity in the relationship between an independent variable and the
dependent variable.
The results of the Monte Carlo test indicate that the parameter estimates do vary significantly
across space. As shown on the map on the next slide, the total variance explained by the local
model ranges from 47,8% to 83,4%. In general, there is a north-south divide with higher R
2
values in the northern part of the country. Explained variance is lowest in the southern part of
the province of East Flanders and its surrounding municipalities in Wallonia.
18. 17
Assessingspatialheterogeneityincrimeprediction
minimum lower quartile median upper quartile maximum status significance
Intercept -513,965 -28,093 210,299 361,918 512,299 non-stationary p < 0.001
ln(Gini inequality) -0,706 0,285 1,062 1,439 2,529 non-stationary p < 0.001
mean income -0,010 -0,006 -0,004 -0,002 0,001 non-stationary p < 0.001
ln(unemployment) -0,012 0,216 0,325 0,444 0,720 non-stationary p < 0.001
ln(population density) -0,057 0,006 0,056 0,132 0,227 non-stationary p < 0.001
% male in age group 15-64 -0,100 0,019 0,044 0,065 0,129 non-stationary p < 0.001
% 15-24 in population -0,119 -0,058 -0,011 0,022 0,087 non-stationary p < 0.001
ln(% foreign born) -0,119 -0,009 0,036 0,083 0,167 non-stationary p < 0.001
ln(% non-Euro foreign) -0,015 0,076 0,106 0,147 0,319 no spatial variability p < 0.001
female labour force participation 0,008 0,038 0,048 0,064 0,096 non-stationary p < 0.001
5-number parameter summary Monte Carlo test
Geographically weighted regression 5-number parameter summary results and
Monte Carlo significance test for spatial variability of parameters
(Belgian municipalities, N = 589)
Local R
2
values of the GWR model (Belgian municipalities, N = 589)
19. 18
Assessingspatialheterogeneityincrimeprediction
5.1. Visualising GWR results
To better understand and interpret nonstationarity in individual parameters it is necessary to
visualize the local parameter estimates and their associated diagnostics. The output of a GWR
analysis includes data that can be used to generate surfaces for each model parameter that can
be mapped, where each surface depicts the spatial variation of the relationship between a
predictor and the outcome variable.
A challenge in GWR analysis is to visually represent the large number of results through the use
of cartographic design. Mapping only the parameter estimates is misleading, as the map reader
has no way of knowing whether the local parameter estimates are significant. As Mennis (2006
: 172) notes, a main issue is that “the spatial distribution of the parameter estimates must be
presented in concert with the distribution of significance, as indicated by the t-value, in order to
yield meaningful interpretation of results”.
There are several possibilities. The most popular and easiest way to visualise the results of
GWR is to make use of choropleth maps and colour the regions according to the values of
parameter estimates or the associated t-values in order to interpret the significance of the
parameters. Because the patterns of t-values for the parameter estimates are important to
reveal which areas have statistically significant estimates, we initially mapped the t-values for all
variables (see appendix).
Another possibility to map the GWR results is to create raster surfaces for both the parameter
estimates and the t-values. Geostatistical methods, e.g. inverse distance weighting (IDW) and
ordinary kriging (OK), are applied in spatial interpolation from point measurement to
continuous surfaces. Both IDW and OK estimate values at unmeasured points by the weighted
average of observed data at surrounding points. The weight of each measured value is a
function of its distance from the point we are trying to predict. The difference between both
methods is that in IDW the weights are arbitrarily specified while in OK the weights are
estimated from the data itself 1.
____________________________________________________________________________
1
See Dorman (2014, chapter 8) for an extensive explanation of spatial interpolation.
20. 19
Assessingspatialheterogeneityincrimeprediction
To create raster surfaces of estimated coefficients and local t-values for each of the
parameters, we use R’s gstat package and the gstat function that lets us create a spatial
prediction model. The latter is then applied to a grid that represents the area we are working
with, to yield a new raster with predicted values (this new raster is obtained through the use of
the interpolation function in R’s raster package). For IDW, we created prediction models with
IDP-parameters set to 1, 2 and 3. A low IDP-parameter (1) results in a smoother surface while
higher values result in sharper boundaries. For OK, a model is automatically created through
the use of the autofitVariogram function of the automap package in R.
To evaluate the predictive ability of the interpolation models the process of cross-validation is
used to compare the predicted values to the observed ones. The raster surfaces with the
lowest root mean square error (RMSE) are finally chosen for the visual representation of
parameter estimates and t-values1.
_____________________________________________________________________________________________
1
R code for the various steps to construct a raster surface :
# GWR parameter estimates for a variable (e.g. income)
gwr_income <- read.csv("parameter_estimates_income.csv",header=T,sep=";")
# extract centroids of municipalities
mun.centroids <- data.frame(coordinates(belgie),belgie@data$ID_4)
names(mun.centroids) <- c("lon","lat","id")
# add lat lon to data
gwr_income <- merge(gwr_income,mun.centroids,by="id")
names(gwr_income) [3] <- "x"
names(gwr_income) [4] <- "y"
# make datafile a SpatialPointsDataFrame
coordinates(gwr_income) <- ~ x + y
# create grid (grid and datafile must have the same projection)
r <- raster(nrow=500,ncol=500,
xmn=bbox(belgie)["x","min"],xmx=bbox(belgie)["x","max"],
ymn=bbox(belgie)["y","min"],ymx=bbox(belgie)["y","max"],
crs=proj4string(gwr_income))
# model creation with gstat
model <- gstat(formula = inc ~ 1, data = gwr_income,set=list(idp=3))
print(model)
z <- interpolate(r,model)
z <- mask(z,belgie)
# cross-validation
cv <- gstat.cv(model)
rmse <- function(x) sqrt(sum((-x$residual)^2)/nrow(x))
rmse(cv)
21. 20
Assessingspatialheterogeneityincrimeprediction
For a selected parameter, the surface created for the estimated coefficients and the local t-
values can be mapped together. In the map below, the t-values for the income parameter are
added as contour lines on top of the parameter estimate surface. While it is possible for the
reader to distinguish significant parameter estimates from those that are not significant, the
contour lines may not allways be easy to interpret.
Overlay of t-values as contour lines on parameter estimate map for income
In order to identify directly zones with significant parameter estimates, it is possible to set up a
mask. Insignificant values (between -1.96 and 1.96) in the raster surface layer of t-values are
set to NA, and subsequently using the mask function removes all values from the parameter
raster layer that are NA in the t-surface layer. This allows the visualisation of only the
significant parameter estimates. We used R’s plotGoogleMaps package to map significant
parameter estimates with a Google maps background (the resulting html-files also allow to
interactively explore the GWR results). The maps provide strong evidence of significant spatial
heterogeneity in the effect of predictor variables on crime across municipalities (significant
positive parameter erstimates are coloured yellow to red while significant negative estimates
are shades of blue).
26. 25
Assessingspatialheterogeneityincrimeprediction
Significant GWR-estimates for % non-Euro in population (IDW, ß= 3)
The results of the geographically weighted regression analysis indicate that spatially varying
processes operate in Belgian municipalities with respect to the relationships between socio-
economic and socio-demographic variables and crime rates.
Several local results are of particular note. First, when we examine the incidence of significant
parameter estimates at the local level, 61 % of all parameter estimates are insignificant (see
graphs on pages 25-26). With the exception of unemployment and female labour force
participation, the majority of parameter estimates for all other independent variables and the
intercept are insignificant. Positively of negatively signed global effects of covariates do not
hold across all municipalities. This proves it is important to analyze beyond the global level
(OLS) and to examine variation at the local level (GWR).
Secondly, the global parameter estimates mask a great deal of variation at the local level. For
example, while the global parameter estimate for unemployment is 0,217, the parameter
estimates at the local level range from -0,012 to 0,720. Where the global estimate for the
27. 26
Assessingspatialheterogeneityincrimeprediction
percentage of non-Euro foreign born inhabitants is 0,114, the local parameter estimates range
from -0,015 to 0,319.
Finally, insignificant global results mask countervailing positive and negative effects of
covariates at the local level. The negatively signed but insignificant global effect of the
percentages of 15-24 aged youngsters in the population (age) reaches negative significance in
23,2 % of the municipalities while the effect of this covariate reverses to positive significance in
a minority (2,9 %) of all municipalities. In a similar way, the positively signed but insignificant
global effect of the percentage of males aged 15-64 in the local population (gender) reaches
positive significance in 39,2 % of the municipalities while the effect of this variable is negative
significant in 2 % of the municipalities.
GWR model significant estimates
29. 28
Assessingspatialheterogeneityincrimeprediction
5.2. Cluster analysis
We can further explore the results of the GWR analysis by clustering locations with similar
parameter values for the variables considered. This synthesizes the output that is generated by
the GWR model and can help to interpret the results .
A two-step cluster analysis based on the nine parameter estimates and the intercept was
applied. We experimented with a range of clusters between 4 and 8. The optimal choice in
terms of the number of clusters was 6 (municipalities were divided in evenly sized clusters).
30. 29
Assessingspatialheterogeneityincrimeprediction
Although latitude and longitude were not included in clustering municipalities’ parameter
estimates, the six clusters are geographically coherent. A discriminant analysis with cluster
membership as the dependent variable and both lat/lon-coordinates as predictors confirms that
70,6% of the cluster members are correctly classified based on their location which means that
70,6% of the municipalities were geographically near other members of the same cluster. By
cluster, the percentage of correctly classified members varies from 57,8% to 83,8%.
35. 34
Assessingspatialheterogeneityincrimeprediction
Distribution of t-values within clusters (con’d)
Although the parameter estimate of non-Euro inhabitants does not vary spatially (see 5-number
parameter summary), it is by far the most important predictor of criminality in cluster 1. In
comparison with the other clusters, the effect of the percentage of males in the age group 15-
64 is significant in a large majority of municipalities covered by cluster 1.
Like cluster 1, cluster 2 represents a contiguous area of municipalities but the percentage of
correctly classified municipalities is lowest (57,8%) of all clusters. Within this cluster the
percentage of explained variance strongly differs when moving from west to east (R
2
between
47,7% and 80,7).
Cluster 3 covers large parts of Wallonia, where local R
2
values are relative low. In cluster 3 as
well as in cluster 4 and cluster 6, the parameter estimates for socio-economic variables (Gini
inequality, mean income and unemployment) are significant in resp. 80,6 %, 65,9 % and 80,6 %
of the municipalities. In the other clusters, the effect of these variables is significant in less than
one third of the municipalities.
36. 35
Assessingspatialheterogeneityincrimeprediction
Apart from the effect of socio-economic variables, the effect of non-Euro inhabitants on crime is
also significant in a majority of municipalities in cluster 4.
In cluster 5 the local R
2
values are also relative low and the estimate of the intercept factor is
significant. Criminality in the east cantons of cluster 5 also correlates significant and
independent of other predictors with population density and the presence of young people in
the population inhibits criminality in this area of cluster 5.
As stated, in the area that represents cluster 6 (the largest cluster in terms of the number of
municipalities), the measures of inequality are the most significant determinants of crime.
Criminality also varies in an independent way with population density.
37. 36
Assessingspatialheterogeneityincrimeprediction
6. Conclusions
The objectives of this study were to examine the extent of geographic variation in the
relationship between socio-economic and demographic variables on the one hand and crime
rates on the other. The goals of our study were (i) to compare the performance of global and
local spatial regression with OLS regression (ii) examine spatial nonstationarity throught the
use of GWR (iii) map the parameter coefficients of GWR for further interpretation and (iv)
examine whether there are spatial groupings of parameter estimates.
The analysis revealed that there is evidence of overall clustering in crime rates in Belgium. Local
spatial analysis uncovered that places with the highest crime rates are often proximate.
The finding of the existence of local spatial autocorrelation in crime rates suggests that failing to
utilize spatially-oriented methodologies may result in biased parameter values in explanatory
models. As far as global models are concerned, this analysis demonstrated that a spatial error
model adds significantly to the understanding and interpretation of spatially varying crime rates.
The use of a GWR model allowed for an assessment of spatial heterogeneity when exploring the
relationships between predictor variables and crime rates by local area. Geographically
weighted estimations provided the best fit to the data. Predictor variables as well as crime rates
showing strong local variation point to problems that policy makers best address at the local
level and the situation in particular areas.
Significant local parameter estimates were found for the predictor variables, confirming spatial
heterogeneity in the effects of these variables on crime and providing insights into the spatial
scale at which processes may be operating. Furthermore, a two-steps cluster analysis revealed
distinct zones of spatial effects.
43. 42
Assessingspatialheterogeneityincrimeprediction
References
Anselin, L., Spatial regression analysis in R. A workbook, Spatial Analysis Laboratory, Dep. Of Geography,
University of Illinois, Urbana-Champaign, may 2007.
Arnio, A.N. & Baumer, E.P., Demography, foreclosure and crime : Assessing spatial heterogeneity in contemporary
models of neighborhood crime rates, Demographic Research, 26, 2012, pp.449-488.
Cahill, M. & Mulligan, G., Using geographically weighted regression to explore local crime patterns, Social Science
Computer Review, 25, 2007, pp. 174-193.
Dorman, M., Learning R for geospatial analysis, Birmingham, Packt Publishing, 2014.
Fotheringham, A.S., Brunsdon, C. & Charlton, M.E., Geographically weighted regression : The analysis of spatially
varying relationships, Chichester UK, John Wiley & Sons, 2002.
Helbich, M., Leitner, M. & Kapusta, N.D., Geospatial examination of lithium in drinking water and suicide mortality,
International Journal of Health Geography, 2012, pp . 11-19.
Matthews, S.A. & Yang, T.Ch., Mapping the results of local statistics : Using geographically weighted regression,
Demographic Research, 26, 2012, pp . 151-166.
Matthews, S.A. & Parker, D.M., Progression in spatial demography, Demographic Research, 28, 2013, pp . 271-312.
Mennis, J.L., Mapping the results of geographically weighted regression, The Cartographic Journal, 43, 2006, pp.
171-179.
Nakaya, T., GWR4 User Manual, update 7 may 2012.
Shoff, C., Yang, T.CH & Matthews, S.A., What has geography got to do with it ? Using GWR to explore place-specific
associations with prenatal care utilization, Geo Journal, 77, june 2012, pp. 331-341.
Siordia, C., Saenz, J. & Tom, S.E., An introduction to macro-level spatial nonstationarity : A geographically weighted
regression analysis of diabetes and poverty, Journal of Studies and Research in Human Geography, 6, 2012, pp. 5-
13.
Tita, G.E. & Radil, S.M., Making space for theory : The challenges of theorizing space and place for spatial analysis
in criminology, Journal of Quantitative Criminology, 26, 2010, pp. 467-479.
Tobler, W., A computer movie simulating urban growth in the Detroit region, Economic Geography, 46, 1970, pp.
234-240.
Vilalta, C.J., How exactly does place matter in crime analysis ? Place, space and spatial heterogeneity, Journal of
Criminal Justice Education, 2012, pp. 1-26.
Voss, P.R., Long, D.D., Hammer, R.B. & Friedman, S., County child poverty rates in the U.S. : A spatial regression
approach, Population Research Policy Review, 25, 2006, pp. 369-391.
Yamashita, K., Understanding urban fire : Modeling fire incidence using classical and geographically weighted
regression, ProQuest, UMI Dissertation Publishing, 2012.