Experimental Evaluation of End-to-End Delay in A Sigfox Network
Experimental Evaluation of End-to-End Delay in A Sigfox Network
4, DECEMBER 2022
TABLE I
S AMPLE OF THE DATA C OLLECTED IN THE DATABASE C ONSIDERING THE S IGFOX M IDDLEWARE (MW) AND THE S ERVER (S)
TABLE II TABLE IV
E ND - TO -E ND T RANSMISSION D ELAY F ROM RP I TO A W EB S ERVER T RANSMISSION D ELAY F ROM THE S ENDER TO THE E MAIL S ERVER
TABLE V
E ND - TO -E ND T RANSMISSION D ELAY IN M OBILITY E XPERIMENTS [4] A. Augustin, J. Yi, T. Clausen, and W. M. Townsley, “A study of LoRa:
Long range & low power networks for the Internet of Things,” Sensors,
vol. 16, no. 9, p. 1466, 2016.
[5] “Sigfox Configuration.” Accessed: Apr. 25, 2022. [Online]. Available:
https://build.sigfox.com
[6] C. Dow and P. Lea, Mastering IoT. London, U.K.: Packt, 2019.
[7] “Sigfox Payload.” Accessed: Jun. 3, 2022. [Online]. Available: https:
//build.sigfox.com/payload
[8] G. G. L. Ribeiro, L. F. D. Lima, L. Oliveira, J. J. P. C. Rodrigues,
C. N. M. Marins, and G. A. B. Marcondes, “An outdoor localization
system based on SigFox,” in Proc. IEEE 87th Veh. Technol. Conf. (VTC
Spring), Jun. 2018, pp. 1–5. [Online]. Available: https://ieeexplore.ieee.
by [8], [11] also reported a significant number of lost messages org/document/8417853/
in mobile experiments, which is consistent with our results. [9] L. Oliveira, J. J. P. C. Rodrigues, S. A. Kozlov, R. A. L. Rabêlo, and
V. Furtado, “Performance assessment of long-range and Sigfox protocols
with mobility support,” Int. J. Commun. Syst., vol. 32, no. 13, Sep. 2019,
V. C ONCLUSION Art. no. e3956. [Online]. Available: https://onlinelibrary.wiley.com/doi/
In this letter we analyzed the Sigfox network as a messaging 10.1002/dac.3956
[10] K. Mikhaylov et al., “Communication performance of a real-life wide-
channel for applications. In the stationary experiments, mes- area low-power network based on Sigfox technology,” in Proc. IEEE Int.
sages were delivered reliably. The typical message delivery Conf. Commun. (ICC), Jun. 2020, pp. 1–6. [Online]. Available: https:
times from a sending device to a server in the Internet varied //ieeexplore.ieee.org/document/9148645/
from 2.5 s to 4.5 s depending on the message size. However, [11] S.-Y. Wang, J.-E. Chang, H. Fan, and Y.-H. Sun, “Performance compar-
isons of NB-IoT, LTE cat-M1, Sigfox, and LoRa moving at high speeds
mobility tests revealed that the message delivery time could be in the air,” in Proc. IEEE Symp. Comput. Commun. (ISCC), Rennes,
notably longer in non-optimal situations. We assumed that this France, Jul. 2020, pp. 1–6. [Online]. Available: https://ieeexplore.ieee.
was due to the design, in which the message is sent three times org/document/9219557/
[12] D. Patel and M. Won, “Experimental study on low power wide area
on different frequencies, and to whether earlier transmission networks (LPWAN) for mobile Internet of Things,” in Proc. IEEE
is lost and later received, causing an increase in end-to-end 85th Veh. Technol. Conf. (VTC Spring), Jun. 2017, pp. 1–5. [Online].
delay. Available: http://ieeexplore.ieee.org/document/8108501/
[13] F. C. de Oliveira, J. J. P. C. Rodrigues, R. A. L. Rabelo, and S. Mumtaz,
In summary, we list what we learned from our experiments “Performance delay comparison in random access procedure for NB-IoT,
in the following: LoRa, and SigFox IoT protocols,” in Proc. IEEE 1st Sustain. Cities
• The typical end-to-end delay, with a static sender and a Latin America Conf. (SCLA), Aug. 2019, pp. 1–6. [Online]. Available:
https://ieeexplore.ieee.org/document/8905443/
server in Internet in semi-urban environment with 8-byte
[14] D. M. Hernandez, G. Peralta, L. Manero, R. Gomez, J. Bilbao, and
message, is less than 3.5 s. Our application server in C. Zubia, “Energy and coverage study of LPWAN schemes for industry
the Internet received 26% of the messages in less than 4.0,” in Proc. IEEE Int. Workshop Electron. Control Meas. Signals Appl.
2.5 s, 62% in less than 3 s, and 88% in less than 3.5 s. Mechatron. (ECMSM), May 2017, pp. 1–6. [Online]. Available: http:
//ieeexplore.ieee.org/document/7945893/
However, there were cases in which delivery took notably [15] B. Al Homssi, A. Al-Hourani, K. G. Chavez, S. Chandrasekharan, and
more time, but these were assumed to be caused by the S. Kandeepan, “Energy-efficient IoT for 5G: A framework for adap-
general nature of Internet traffic. tive power and rate control,” in Proc. 12th Int. Conf. Signal Process.
Commun. Syst. (ICSPCS), Dec. 2018, pp. 1–6. [Online]. Available:
• Message size affects the message transmission time. Each https://ieeexplore.ieee.org/document/8631733/
message is padded to a size of 1, 4, 8, or 12 bytes, which [16] A. Ikpehai, B. Adebisi, and K. Anoh, “Effects of traffic character-
the developer should be aware of. In our experiments, istics on energy consumption of IoT end devices in smart city,” in
Proc. IEEE Global Inf. Infrastruct. Netw. Symp. (GIIS), Thessaloniki,
message size affected the average end-to-end delay to Greece, Oct. 2018, pp. 1–6. [Online]. Available: https://ieeexplore.ieee.
a server in the Internet with respect to message size of org/document/8635744/
3.1 s, 3.5 s, 3.8 s and 4.1 s. [17] J. Tomlain, O. Teren, and J. Tomlain, “Communication technolo-
• Mobility can have a drastic impact on message delivery gies and data exchange possibilities for smart energy solutions,” in
Proc. IEEE New Trends Signal Process. (NTSP), Liptovský Mikuláš,
reliability, as only 20% of the messages were delivered Slovakia, Oct. 2018, pp. 1–6. [Online]. Available: https://ieeexplore.ieee.
successfully in our experiments. However, the results org/document/8524097/
could be different if the antenna was located on the roof [18] Y. Lykov, A. Paniotova, V. Shatalova, and A. Lykova, “Energy effi-
ciency comparison LPWANs: LoRaWAN vs Sigfox,” in Proc. IEEE Int.
or if the experiments were run in an urban environment. Conf. Probl. Infocommun. Sci. Technol. (PIC S T), Kharkiv, Ukraine,
• The user cannot expect that the message is delivered Oct. 2020, pp. 485–490. [Online]. Available: https://ieeexplore.ieee.org/
reliably. The Sigfox network can provide four down- document/9468026/
[19] H. Sallouha, A. Chiumento, S. Rajendran, and S. Pollin, “Localization in
link messages per day, so acknowledging the messages ultra narrow band IoT networks: Design guidelines and tradeoffs,” IEEE
is generally not an option. Internet Things J., vol. 6, no. 6, pp. 9375–9385, Dec. 2019. [Online].
Available: https://ieeexplore.ieee.org/document/8778774/
[20] T. Janssen, M. Aernouts, R. Berkvens, and M. Weyn, “Outdoor finger-
R EFERENCES printing localization using Sigfox,” in Proc. Int. Conf. Indoor Position.
[1] K. Mekki, E. Bajic, F. Chaxel, and F. Meyer, “A comparative study of Indoor Navig. (IPIN), Sep. 2018, pp. 1–6. [Online]. Available: https:
LPWAN technologies for large-scale IoT deployment,” ICT Exp., vol. 5, //ieeexplore.ieee.org/document/8533826/
no. 1, pp. 1–7, 2019. [21] M. Aernouts, B. Bellekens, R. Berkvens, and M. Weyn, “A compari-
[2] “Sigfox.” Accessed: Apr. 25, 2022. [Online]. Available: https://www. son of signal strength localization methods with Sigfox,” in Proc. 15th
sigfox.com/en Workshop Position. Navig. Commun. (WPNC), Oct. 2018, pp. 1–6.
[3] R. Brotzu, P. Aru, M. Fadda, and D. Giusto, “Urban SigFox-based [Online]. Available: https://ieeexplore.ieee.org/document/8555743/
mobility system,” in Proc. IEEE Int. Symp. Broadband Multimedia Syst. [22] “QGIS.” Accessed: Jun. 2, 2022. [Online]. Available: https://www.qgis.
Broadcast. (BMSB), 2021, pp. 1–4. org/en/site/