RediSearch crash on v1.4.16 & also on v1.4.20 #947

dme-development · 2019-10-14T18:18:35Z

We are seeing lot's of crashes every day.

RediSearch version 1.4.16 (Git=v1.4.16)
concurrency: ON, gc: ON

This is the full crash report:

=== REDIS BUG REPORT START: Cut & paste starting from here ===
66237:S 14 Oct 2019 19:03:09.245 # Redis 5.0.3 crashed by signal: 11
66237:S 14 Oct 2019 19:03:09.245 # Crashed running the instruction at: 0x7f72da019abb
66237:S 14 Oct 2019 19:03:09.245 # Accessing address: (nil)
66237:S 14 Oct 2019 19:03:09.245 # Failed assertion: (:0)

------ STACK TRACE ------
EIP:
/var/lib/redis/redisearch.so(+0x54abb)[0x7f72da019abb]

Backtrace:
/usr/bin/redis-server 127.0.0.1:6379(logStackTrace+0x4a)[0x559a17e46d6a]
/usr/bin/redis-server 127.0.0.1:6379(sigsegvHandler+0xc3)[0x559a17e47533]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7f72dc92c0e0]
/var/lib/redis/redisearch.so(+0x54abb)[0x7f72da019abb]
/var/lib/redis/redisearch.so(IR_Read+0x32)[0x7f72da019882]
/var/lib/redis/redisearch.so(IR_SkipTo+0x10d)[0x7f72da019a3d]
/var/lib/redis/redisearch.so(+0x50d67)[0x7f72da015d67]
/var/lib/redis/redisearch.so(+0x5143c)[0x7f72da01643c]
/var/lib/redis/redisearch.so(+0x516a9)[0x7f72da0166a9]
/var/lib/redis/redisearch.so(+0x51180)[0x7f72da016180]
/var/lib/redis/redisearch.so(baseResultProcessor_Next+0x3b)[0x7f72da0269fb]
/var/lib/redis/redisearch.so(scorerProcessor_Next+0x29)[0x7f72da026c99]
/var/lib/redis/redisearch.so(sorter_Next+0x49)[0x7f72da027bc9]
/var/lib/redis/redisearch.so(pager_Next+0x44)[0x7f72da026d44]
/var/lib/redis/redisearch.so(loader_Next+0x54)[0x7f72da0274d4]
/var/lib/redis/redisearch.so(QueryPlan_Run+0xf3)[0x7f72da024e93]
/var/lib/redis/redisearch.so(_SearchCommand+0xaf)[0x7f72da01b7af]
/var/lib/redis/redisearch.so(+0x420bb)[0x7f72da0070bb]
/var/lib/redis/redisearch.so(+0xaae0e)[0x7f72da06fe0e]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x74a4)[0x7f72dc9224a4]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f72dc664d0f]

------ INFO OUTPUT ------

Server

redis_version:5.0.3
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:9a0d28f504862808
redis_mode:standalone
os:Linux 4.9.0-9-amd64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:6.3.0
process_id:66237
run_id:9256d0be332a4bc7f30200bf0553fa3f373e2422
tcp_port:6379
uptime_in_seconds:1176
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:10791501
executable:/usr/bin/redis-server
config_file:/etc/redis/redis.conf

Clients

connected_clients:75
client_recent_max_input_buffer:1275
client_recent_max_output_buffer:0
blocked_clients:1

Memory

used_memory:279575464
used_memory_human:266.62M
used_memory_rss:655654912
used_memory_rss_human:625.28M
used_memory_peak:312560864
used_memory_peak_human:298.08M
used_memory_peak_perc:89.45%
used_memory_overhead:10385602
used_memory_startup:787800
used_memory_dataset:269189862
used_memory_dataset_perc:96.56%
allocator_allocated:637269488
allocator_active:671162368
allocator_resident:655587328
total_system_memory:8356696064
total_system_memory_human:7.78G
used_memory_lua:67584
used_memory_lua_human:66.00K
used_memory_scripts:4440
used_memory_scripts_human:4.34K
number_of_cached_scripts:7
maxmemory:6442450944
maxmemory_human:6.00G
maxmemory_policy:noeviction
allocator_frag_ratio:1.05
allocator_frag_bytes:33892880
allocator_rss_ratio:0.98
allocator_rss_bytes:-15575040
rss_overhead_ratio:1.00
rss_overhead_bytes:67584
mem_fragmentation_ratio:2.34
mem_fragmentation_bytes:376031520
mem_not_counted_for_evict:0
mem_replication_backlog:1048576
mem_clients_slaves:0
mem_clients_normal:1695186
mem_aof_buffer:0
mem_allocator:jemalloc-3.6.0
active_defrag_running:0
lazyfree_pending_objects:0

Persistence

loading:0
rdb_changes_since_last_save:3521
rdb_bgsave_in_progress:0
rdb_last_save_time:1571072532
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:1
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:44228608
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0

Stats

total_connections_received:215
total_commands_processed:631559
instantaneous_ops_per_sec:437
total_net_input_bytes:294326623
total_net_output_bytes:3857758545
instantaneous_input_kbps:126.75
instantaneous_output_kbps:12993.00
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:33257364
keyspace_misses:203387
pubsub_channels:2
pubsub_patterns:0
latest_fork_usec:17946
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0

Replication

role:slave
master_host:192.168.224.23
master_port:6379
master_link_status:up
master_last_io_seconds_ago:0
master_sync_in_progress:0
slave_repl_offset:14530031234
slave_priority:0
slave_read_only:1
connected_slaves:0
master_replid:bdbf55dc74885fdb5d38d507a71865d7455c9be8
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:14530031234
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:14528982659
repl_backlog_histlen:1048576

CPU

used_cpu_sys:78.680000
used_cpu_user:235.128000
used_cpu_sys_children:34.840000
used_cpu_user_children:20.404000

Commandstats

cmdstat_expire:calls=1475,usec=4592,usec_per_call=3.11
cmdstat_hmset:calls=1475,usec=22016,usec_per_call=14.93
cmdstat_unlink:calls=2110,usec=13636,usec_per_call=6.46
cmdstat_setex:calls=4341,usec=52902,usec_per_call=12.19
cmdstat_get:calls=70264,usec=775599,usec_per_call=11.04
cmdstat_subscribe:calls=48,usec=87,usec_per_call=1.81
cmdstat_FT.SAFEADD:calls=104996,usec=7454708,usec_per_call=71.00
cmdstat_ping:calls=4271,usec=4545,usec_per_call=1.06
cmdstat_exec:calls=104996,usec=7820357,usec_per_call=74.48
cmdstat_FT.SEARCH:calls=14624,usec=827265,usec_per_call=56.57
cmdstat_multi:calls=104996,usec=16819,usec_per_call=0.16
cmdstat_cluster:calls=41,usec=15,usec_per_call=0.37
cmdstat_set:calls=24,usec=255,usec_per_call=10.62
cmdstat_echo:calls=81,usec=14,usec_per_call=0.17
cmdstat_publish:calls=3460,usec=26136,usec_per_call=7.55
cmdstat_exists:calls=3,usec=4,usec_per_call=1.33
cmdstat_select:calls=46340,usec=59867,usec_per_call=1.29
cmdstat_FT.AGGREGATE:calls=31691,usec=1270886,usec_per_call=40.10
cmdstat_del:calls=5369,usec=70158,usec_per_call=13.07
cmdstat_hgetall:calls=129391,usec=4798030,usec_per_call=37.08
cmdstat_client:calls=81,usec=57,usec_per_call=0.70
cmdstat_config:calls=236,usec=6293,usec_per_call=26.67
cmdstat_FT.CREATE:calls=9,usec=1670,usec_per_call=185.56
cmdstat_info:calls=1231,usec=72528,usec_per_call=58.92
cmdstat_auth:calls=6,usec=3,usec_per_call=0.50

Cluster

cluster_enabled:0

Keyspace

db0:keys=126610,expires=19770,avg_ttl=0

------ CLIENT LIST OUTPUT ------
id=13 addr=192.168.224.24:39391 fd=14 name= age=1176 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14 addr=192.168.224.24:52957 fd=15 name= age=1176 idle=1 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe
id=79 addr=192.168.223.17:61277 fd=18 name=SEWWWP005 age=1170 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=80 addr=192.168.223.17:61279 fd=23 name=SEWWWP005 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=81 addr=192.168.223.10:49644 fd=24 name=SEWWSP004 age=1170 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=82 addr=192.168.223.10:49646 fd=25 name=SEWWSP004 age=1170 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=83 addr=192.168.223.10:49647 fd=26 name=SEWWSP004 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=85 addr=192.168.223.10:49635 fd=28 name=SEWWSP004 age=1170 idle=18 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=86 addr=192.168.223.10:49640 fd=29 name=SEWWSP004 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=87 addr=192.168.223.10:49642 fd=30 name=SEWWSP004 age=1170 idle=19 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=89 addr=192.168.223.10:49643 fd=32 name=SEWWSP004 age=1170 idle=18 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=90 addr=192.168.223.10:49641 fd=33 name=SEWWSP004 age=1170 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=91 addr=192.168.223.10:49645 fd=34 name=SEWWSP004 age=1170 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=92 addr=192.168.223.10:49638 fd=35 name=SEWWSP004 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=93 addr=192.168.223.10:49636 fd=36 name=SEWWSP004 age=1170 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=94 addr=192.168.223.10:49639 fd=37 name=SEWWSP004 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=95 addr=192.168.223.10:49637 fd=38 name=SEWWSP004 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=96 addr=192.168.223.8:10336 fd=39 name=SEWWSP001 age=1170 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=97 addr=192.168.223.8:10337 fd=40 name=SEWWSP001 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=98 addr=192.168.223.5:57995 fd=41 name=SEWWWP002 age=1170 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=99 addr=192.168.223.6:49255 fd=42 name=SEWWWP003 age=1170 idle=18 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=100 addr=192.168.223.5:57997 fd=43 name=SEWWWP002 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=101 addr=192.168.223.6:49256 fd=44 name=SEWWWP003 age=1170 idle=18 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=102 addr=192.168.223.9:17388 fd=45 name=SEWWSP002 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=103 addr=192.168.223.9:17387 fd=46 name=SEWWSP002 age=1170 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=104 addr=192.168.223.9:17386 fd=47 name=SEWWSP002 age=1170 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=105 addr=192.168.223.9:17385 fd=48 name=SEWWSP002 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=106 addr=192.168.223.18:64843 fd=49 name=SEWWWP006 age=1170 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=107 addr=192.168.223.18:64844 fd=50 name=SEWWWP006 age=1170 idle=19 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=108 addr=192.168.223.10:49648 fd=51 name=SEWWSP004 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=109 addr=192.168.223.10:49649 fd=52 name=SEWWSP004 age=1170 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=110 addr=192.168.223.10:49652 fd=53 name=SEWWSP004 age=1170 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=111 addr=192.168.223.8:10339 fd=54 name=SEWWSP001 age=1170 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=112 addr=192.168.223.8:10338 fd=55 name=SEWWSP001 age=1170 idle=22 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=113 addr=192.168.223.8:10347 fd=56 name=SEWWSP001 age=1170 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=114 addr=192.168.223.8:10344 fd=57 name=SEWWSP001 age=1170 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=115 addr=192.168.223.8:10346 fd=58 name=SEWWSP001 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=116 addr=192.168.223.8:10342 fd=59 name=SEWWSP001 age=1170 idle=10 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=117 addr=192.168.223.8:10349 fd=60 name=SEWWSP001 age=1170 idle=11 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=118 addr=192.168.223.8:10341 fd=61 name=SEWWSP001 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=440 addr=192.168.223.12:63535 fd=82 name=SESFSP002 age=1170 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=441 addr=192.168.223.12:63536 fd=83 name=SESFSP002 age=1170 idle=28 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=119 addr=192.168.223.8:10348 fd=62 name=SEWWSP001 age=1170 idle=9 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=120 addr=192.168.223.8:10351 fd=63 name=SEWWSP001 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=121 addr=192.168.223.8:10350 fd=64 name=SEWWSP001 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=122 addr=192.168.223.8:10340 fd=65 name=SEWWSP001 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=123 addr=192.168.223.9:17389 fd=66 name=SEWWSP002 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=124 addr=192.168.223.9:17391 fd=67 name=SEWWSP002 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=125 addr=192.168.223.9:17390 fd=68 name=SEWWSP002 age=1170 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=126 addr=192.168.223.8:10353 fd=69 name=SEWWSP001 age=1170 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=127 addr=192.168.223.8:10355 fd=70 name=SEWWSP001 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=134 addr=192.168.223.8:10366 fd=77 name=SEWWSP001 age=1170 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=135 addr=192.168.223.9:17394 fd=78 name=SEWWSP002 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=136 addr=192.168.223.9:17397 fd=79 name=SEWWSP002 age=1170 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=137 addr=192.168.223.9:17392 fd=80 name=SEWWSP002 age=1170 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=156 addr=192.168.223.8:10367 fd=81 name=SEWWSP001 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=128 addr=192.168.223.8:10358 fd=71 name=SEWWSP001 age=1170 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=129 addr=192.168.223.8:10352 fd=72 name=SEWWSP001 age=1170 idle=21 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=36734 addr=192.168.223.10:50698 fd=27 name=SEWWSP004 age=914 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=36735 addr=192.168.223.10:50699 fd=31 name=SEWWSP004 age=914 idle=6 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=130 addr=192.168.223.8:10354 fd=73 name=SEWWSP001 age=1170 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=131 addr=192.168.223.8:10360 fd=74 name=SEWWSP001 age=1170 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=132 addr=192.168.223.10:49656 fd=75 name=SEWWSP004 age=1170 idle=0 flags=b db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=133 addr=192.168.223.10:49657 fd=76 name=SEWWSP004 age=1170 idle=28 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=36 addr=192.168.223.13:61966 fd=21 name=SESFSP003 age=1174 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=37 addr=192.168.223.13:61965 fd=22 name=SESFSP003 age=1174 idle=31 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=9 addr=192.168.224.22:51087 fd=10 name= age=1176 idle=1 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe
id=20 addr=192.168.223.8:10384 fd=16 name=SEWWSP001 age=1175 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.AGGREGATE
id=21 addr=192.168.223.8:10383 fd=17 name=SEWWSP001 age=1175 idle=33 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=34 addr=192.168.223.4:57666 fd=19 name=SEWWWP001 age=1174 idle=23 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=35 addr=192.168.223.4:57665 fd=20 name=SEWWWP001 age=1174 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=10 addr=192.168.224.22:44919 fd=11 name= age=1176 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=publish
id=11 addr=192.168.224.23:59045 fd=12 name= age=1176 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=publish
id=75 addr=192.168.224.23:6379 fd=9 name= age=1171 idle=0 flags=M db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=setex
id=12 addr=192.168.224.23:53429 fd=13 name= age=1176 idle=1 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe

------ REGISTERS ------
66237:S 14 Oct 2019 19:03:09.246 #
RAX:00007f72c95446e0 RBX:00007f7299ae52e0
RCX:00007f729981f790 RDX:000000000000001e
RDI:00007f7299ae52e0 RSI:00007f72aeb8b3e0
RBP:00007f72d17b29d8 RSP:00007f72d17b2940
R8 :0000000000000003 R9 :0103030506050400
R10:00007f72bb4ea520 R11:0000000000000055
R12:000000000000001e R13:00007f72d17b29d8
R14:00007f729981f7e0 R15:00007f72999c5c80
RIP:00007f72da019abb EFL:0000000000010287
CSGSFS:002b000000000033
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b294f) -> 0000000000000010
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b294e) -> 00000000000000a0
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b294d) -> 00007f72da01643c
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b294c) -> 000000000018363e
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b294b) -> 0000000000000000
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b294a) -> 0000000000000000
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b2949) -> 00007f72da015d67
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b2948) -> 00007f72d17b29d8
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b2947) -> 000000000018363e
66237:S 14 Oct 2019 19:03:09.246 # (00007f72d17b2946) -> 00007f72998d9100
66237:S 14 Oct 2019 19:03:09.247 # (00007f72d17b2945) -> 00007f72da019a3d
66237:S 14 Oct 2019 19:03:09.247 # (00007f72d17b2944) -> 00007f72d17b29d8
66237:S 14 Oct 2019 19:03:09.247 # (00007f72d17b2943) -> 000000000018363e
66237:S 14 Oct 2019 19:03:09.247 # (00007f72d17b2942) -> 00007f7299ae52e0
66237:S 14 Oct 2019 19:03:09.247 # (00007f72d17b2941) -> 00007f72da019882
66237:S 14 Oct 2019 19:03:09.247 # (00007f72d17b2940) -> 00007f7299ae52e0

------ FAST MEMORY TEST ------
66237:S 14 Oct 2019 19:03:09.247 # Bio thread for job type #0 terminated
66237:S 14 Oct 2019 19:03:09.247 # Bio thread for job type #1 terminated
66237:S 14 Oct 2019 19:03:09.247 # Bio thread for job type #2 terminated
*** Preparing to test memory region 559a180c5000 (94208 bytes)
*** Preparing to test memory region 7f7294c00000 (41943040 bytes)
*** Preparing to test memory region 7f72977fe000 (8388608 bytes)
*** Preparing to test memory region 7f7297fff000 (8388608 bytes)
*** Preparing to test memory region 7f7298800000 (96468992 bytes)
*** Preparing to test memory region 7f729e7ff000 (8388608 bytes)
*** Preparing to test memory region 7f729f000000 (113246208 bytes)
*** Preparing to test memory region 7f72a6000000 (16777216 bytes)
*** Preparing to test memory region 7f72a7400000 (125829120 bytes)
*** Preparing to test memory region 7f72aefff000 (8388608 bytes)
*** Preparing to test memory region 7f72af800000 (37748736 bytes)
*** Preparing to test memory region 7f72b2000000 (62914560 bytes)
*** Preparing to test memory region 7f72b5ffe000 (8388608 bytes)
*** Preparing to test memory region 7f72b67ff000 (8388608 bytes)
*** Preparing to test memory region 7f72b7000000 (25165824 bytes)
*** Preparing to test memory region 7f72b8bff000 (8388608 bytes)
*** Preparing to test memory region 7f72b9400000 (54525952 bytes)
*** Preparing to test memory region 7f72bcc00000 (100663296 bytes)
*** Preparing to test memory region 7f72c3000000 (109051904 bytes)
*** Preparing to test memory region 7f72c9c00000 (83886080 bytes)
*** Preparing to test memory region 7f72cefb0000 (8388608 bytes)
*** Preparing to test memory region 7f72cf7b1000 (8388608 bytes)
*** Preparing to test memory region 7f72cffb2000 (8388608 bytes)
*** Preparing to test memory region 7f72d07b3000 (8388608 bytes)
*** Preparing to test memory region 7f72d0fb4000 (8388608 bytes)
*** Preparing to test memory region 7f72d17b5000 (8388608 bytes)
*** Preparing to test memory region 7f72d1fb6000 (8388608 bytes)
*** Preparing to test memory region 7f72d27b7000 (8388608 bytes)
*** Preparing to test memory region 7f72d2fb8000 (8388608 bytes)
*** Preparing to test memory region 7f72d37b9000 (8388608 bytes)
*** Preparing to test memory region 7f72d3fba000 (8388608 bytes)
*** Preparing to test memory region 7f72d47bb000 (8388608 bytes)
*** Preparing to test memory region 7f72d4fbc000 (8388608 bytes)
*** Preparing to test memory region 7f72d57bd000 (8388608 bytes)
*** Preparing to test memory region 7f72d5fbe000 (8388608 bytes)
*** Preparing to test memory region 7f72d67bf000 (8388608 bytes)
*** Preparing to test memory region 7f72d6fc0000 (8388608 bytes)
*** Preparing to test memory region 7f72d77c1000 (8388608 bytes)
*** Preparing to test memory region 7f72d7fc2000 (8388608 bytes)
*** Preparing to test memory region 7f72d87c3000 (8388608 bytes)
*** Preparing to test memory region 7f72d8fc4000 (8388608 bytes)
*** Preparing to test memory region 7f72d97c5000 (8388608 bytes)
*** Preparing to test memory region 7f72da3f9000 (16384 bytes)
*** Preparing to test memory region 7f72da3fe000 (8388608 bytes)
*** Preparing to test memory region 7f72dabff000 (8388608 bytes)
*** Preparing to test memory region 7f72db400000 (8388608 bytes)
*** Preparing to test memory region 7f72dbc00000 (8388608 bytes)
*** Preparing to test memory region 7f72dc917000 (16384 bytes)
*** Preparing to test memory region 7f72dcb34000 (16384 bytes)
*** Preparing to test memory region 7f72dd48a000 (4096 bytes)
*** Preparing to test memory region 7f72ddccb000 (4096 bytes)
*** Preparing to test memory region 7f72de0e6000 (24576 bytes)
*** Preparing to test memory region 7f72de0f5000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.77915:C 14 Oct 2019 19:03:12.513 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
77915:C 14 Oct 2019 19:03:12.513 # Redis version=5.0.3, bits=64, commit=00000000, modified=0, pid=77915, just started
77915:C 14 Oct 2019 19:03:12.513 # Configuration loaded
.
.-__ ''-._ _.- . . ''-._ Redis 5.0.3 (00000000/0) 64 bit
.- .-```. ```\/ _.,_ ''-._ ( ' , .-` | `, ) Running in standalone mode |`-._`-...-` __...-.-.|'_.-'| Port: 6379 | -. ._ / _.-' | PID: 77924 -._ -._ -./ .-' .-'
|-._-. -.__.-' _.-'_.-'| | -.-._ _.-'_.-' | http://redis.io -._ -._-..-'.-' .-'
|-._-. -.__.-' _.-'_.-'| | -.-._ _.-'_.-' | -._ -._-..-'_.-' _.-'
-._ -..-' _.-'
-._ _.-' -..-'

77924:S 14 Oct 2019 19:03:12.517 # Server initialized
77924:S 14 Oct 2019 19:03:12.517 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
77924:S 14 Oct 2019 19:03:12.518 * RediSearch version 1.4.16 (Git=v1.4.16)
77924:S 14 Oct 2019 19:03:12.518 * concurrency: ON, gc: ON, prefix min length: 2, prefix max expansions: 200, query timeout (ms): 500, timeout policy: return, cursor read size: 1000, cursor max idle (ms): 300000, max doctable size: 1000000, search pool size: 20, index pool size: 8,
77924:S 14 Oct 2019 19:03:12.519 * Initialized thread pool!
77924:S 14 Oct 2019 19:03:12.519 * Module 'ft' loaded from /var/lib/redis/redisearch.so

The text was updated successfully, but these errors were encountered:

MeirShpilraien · 2019-10-15T14:38:48Z

@dme-development did you compiled yourself or do you use docker?

dme-development · 2019-10-15T15:38:39Z

@MeirShpilraien it is self compiled.

Can you conclude from the crash report what is causing this?

MeirShpilraien · 2019-10-15T15:40:07Z

I need the redisearch.so binary, can you pls send it to me?

dme-development · 2019-10-15T15:49:57Z

@MeirShpilraien I've just send it to you via mail.

MeirShpilraien · 2019-10-16T05:33:38Z

Thanks, I will check it out.

MeirShpilraien · 2019-10-16T06:37:56Z

@dme-development I think I might have found what can cause such a crash, can you please try switching to SAFEMODE and let me know if it still happened? You can switch to SAFEMODE using:
redis-server --loadmodule ./redisearch.so SAFEMODE

dme-development · 2019-10-16T06:53:27Z

@MeirShpilraien I will request the change and keep you updated on the difference.
Will this affect performance in any way?

MeirShpilraien · 2019-10-16T07:00:01Z

@dme-development it should not effect performance.
Regardless, how often do you see this crash?

dme-development · 2019-10-16T07:13:01Z

@MeirShpilraien About 20 times per day.

MeirShpilraien · 2019-10-16T07:28:34Z

@dme-development wowo this is a lot, let me know if the SAFEMODE solved it.
Last question, are you updating your numeric index a lot?

dme-development · 2019-10-16T10:02:36Z

@MeirShpilraien I can confirm the crashes don't occur anymore since the SAFEMODE is on, at least until now.
We are having updates on our indexes constantly, almost every minute. Our indexes exist of text, numeric and tag fields.

Can we just keep running it in safemode without causing any other issues?

MeirShpilraien · 2019-10-16T10:13:47Z

@dme-development yes for now keep running on safemode, I am not closing the issue and I will update once the issue is solved.

dme-development · 2019-10-16T13:53:08Z

@MeirShpilraien even with the SAFEMODE on, we've had 2 crashes until now. It looks better then before, but the crashes still occur.
The stacktraces of the 2 crashes from today looks exactly the same as the one I posted yesterday (without SAFEMODE on).

MeirShpilraien · 2019-10-16T14:19:37Z

I see, so the safe mode did not stopped it, it just hide it a little. Now I am not sure the problem I found and the problem you have are the same, we might have another issue.

Any chance you can get a core dump (of the crash) and send it to me to investigate?

dme-development · 2019-10-16T14:36:36Z

More info is on it's way via email.

ebinezar · 2019-11-05T10:47:12Z

Can you guys, update the status of this issue ? We are running 1.4.16 version on production, around 100k users are accessing it daily and it never fail to crash once in a day.

MeirShpilraien · 2019-11-05T16:31:46Z

@ebinezar this is currently under investigation, will update more once we find the root cause of the crash.

dme-development · 2019-12-11T12:26:08Z

We were finally able to upgrade to v1.4.18, but we noticed that Redis still keeps crashing. I've send over the details to @MeirShpilraien .

MeirShpilraien · 2019-12-11T19:20:22Z

1.4.18 crash report:

=== REDIS BUG REPORT START: Cut & paste starting from here ===
123639:S 03 Dec 2019 16:16:05.453 # Redis 5.0.3 crashed by signal: 11
123639:S 03 Dec 2019 16:16:05.453 # Crashed running the instruction at: 0x7fb8352c1088
123639:S 03 Dec 2019 16:16:05.453 # Accessing address: (nil)
123639:S 03 Dec 2019 16:16:05.453 # Failed assertion: <no assertion failed> (<no file>:0)

------ STACK TRACE ------
EIP:
/lib/x86_64-linux-gnu/libc.so.6(+0x129088)[0x7fb8352c1088]

Backtrace:
/usr/bin/redis-server 127.0.0.1:6379(logStackTrace+0x4a)[0x55a128833d6a]
/usr/bin/redis-server 127.0.0.1:6379(sigsegvHandler+0xc3)[0x55a128834533]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7fb8355480e0]
/lib/x86_64-linux-gnu/libc.so.6(+0x129088)[0x7fb8352c1088]
/var/lib/redis/redisearch.so(+0x83f89)[0x7fb832b13f89]
/var/lib/redis/redisearch.so(+0x877ca)[0x7fb832b177ca]
/var/lib/redis/redisearch.so(IR_Read+0x97)[0x7fb832b18039]
/var/lib/redis/redisearch.so(IR_SkipTo+0xd8)[0x7fb832b183c9]
/var/lib/redis/redisearch.so(+0x7d8c9)[0x7fb832b0d8c9]
/var/lib/redis/redisearch.so(+0x7e36f)[0x7fb832b0e36f]
/var/lib/redis/redisearch.so(+0x7e1e0)[0x7fb832b0e1e0]
/var/lib/redis/redisearch.so(+0x7d8c9)[0x7fb832b0d8c9]
/var/lib/redis/redisearch.so(+0x7e36f)[0x7fb832b0e36f]
/var/lib/redis/redisearch.so(baseResultProcessor_Next+0x87)[0x7fb832b33ed3]
/var/lib/redis/redisearch.so(+0xa3c69)[0x7fb832b33c69]
/var/lib/redis/redisearch.so(scorerProcessor_Next+0x37)[0x7fb832b34041]
/var/lib/redis/redisearch.so(+0xa3c69)[0x7fb832b33c69]
/var/lib/redis/redisearch.so(sorter_Next+0xac)[0x7fb832b34579]
/var/lib/redis/redisearch.so(+0xa3c69)[0x7fb832b33c69]
/var/lib/redis/redisearch.so(pager_Next+0x37)[0x7fb832b34b8d]
/var/lib/redis/redisearch.so(+0xa3c69)[0x7fb832b33c69]
/var/lib/redis/redisearch.so(loader_Next+0x37)[0x7fb832b34f4f]
/var/lib/redis/redisearch.so(+0x9ecb2)[0x7fb832b2ecb2]
/var/lib/redis/redisearch.so(+0x9f215)[0x7fb832b2f215]
/var/lib/redis/redisearch.so(QueryPlan_Run+0x23)[0x7fb832b2fb9e]
/var/lib/redis/redisearch.so(_SearchCommand+0x284)[0x7fb832b1c15d]
/var/lib/redis/redisearch.so(+0x8c26e)[0x7fb832b1c26e]
/usr/bin/redis-server 127.0.0.1:6379(RedisModuleCommandDispatcher+0x53)[0x55a128861763]
/usr/bin/redis-server 127.0.0.1:6379(call+0xb7)[0x55a1287eda07]
/usr/bin/redis-server 127.0.0.1:6379(processCommand+0x38f)[0x55a1287ee0ff]
/usr/bin/redis-server 127.0.0.1:6379(processInputBuffer+0x185)[0x55a1287fea55]
/usr/bin/redis-server 127.0.0.1:6379(aeProcessEvents+0x2d0)[0x55a1287e74e0]
/usr/bin/redis-server 127.0.0.1:6379(aeMain+0x2b)[0x55a1287e779b]
/usr/bin/redis-server 127.0.0.1:6379(main+0x4db)[0x55a1287e1ceb]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7fb8351b82e1]
/usr/bin/redis-server 127.0.0.1:6379(_start+0x2a)[0x55a1287e1f4a]

------ INFO OUTPUT ------
# Server
redis_version:5.0.3
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:9a0d28f504862808
redis_mode:standalone
os:Linux 4.9.0-9-amd64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:6.3.0
process_id:123639
run_id:67169403664fd901a84c424f6bcb9d308c384c0b
tcp_port:6379
uptime_in_seconds:9417
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:15105077
executable:/usr/bin/redis-server
config_file:/etc/redis/redis.conf

# Clients
connected_clients:77
client_recent_max_input_buffer:2
client_recent_max_output_buffer:348624
blocked_clients:0

# Memory
used_memory:500273744
used_memory_human:477.10M
used_memory_rss:539873280
used_memory_rss_human:514.86M
used_memory_peak:533002416
used_memory_peak_human:508.31M
used_memory_peak_perc:93.86%
used_memory_overhead:10586670
used_memory_startup:788872
used_memory_dataset:489687074
used_memory_dataset_perc:98.04%
allocator_allocated:501885632
allocator_active:540909568
allocator_resident:539805696
total_system_memory:8356696064
total_system_memory_human:7.78G
used_memory_lua:67584
used_memory_lua_human:66.00K
used_memory_scripts:4440
used_memory_scripts_human:4.34K
number_of_cached_scripts:7
maxmemory:6442450944
maxmemory_human:6.00G
maxmemory_policy:noeviction
allocator_frag_ratio:1.08
allocator_frag_bytes:39023936
allocator_rss_ratio:1.00
allocator_rss_bytes:-1103872
rss_overhead_ratio:1.00
rss_overhead_bytes:67584
mem_fragmentation_ratio:1.08
mem_fragmentation_bytes:39698760
mem_not_counted_for_evict:0
mem_replication_backlog:1048576
mem_clients_slaves:0
mem_clients_normal:1925662
mem_aof_buffer:0
mem_allocator:jemalloc-3.6.0
active_defrag_running:0
lazyfree_pending_objects:0

# Persistence
loading:0
rdb_changes_since_last_save:8198
rdb_bgsave_in_progress:0
rdb_last_save_time:1575386008
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:2
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:47153152
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0

# Stats
total_connections_received:1301
total_commands_processed:3536138
instantaneous_ops_per_sec:483
total_net_input_bytes:1274973347
total_net_output_bytes:46153672452
instantaneous_input_kbps:279.97
instantaneous_output_kbps:6011.44
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:115401278
keyspace_misses:844636
pubsub_channels:2
pubsub_patterns:0
latest_fork_usec:14486
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0

# Replication
role:slave
master_host:192.168.224.23
master_port:6379
master_link_status:up
master_last_io_seconds_ago:0
master_sync_in_progress:0
slave_repl_offset:274458519321
slave_priority:0
slave_read_only:1
connected_slaves:0
master_replid:d078d8ac26112a7b95baa568622d94b8ecf87dca
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:274458519321
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:274457470746
repl_backlog_histlen:1048576

# CPU
used_cpu_sys:482.640000
used_cpu_user:3427.428000
used_cpu_sys_children:325.072000
used_cpu_user_children:268.400000

# Commandstats
cmdstat_FT.CREATE:calls=64,usec=21003,usec_per_call=328.17
cmdstat_del:calls=58596,usec=639939,usec_per_call=10.92
cmdstat_hmset:calls=13942,usec=204969,usec_per_call=14.70
cmdstat_echo:calls=172,usec=80,usec_per_call=0.47
cmdstat_module:calls=1,usec=3,usec_per_call=3.00
cmdstat_subscribe:calls=180,usec=677,usec_per_call=3.76
cmdstat_FT.AGGREGATE:calls=175087,usec=2119105867,usec_per_call=12103.16
cmdstat_ping:calls=33623,usec=32925,usec_per_call=0.98
cmdstat_config:calls=1313,usec=48910,usec_per_call=37.25
cmdstat_cluster:calls=86,usec=148,usec_per_call=1.72
cmdstat_multi:calls=77001,usec=15644,usec_per_call=0.20
cmdstat_unlink:calls=11343,usec=102484,usec_per_call=9.03
cmdstat_FT.SAFEADD:calls=76923,usec=40838448,usec_per_call=530.90
cmdstat_setex:calls=84385,usec=755538,usec_per_call=8.95
cmdstat_select:calls=284410,usec=358171,usec_per_call=1.26
cmdstat_set:calls=191,usec=1939,usec_per_call=10.15
cmdstat_FT.SEARCH:calls=108953,usec=1316720142,usec_per_call=12085.21
cmdstat_publish:calls=28812,usec=194649,usec_per_call=6.76
cmdstat_exec:calls=77001,usec=42981099,usec_per_call=558.19
cmdstat_client:calls=172,usec=246,usec_per_call=1.43
cmdstat_info:calls=9679,usec=567055,usec_per_call=58.59
cmdstat_get:calls=657602,usec=7761232,usec_per_call=11.80
cmdstat_hgetall:calls=1822265,usec=67796027,usec_per_call=37.20
cmdstat_auth:calls=6,usec=1,usec_per_call=0.17
cmdstat_exists:calls=390,usec=1381,usec_per_call=3.54
cmdstat_expire:calls=13941,usec=39403,usec_per_call=2.83

# Cluster
cluster_enabled:0

# Keyspace
db0:keys=127145,expires=17507,avg_ttl=0
db2:keys=30,expires=30,avg_ttl=0

------ CLIENT LIST OUTPUT ------
id=6 addr=192.168.224.24:44947 fd=13 name= age=9416 idle=0 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe
id=10 addr=192.168.223.6:54082 fd=17 name=SEWWWP003 age=9412 idle=44 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=11 addr=192.168.223.6:54083 fd=18 name=SEWWWP003 age=9412 idle=44 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=198 addr=192.168.223.8:1370 fd=16 name=SEWWSP001 age=9409 idle=42 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=209 addr=192.168.223.8:1375 fd=24 name=SEWWSP001 age=9409 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=210 addr=192.168.223.8:1374 fd=25 name=SEWWSP001 age=9409 idle=20 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=211 addr=192.168.223.10:63828 fd=26 name=SEWWSP004 age=9409 idle=14 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=217 addr=192.168.223.10:63834 fd=32 name=SEWWSP004 age=9409 idle=40 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=218 addr=192.168.223.10:63833 fd=33 name=SEWWSP004 age=9409 idle=40 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=344 addr=192.168.223.8:1378 fd=54 name=SEWWSP001 age=9408 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=350 addr=192.168.223.10:63846 fd=60 name=SEWWSP004 age=9408 idle=33 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=422 addr=192.168.223.8:1389 fd=72 name=SEWWSP001 age=9408 idle=44 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=423 addr=192.168.223.8:1388 fd=73 name=SEWWSP001 age=9408 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=424 addr=192.168.223.8:1386 fd=74 name=SEWWSP001 age=9408 idle=33 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=425 addr=192.168.223.8:1387 fd=75 name=SEWWSP001 age=9408 idle=9 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=426 addr=192.168.223.8:1390 fd=76 name=SEWWSP001 age=9408 idle=40 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=427 addr=192.168.223.8:1391 fd=77 name=SEWWSP001 age=9408 idle=40 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=428 addr=192.168.223.8:1392 fd=78 name=SEWWSP001 age=9408 idle=10 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=429 addr=192.168.223.8:1394 fd=79 name=SEWWSP001 age=9408 idle=13 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=430 addr=192.168.223.8:1395 fd=80 name=SEWWSP001 age=9408 idle=42 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=431 addr=192.168.223.8:1393 fd=81 name=SEWWSP001 age=9408 idle=41 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=351 addr=192.168.223.10:63847 fd=61 name=SEWWSP004 age=9408 idle=33 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=376 addr=192.168.223.8:1382 fd=62 name=SEWWSP001 age=9408 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=396 addr=192.168.223.6:54092 fd=70 name=SEWWWP003 age=9408 idle=40 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=397 addr=192.168.223.6:54093 fd=71 name=SEWWWP003 age=9408 idle=40 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=377 addr=192.168.223.8:1383 fd=63 name=SEWWSP001 age=9408 idle=41 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=564243 addr=192.168.223.12:62888 fd=34 name=SESFSP002 age=5958 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=564244 addr=192.168.223.12:62889 fd=35 name=SESFSP002 age=5958 idle=58 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=378 addr=192.168.223.10:63848 fd=64 name=SEWWSP004 age=9408 idle=35 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=379 addr=192.168.223.10:63849 fd=65 name=SEWWSP004 age=9408 idle=35 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=380 addr=192.168.223.8:1384 fd=66 name=SEWWSP001 age=9408 idle=32 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=1162770 addr=192.168.223.13:54527 fd=36 name=SESFSP003 age=2194 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=1162771 addr=192.168.223.13:54526 fd=37 name=SESFSP003 age=2194 idle=24 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=1162772 addr=192.168.223.9:15458 fd=38 name=SEWWSP002 age=2194 idle=14 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=1162773 addr=192.168.223.9:15459 fd=39 name=SEWWSP002 age=2194 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=1179 qbuf-free=31589 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=1162774 addr=192.168.223.4:52437 fd=48 name=SEWWWP001 age=2194 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=1162775 addr=192.168.223.4:52438 fd=49 name=SEWWWP001 age=2194 idle=13 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=1162796 addr=192.168.223.8:11589 fd=52 name=SEWWSP001 age=2194 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=1162797 addr=192.168.223.8:11590 fd=53 name=SEWWSP001 age=2194 idle=29 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=381 addr=192.168.223.8:1385 fd=67 name=SEWWSP001 age=9408 idle=32 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=345 addr=192.168.223.8:1379 fd=55 name=SEWWSP001 age=9408 idle=41 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=1142749 addr=192.168.223.10:60372 fd=85 name=SEWWSP004 age=2264 idle=26 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=1142750 addr=192.168.223.10:60373 fd=88 name=SEWWSP004 age=2264 idle=26 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=340 addr=192.168.223.9:17262 fd=50 name=SEWWSP002 age=9409 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=341 addr=192.168.223.9:17263 fd=51 name=SEWWSP002 age=9409 idle=14 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=317 addr=192.168.223.10:63840 fd=46 name=SEWWSP004 age=9409 idle=15 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=318 addr=192.168.223.10:63841 fd=47 name=SEWWSP004 age=9409 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=748345 addr=192.168.223.17:57297 fd=20 name=SEWWWP005 age=4817 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=748346 addr=192.168.223.18:59087 fd=21 name=SEWWWP006 age=4817 idle=30 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=748347 addr=192.168.223.18:59088 fd=22 name=SEWWWP006 age=4817 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=748348 addr=192.168.223.5:62986 fd=23 name=SEWWWP002 age=4817 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=748349 addr=192.168.223.5:62988 fd=40 name=SEWWWP002 age=4817 idle=31 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=748350 addr=192.168.223.10:60352 fd=41 name=SEWWSP004 age=4817 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=748351 addr=192.168.223.10:60353 fd=42 name=SEWWSP004 age=4817 idle=37 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=748352 addr=192.168.223.17:57298 fd=43 name=SEWWWP005 age=4817 idle=33 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=748353 addr=192.168.223.9:6904 fd=44 name=SEWWSP002 age=4817 idle=34 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=748354 addr=192.168.223.8:4217 fd=45 name=SEWWSP001 age=4817 idle=38 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=748355 addr=192.168.223.8:4218 fd=56 name=SEWWSP001 age=4817 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=748356 addr=192.168.223.10:60357 fd=57 name=SEWWSP004 age=4817 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=748357 addr=192.168.223.10:60359 fd=58 name=SEWWSP004 age=4817 idle=39 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=748358 addr=192.168.223.9:6903 fd=59 name=SEWWSP002 age=4817 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=748359 addr=192.168.223.10:60364 fd=68 name=SEWWSP004 age=4817 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=748360 addr=192.168.223.10:60365 fd=69 name=SEWWSP004 age=4817 idle=2 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=212 addr=192.168.223.10:63827 fd=27 name=SEWWSP004 age=9409 idle=14 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=213 addr=192.168.223.10:63830 fd=28 name=SEWWSP004 age=9409 idle=46 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=214 addr=192.168.223.10:63829 fd=29 name=SEWWSP004 age=9409 idle=46 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=215 addr=192.168.223.9:17256 fd=30 name=SEWWSP002 age=9409 idle=27 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=216 addr=192.168.223.9:17257 fd=31 name=SEWWSP002 age=9409 idle=27 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=199 addr=192.168.223.8:1371 fd=19 name=SEWWSP001 age=9409 idle=42 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=7 addr=192.168.224.22:34755 fd=14 name= age=9416 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=publish
id=8 addr=192.168.224.22:46025 fd=15 name= age=9416 idle=0 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe
id=197 addr=192.168.224.23:6379 fd=9 name= age=9409 idle=0 flags=M db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=setex
id=3 addr=192.168.224.23:54485 fd=10 name= age=9416 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=ping
id=4 addr=192.168.224.23:43951 fd=11 name= age=9416 idle=0 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe
id=5 addr=192.168.224.24:59711 fd=12 name= age=9416 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=publish
id=748556 addr=192.168.223.8:4235 fd=82 name=SEWWSP001 age=4816 idle=37 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=748557 addr=192.168.223.8:4234 fd=83 name=SEWWSP001 age=4816 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get

------ CURRENT CLIENT INFO ------
id=1162773 addr=192.168.223.9:15459 fd=39 name=SEWWSP002 age=2194 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=1179 qbuf-free=31589 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
argv[0]: 'FT.SEARCH'
argv[1]: 'idxCachedAuctionItem'
argv[2]: '(((((-@RestrictionCountryCodesInclude:[0 0] -@RestrictionCountryCodesInclude:[1 1])|(@RestrictionCountryCodesInclude:[1 1] @RestrictionCountryCodes:{ro})|(@RestrictionCountryCodesInclude:[0 0] -@RestrictionCountryCodes:{ro})) ((-@RestrictionCompanyStatusIdsInclude:[0 0] -@RestrictionCompanyStatusIdsInclude:[1 1])|(@RestrictionCompanyStatusIdsInclude:[1 1] @RestrictionCompanyStatusIds:{0})|(@RestrictionCompanyStatusIdsInclude:[0 0] -@RestrictionCompanyStatusIds:{0}))) ((-@RestrictionCompanyIdsInclude:[0 0] -@RestrictionCompanyIdsInclude:[1 1])|(@RestrictionCompanyIdsInclude:[1 1] @RestrictionCompanyIds:{165581})|(@RestrictionCompanyIdsInclude:[0 0] -@RestrictionCompanyIds:{165581}))) (((@AuctionId:[1 2147483647] @HasBuyNowBidPlaced:[0 0]) ((@BatchStartDate:[-inf 1575389765] @BatchEndDate:[1575389765 +inf]) (((@StatusId:[2 2]|@StatusId:[50 50])|@StatusId:[40 40])|@StatusId:[41 41])))|((((@BatchStartDate:[-inf 1575389765] @BatchEndDate:[-inf 1575389765]) @WillBeExtended:[1 1]) @IsExtendedPhaseFinishedargv[3]: 'LIMIT'
argv[4]: '0'
argv[5]: '0'

------ REGISTERS ------
123639:S 03 Dec 2019 16:16:05.455 # 
RAX:00007ffe1f4626f7 RBX:00007fb8094e1000
RCX:165802280128008a RDX:0000000000000001
RDI:00007ffe1f4626f7 RSI:165802280128008a
RBP:00007ffe1f4626a0 RSP:00007ffe1f462678
R8 :00007fb832b17791 R9 :00007fb834c000c0
R10:ffffffffffc00000 R11:00007fb834c000c8
R12:0000000000000000 R13:0000000000000000
R14:000598ce2cc624f6 R15:000000000000000f
RIP:00007fb8352c1088 EFL:0000000000010246
CSGSFS:002b000000000033
123639:S 03 Dec 2019 16:16:05.455 # (00007ffe1f462687) -> 28007ffe1f462740
123639:S 03 Dec 2019 16:16:05.455 # (00007ffe1f462686) -> 0000000000000000
123639:S 03 Dec 2019 16:16:05.455 # (00007ffe1f462685) -> 00007fb805e13560
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f462684) -> 00007fb808bc7400
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f462683) -> 00007fb8018a8a10
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f462682) -> 0000000000000000
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f462681) -> 00007fb804a6db20
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f462680) -> 4000000000000000
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f46267f) -> 0000000000000000
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f46267e) -> 00007fb832b177ca
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f46267d) -> 00007ffe1f462700
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f46267c) -> 00007fb808bc7400
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f46267b) -> 00007ffe1f4626f7
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f46267a) -> 0000000000000001
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f462679) -> 4000000000000000
123639:S 03 Dec 2019 16:16:05.456 # (00007ffe1f462678) -> 00007fb832b13f89

------ FAST MEMORY TEST ------
123639:S 03 Dec 2019 16:16:05.456 # Bio thread for job type #0 terminated
123639:S 03 Dec 2019 16:16:05.456 # Bio thread for job type #1 terminated
123639:S 03 Dec 2019 16:16:05.456 # Bio thread for job type #2 terminated
*** Preparing to test memory region 55a128ab2000 (94208 bytes)
*** Preparing to test memory region 7fb7f1800000 (465567744 bytes)
*** Preparing to test memory region 7fb80d7fe000 (8388608 bytes)
*** Preparing to test memory region 7fb80dfff000 (8388608 bytes)
*** Preparing to test memory region 7fb80e800000 (25165824 bytes)
*** Preparing to test memory region 7fb810400000 (25165824 bytes)
*** Preparing to test memory region 7fb812000000 (29360128 bytes)
*** Preparing to test memory region 7fb814000000 (100663296 bytes)
*** Preparing to test memory region 7fb81a400000 (96468992 bytes)
*** Preparing to test memory region 7fb820c00000 (113246208 bytes)
*** Preparing to test memory region 7fb827a7b000 (8388608 bytes)
*** Preparing to test memory region 7fb82827c000 (8388608 bytes)
*** Preparing to test memory region 7fb828a7d000 (8388608 bytes)
*** Preparing to test memory region 7fb82927e000 (8388608 bytes)
*** Preparing to test memory region 7fb829a7f000 (8388608 bytes)
*** Preparing to test memory region 7fb82a280000 (8388608 bytes)
*** Preparing to test memory region 7fb82aa81000 (8388608 bytes)
*** Preparing to test memory region 7fb82b282000 (8388608 bytes)
*** Preparing to test memory region 7fb82ba83000 (8388608 bytes)
*** Preparing to test memory region 7fb82c284000 (8388608 bytes)
*** Preparing to test memory region 7fb82ca85000 (8388608 bytes)
*** Preparing to test memory region 7fb82d286000 (8388608 bytes)
*** Preparing to test memory region 7fb82da87000 (8388608 bytes)
*** Preparing to test memory region 7fb82e288000 (8388608 bytes)
*** Preparing to test memory region 7fb82ea89000 (8388608 bytes)
*** Preparing to test memory region 7fb82f28a000 (8388608 bytes)
*** Preparing to test memory region 7fb82fa8b000 (8388608 bytes)
*** Preparing to test memory region 7fb83028c000 (8388608 bytes)
*** Preparing to test memory region 7fb830a8d000 (8388608 bytes)
*** Preparing to test memory region 7fb83128e000 (8388608 bytes)
*** Preparing to test memory region 7fb831a8f000 (8388608 bytes)
*** Preparing to test memory region 7fb832290000 (8388608 bytes)
*** Preparing to test memory region 7fb832ffa000 (12288 bytes)
*** Preparing to test memory region 7fb832ffe000 (8388608 bytes)
*** Preparing to test memory region 7fb8337ff000 (8388608 bytes)
*** Preparing to test memory region 7fb834000000 (8388608 bytes)
*** Preparing to test memory region 7fb834800000 (8388608 bytes)
*** Preparing to test memory region 7fb835533000 (16384 bytes)
*** Preparing to test memory region 7fb835750000 (16384 bytes)
*** Preparing to test memory region 7fb8360a6000 (4096 bytes)
*** Preparing to test memory region 7fb8368e7000 (4096 bytes)
*** Preparing to test memory region 7fb836d02000 (24576 bytes)
*** Preparing to test memory region 7fb836d11000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.

------ DUMPING CODE AROUND EIP ------
Symbol: (null) (base: (nil))
Module: /lib/x86_64-linux-gnu/libc.so.6 (base 0x7fb835198000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=(nil) -D -b binary -m i386:x86-64 /tmp/dump.bin
------

=== REDIS BUG REPORT END. Make sure to include from START to END. ===

       Please report the crash by opening an issue on github:

           http://github.com/antirez/redis/issues

  Suspect RAM error? Use redis-server --test-memory to verify it.

83352:C 03 Dec 2019 16:16:11.332 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
83352:C 03 Dec 2019 16:16:11.971 # Redis version=5.0.3, bits=64, commit=00000000, modified=0, pid=83352, just started
83352:C 03 Dec 2019 16:16:11.971 # Configuration loaded
                _._                                                  
           _.-``__ ''-._                                             
      _.-``    `.  `_.  ''-._           Redis 5.0.3 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._                                   
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 83361
  `-._    `-._  `-./  _.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |           http://redis.io        
  `-._    `-._`-.__.-'_.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |                                  
  `-._    `-._`-.__.-'_.-'    _.-'                                   
      `-._    `-.__.-'    _.-'                                       
          `-._        _.-'                                           
              `-.__.-'                                               

83361:S 03 Dec 2019 16:16:11.980 # Server initialized
83361:S 03 Dec 2019 16:16:11.980 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
83361:S 03 Dec 2019 16:16:11.981 * <ft> RediSearch version 1.4.18 (Git=v1.4.18)
83361:S 03 Dec 2019 16:16:11.981 * <ft> concurrency: OFF(SAFEMODE), gc: ON, prefix min length: 2, prefix max expansions: 200, query timeout (ms): 500, timeout policy: return, cursor read size: 1000, cursor max idle (ms): 300000, max doctable size: 1000000, search pool size: 20, index pool size: 8, 
83361:S 03 Dec 2019 16:16:11.990 * <ft> Initialized thread pool!
83361:S 03 Dec 2019 16:16:11.991 * Module 'ft' loaded from /var/lib/redis/redisearch.so
83361:S 03 Dec 2019 16:16:13.830 * DB loaded from disk: 1.839 seconds
83361:S 03 Dec 2019 16:16:13.830 * Before turning into a replica, using my master parameters to synthesize a cached master: I may be able to synchronize with the new master with just a partial transfer.
83361:S 03 Dec 2019 16:16:13.830 * Ready to accept connections

MeirShpilraien · 2019-12-11T19:24:37Z

Running with FORKGC

MeirShpilraien · 2019-12-11T19:28:30Z

@dme-development I see you have expiring keys, could it be that you accidentally set expiration on one of RediSearch internal keys ?

dme-development · 2019-12-11T19:31:59Z

@MeirShpilraien Also: running in SAFEMODE.

We have some expiring keys, but all of them are not indexed by RediSearch. We don't put a TTL on the objects/keys that are in the index.

MeirShpilraien · 2019-12-22T16:39:17Z

@dme-development we just tagged 1.6.5, there are many forkgc fixes there, is it possible for you to try it?

dme-development · 2019-12-23T06:28:59Z

@MeirShpilraien I think this is not an option. We're seeing these crashes only in our production environment where there is loads of traffic & concurrent operations. Since we are still running 1.4., my CIO will not approve testing the 1.6. in production. This is also still a RC, I believe?
I can test it on our other environments, but it would be impossible to see if the crashes still occur.
You have no way to merge these fixes into the 1.4 branch?

MeirShpilraien · 2019-12-23T09:56:01Z

@dme-development will backport to 1.4.20, its already on this PR: #1022

MeirShpilraien · 2020-01-02T20:52:31Z

@dme-development We just released 1.4.20, can you give it a try?

dme-development · 2020-01-08T07:34:46Z

@MeirShpilraien Bad news: still crashing on 1.4.20

=== REDIS BUG REPORT START: Cut & paste starting from here ===
58129:S 07 Jan 2020 21:59:23.176 # Redis 5.0.3 crashed by signal: 11
58129:S 07 Jan 2020 21:59:23.176 # Crashed running the instruction at: 0x7fedffa66088
58129:S 07 Jan 2020 21:59:23.176 # Accessing address: (nil)
58129:S 07 Jan 2020 21:59:23.176 # Failed assertion: <no assertion failed> (<no file>:0)

------ STACK TRACE ------
EIP:
/lib/x86_64-linux-gnu/libc.so.6(+0x129088)[0x7fedffa66088]

Backtrace:
/usr/bin/redis-server 127.0.0.1:6379(logStackTrace+0x4a)[0x5622849cad6a]
/usr/bin/redis-server 127.0.0.1:6379(sigsegvHandler+0xc3)[0x5622849cb533]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7fedffced0e0]
/lib/x86_64-linux-gnu/libc.so.6(+0x129088)[0x7fedffa66088]
/var/lib/redis/redisearch.so(+0x840ef)[0x7fedfd3130ef]
/var/lib/redis/redisearch.so(+0x8793b)[0x7fedfd31693b]
/var/lib/redis/redisearch.so(IR_Read+0x97)[0x7fedfd3171aa]
/var/lib/redis/redisearch.so(IR_SkipTo+0xd8)[0x7fedfd31753a]
/var/lib/redis/redisearch.so(+0x7e896)[0x7fedfd30d896]
/var/lib/redis/redisearch.so(+0x7e1f3)[0x7fedfd30d1f3]
/var/lib/redis/redisearch.so(+0x7da2f)[0x7fedfd30ca2f]
/var/lib/redis/redisearch.so(+0x7e4d5)[0x7fedfd30d4d5]
/var/lib/redis/redisearch.so(baseResultProcessor_Next+0x87)[0x7fedfd3330fd]
/var/lib/redis/redisearch.so(+0xa3e93)[0x7fedfd332e93]
/var/lib/redis/redisearch.so(scorerProcessor_Next+0x37)[0x7fedfd33326b]
/var/lib/redis/redisearch.so(+0xa3e93)[0x7fedfd332e93]
/var/lib/redis/redisearch.so(sorter_Next+0xac)[0x7fedfd3337a3]
/var/lib/redis/redisearch.so(+0xa3e93)[0x7fedfd332e93]
/var/lib/redis/redisearch.so(pager_Next+0x37)[0x7fedfd333db7]
/var/lib/redis/redisearch.so(+0xa3e93)[0x7fedfd332e93]
/var/lib/redis/redisearch.so(loader_Next+0x37)[0x7fedfd334161]
/var/lib/redis/redisearch.so(+0x9eedc)[0x7fedfd32dedc]
/var/lib/redis/redisearch.so(+0x9f43f)[0x7fedfd32e43f]
/var/lib/redis/redisearch.so(QueryPlan_Run+0x23)[0x7fedfd32edc8]
/var/lib/redis/redisearch.so(_SearchCommand+0x284)[0x7fedfd31b37f]
/var/lib/redis/redisearch.so(+0x8c490)[0x7fedfd31b490]
/usr/bin/redis-server 127.0.0.1:6379(RedisModuleCommandDispatcher+0x53)[0x5622849f8763]
/usr/bin/redis-server 127.0.0.1:6379(call+0xb7)[0x562284984a07]
/usr/bin/redis-server 127.0.0.1:6379(processCommand+0x38f)[0x5622849850ff]
/usr/bin/redis-server 127.0.0.1:6379(processInputBuffer+0x185)[0x562284995a55]
/usr/bin/redis-server 127.0.0.1:6379(aeProcessEvents+0x2d0)[0x56228497e4e0]
/usr/bin/redis-server 127.0.0.1:6379(aeMain+0x2b)[0x56228497e79b]
/usr/bin/redis-server 127.0.0.1:6379(main+0x4db)[0x562284978ceb]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7fedff95d2e1]
/usr/bin/redis-server 127.0.0.1:6379(_start+0x2a)[0x562284978f4a]

------ INFO OUTPUT ------
# Server
redis_version:5.0.3
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:9a0d28f504862808
redis_mode:standalone
os:Linux 4.9.0-9-amd64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:6.3.0
process_id:58129
run_id:10622aac45bb1ff393f94c4d8ed4ee807170435e
tcp_port:6379
uptime_in_seconds:9882
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:1372459
executable:/usr/bin/redis-server
config_file:/etc/redis/redis.conf

# Clients
connected_clients:75
client_recent_max_input_buffer:2
client_recent_max_output_buffer:697192
blocked_clients:0

# Memory
used_memory:536485432
used_memory_human:511.63M
used_memory_rss:524779520
used_memory_rss_human:500.47M
used_memory_peak:538263184
used_memory_peak_human:513.33M
used_memory_peak_perc:99.67%
used_memory_overhead:11595694
used_memory_startup:787848
used_memory_dataset:524889738
used_memory_dataset_perc:97.98%
allocator_allocated:537858440
allocator_active:556474368
allocator_resident:524711936
total_system_memory:8356696064
total_system_memory_human:7.78G
used_memory_lua:67584
used_memory_lua_human:66.00K
used_memory_scripts:4440
used_memory_scripts_human:4.34K
number_of_cached_scripts:7
maxmemory:6442450944
maxmemory_human:6.00G
maxmemory_policy:noeviction
allocator_frag_ratio:1.03
allocator_frag_bytes:18615928
allocator_rss_ratio:0.94
allocator_rss_bytes:-31762432
rss_overhead_ratio:1.00
rss_overhead_bytes:67584
mem_fragmentation_ratio:0.98
mem_fragmentation_bytes:-11808616
mem_not_counted_for_evict:0
mem_replication_backlog:1048576
mem_clients_slaves:0
mem_clients_normal:1727958
mem_aof_buffer:0
mem_allocator:jemalloc-3.6.0
active_defrag_running:0
lazyfree_pending_objects:0

# Persistence
loading:0
rdb_changes_since_last_save:2591
rdb_bgsave_in_progress:0
rdb_last_save_time:1578430672
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:2
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:47443968
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0

# Stats
total_connections_received:1287
total_commands_processed:3851124
instantaneous_ops_per_sec:259
total_net_input_bytes:1264596807
total_net_output_bytes:47398142637
instantaneous_input_kbps:82.21
instantaneous_output_kbps:2240.45
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:149714348
keyspace_misses:759506
pubsub_channels:2
pubsub_patterns:0
latest_fork_usec:13391
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0

# Replication
role:slave
master_host:192.168.224.23
master_port:6379
master_link_status:up
master_last_io_seconds_ago:0
master_sync_in_progress:0
slave_repl_offset:21141155967
slave_priority:0
slave_read_only:1
connected_slaves:0
master_replid:addbbb8abe0cb29b1bb51b8169166f345970618e
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:21141155967
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:21140107392
repl_backlog_histlen:1048576

# CPU
used_cpu_sys:530.008000
used_cpu_user:3954.972000
used_cpu_sys_children:341.740000
used_cpu_user_children:240.136000

# Commandstats
cmdstat_expire:calls=11279,usec=36758,usec_per_call=3.26
cmdstat_del:calls=50955,usec=650340,usec_per_call=12.76
cmdstat_set:calls=202,usec=2646,usec_per_call=13.10
cmdstat_client:calls=162,usec=155,usec_per_call=0.96
cmdstat_hmset:calls=11279,usec=179222,usec_per_call=15.89
cmdstat_multi:calls=81553,usec=24410,usec_per_call=0.30
cmdstat_exec:calls=81553,usec=38151557,usec_per_call=467.81
cmdstat_FT.CREATE:calls=66,usec=1174,usec_per_call=17.79
cmdstat_unlink:calls=4754,usec=55851,usec_per_call=11.75
cmdstat_echo:calls=162,usec=84,usec_per_call=0.52
cmdstat_cluster:calls=81,usec=121,usec_per_call=1.49
cmdstat_config:calls=1263,usec=62428,usec_per_call=49.43
cmdstat_FT.SAFEADD:calls=81553,usec=36290398,usec_per_call=444.99
cmdstat_FT.AGGREGATE:calls=231645,usec=2538576669,usec_per_call=10958.91
cmdstat_ping:calls=34988,usec=33550,usec_per_call=0.96
cmdstat_publish:calls=29830,usec=228755,usec_per_call=7.67
cmdstat_setex:calls=51850,usec=596835,usec_per_call=11.51
cmdstat_hgetall:calls=1921571,usec=74946425,usec_per_call=39.00
cmdstat_FT.SEARCH:calls=128756,usec=1432071639,usec_per_call=11122.37
cmdstat_info:calls=9941,usec=629078,usec_per_call=63.28
cmdstat_get:calls=757154,usec=8707937,usec_per_call=11.50
cmdstat_select:calls=360362,usec=490974,usec_per_call=1.36
cmdstat_auth:calls=6,usec=4,usec_per_call=0.67
cmdstat_exists:calls=9,usec=52,usec_per_call=5.78
cmdstat_subscribe:calls=150,usec=923,usec_per_call=6.15

# Cluster
cluster_enabled:0

# Keyspace
db0:keys=132135,expires=15924,avg_ttl=0

------ CLIENT LIST OUTPUT ------
id=234 addr=192.168.223.10:62341 fd=69 name=SEWWSP004 age=9874 idle=6 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=237 addr=192.168.223.10:62344 fd=72 name=SEWWSP004 age=9874 idle=27 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=238 addr=192.168.223.10:62343 fd=73 name=SEWWSP004 age=9874 idle=27 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=196 addr=192.168.223.8:16939 fd=61 name=SEWWSP001 age=9874 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=189 addr=192.168.223.8:16934 fd=54 name=SEWWSP001 age=9874 idle=5 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=190 addr=192.168.223.8:16933 fd=55 name=SEWWSP001 age=9874 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=1405726 addr=192.168.223.10:61209 fd=19 name=SEWWSP004 age=869 idle=26 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=1405727 addr=192.168.223.10:61212 fd=44 name=SEWWSP004 age=869 idle=26 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=180 addr=192.168.223.21:52754 fd=46 name=SEWWSP005 age=9874 idle=41 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=181 addr=192.168.223.21:52755 fd=47 name=SEWWSP005 age=9874 idle=41 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=182 addr=192.168.223.9:19219 fd=48 name=SEWWSP002 age=9874 idle=54 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=416683 addr=192.168.223.12:50541 fd=56 name=SESFSP002 age=7107 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.AGGREGATE
id=416684 addr=192.168.223.12:50542 fd=57 name=SESFSP002 age=7107 idle=9 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=183 addr=192.168.223.9:19220 fd=49 name=SEWWSP002 age=9874 idle=54 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=174 addr=192.168.223.9:19216 fd=40 name=SEWWSP002 age=9874 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=175 addr=192.168.223.9:19217 fd=41 name=SEWWSP002 age=9874 idle=53 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=165 addr=192.168.223.8:16922 fd=31 name=SEWWSP001 age=9874 idle=6 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=166 addr=192.168.223.10:62332 fd=32 name=SEWWSP004 age=9874 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=167 addr=192.168.223.10:62333 fd=33 name=SEWWSP004 age=9874 idle=17 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=168 addr=192.168.223.8:16925 fd=34 name=SEWWSP001 age=9874 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=169 addr=192.168.223.8:16926 fd=35 name=SEWWSP001 age=9874 idle=6 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=159 addr=192.168.223.22:49579 fd=25 name=SEWWSP006 age=9874 idle=51 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=160 addr=192.168.223.8:16919 fd=26 name=SEWWSP001 age=9874 idle=6 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=161 addr=192.168.223.8:16918 fd=27 name=SEWWSP001 age=9874 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=162 addr=192.168.223.6:58498 fd=28 name=SEWWWP003 age=9874 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=163 addr=192.168.223.6:58497 fd=29 name=SEWWWP003 age=9874 idle=4 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=146 addr=192.168.224.23:6379 fd=9 name= age=9875 idle=0 flags=M db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=setex
id=4 addr=192.168.224.24:47177 fd=11 name= age=9881 idle=1 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe
id=5 addr=192.168.224.22:56075 fd=12 name= age=9881 idle=1 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe
id=6 addr=192.168.224.22:54185 fd=13 name= age=9881 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=ping
id=7 addr=192.168.224.23:54101 fd=14 name= age=9881 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=publish
id=8 addr=192.168.224.23:47037 fd=15 name= age=9881 idle=1 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=subscribe
id=3 addr=192.168.224.24:50889 fd=10 name= age=9881 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=150 addr=192.168.223.17:62877 fd=16 name=SEWWWP005 age=9874 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=151 addr=192.168.223.17:62878 fd=17 name=SEWWWP005 age=9874 idle=6 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=604 addr=192.168.223.10:62374 fd=82 name=SEWWSP004 age=9871 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.AGGREGATE
id=605 addr=192.168.223.10:62375 fd=83 name=SEWWSP004 age=9871 idle=25 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=152 addr=192.168.223.10:62328 fd=18 name=SEWWSP004 age=9874 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=154 addr=192.168.223.10:62329 fd=20 name=SEWWSP004 age=9874 idle=58 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=586482 addr=192.168.223.8:8702 fd=21 name=SEWWSP001 age=6062 idle=55 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=586483 addr=192.168.223.8:8703 fd=84 name=SEWWSP001 age=6062 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=158 addr=192.168.223.22:49578 fd=24 name=SEWWSP006 age=9874 idle=51 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=164 addr=192.168.223.8:16923 fd=30 name=SEWWSP001 age=9874 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=170 addr=192.168.223.8:16927 fd=36 name=SEWWSP001 age=9874 idle=6 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=171 addr=192.168.223.8:16928 fd=37 name=SEWWSP001 age=9874 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=184 addr=192.168.223.10:62337 fd=50 name=SEWWSP004 age=9874 idle=56 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=185 addr=192.168.223.10:62338 fd=51 name=SEWWSP004 age=9874 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=193 addr=192.168.223.8:16936 fd=58 name=SEWWSP001 age=9874 idle=5 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=255 addr=192.168.223.10:62348 fd=76 name=SEWWSP004 age=9874 idle=55 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=256 addr=192.168.223.10:62349 fd=77 name=SEWWSP004 age=9874 idle=55 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=257 addr=192.168.223.8:16942 fd=78 name=SEWWSP001 age=9874 idle=10 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=547414 addr=192.168.223.9:6090 fd=22 name=SEWWSP002 age=6302 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=547415 addr=192.168.223.9:6091 fd=23 name=SEWWSP002 age=6302 idle=36 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=547416 addr=192.168.223.18:53711 fd=38 name=SEWWWP006 age=6302 idle=7 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=547417 addr=192.168.223.18:53712 fd=39 name=SEWWWP006 age=6302 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=547418 addr=192.168.223.4:58293 fd=42 name=SEWWWP001 age=6302 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=547419 addr=192.168.223.4:58294 fd=43 name=SEWWWP001 age=6302 idle=9 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=547420 addr=192.168.223.5:51841 fd=52 name=SEWWWP002 age=6302 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=547421 addr=192.168.223.5:51842 fd=53 name=SEWWWP002 age=6302 idle=11 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=547422 addr=192.168.223.8:6825 fd=59 name=SEWWSP001 age=6302 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=547423 addr=192.168.223.8:6828 fd=60 name=SEWWSP001 age=6302 idle=35 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=547424 addr=192.168.223.8:6830 fd=64 name=SEWWSP001 age=6302 idle=35 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=547425 addr=192.168.223.8:6832 fd=70 name=SEWWSP001 age=6302 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=1169 qbuf-free=31599 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
id=547426 addr=192.168.223.9:6098 fd=65 name=SEWWSP002 age=6302 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=12656 oll=0 omem=0 events=r cmd=hgetall
id=547427 addr=192.168.223.9:6099 fd=71 name=SEWWSP002 age=6302 idle=36 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=258 addr=192.168.223.8:16943 fd=79 name=SEWWSP001 age=9874 idle=10 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=259 addr=192.168.223.9:19233 fd=80 name=SEWWSP002 age=9874 idle=48 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=243822 addr=192.168.223.13:49614 fd=45 name=SESFSP003 age=8257 idle=24 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=243823 addr=192.168.223.13:49613 fd=62 name=SESFSP003 age=8257 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=FT.AGGREGATE
id=260 addr=192.168.223.9:19232 fd=81 name=SEWWSP002 age=9874 idle=48 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=231 addr=192.168.223.8:16941 fd=66 name=SEWWSP001 age=9874 idle=52 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=232 addr=192.168.223.8:16940 fd=67 name=SEWWSP001 age=9874 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=245 addr=192.168.223.10:62345 fd=74 name=SEWWSP004 age=9874 idle=53 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=246 addr=192.168.223.10:62346 fd=75 name=SEWWSP004 age=9874 idle=53 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=233 addr=192.168.223.10:62340 fd=68 name=SEWWSP004 age=9874 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info

------ CURRENT CLIENT INFO ------
id=547425 addr=192.168.223.8:6832 fd=70 name=SEWWSP001 age=6302 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=1169 qbuf-free=31599 obl=0 oll=0 omem=0 events=r cmd=FT.SEARCH
argv[0]: 'FT.SEARCH'
argv[1]: 'idxCachedAuctionItem'
argv[2]: '(((((-@RestrictionCountryCodesInclude:[0 0] -@RestrictionCountryCodesInclude:[1 1])|(@RestrictionCountryCodesInclude:[1 1] @RestrictionCountryCodes:{hu})|(@RestrictionCountryCodesInclude:[0 0] -@RestrictionCountryCodes:{hu})) ((-@RestrictionCompanyStatusIdsInclude:[0 0] -@RestrictionCompanyStatusIdsInclude:[1 1])|(@RestrictionCompanyStatusIdsInclude:[1 1] @RestrictionCompanyStatusIds:{0})|(@RestrictionCompanyStatusIdsInclude:[0 0] -@RestrictionCompanyStatusIds:{0}))) ((-@RestrictionCompanyIdsInclude:[0 0] -@RestrictionCompanyIdsInclude:[1 1])|(@RestrictionCompanyIdsInclude:[1 1] @RestrictionCompanyIds:{0})|(@RestrictionCompanyIdsInclude:[0 0] -@RestrictionCompanyIds:{0}))) ((@AuctionId:[1 2147483647] @HasBuyNowBidPlaced:[0 0]) (((@BatchStartDate:[-inf 1578434363] @BatchEndDate:[1578434363 +inf]) (((@StatusId:[2 2]|@StatusId:[50 50])|@StatusId:[40 40])|@StatusId:[41 41]))|((((@BatchStartDate:[-inf 1578434363] @BatchEndDate:[-inf 1578434363]) @WillBeExtended:[1 1]) @IsExtendedPhaseFinished:[0 0]) (((argv[3]: 'LIMIT'
argv[4]: '0'
argv[5]: '0'

------ REGISTERS ------
58129:S 07 Jan 2020 21:59:23.178 # 
RAX:00007ffe214fd727 RBX:00007fedd0778000
RCX:0b0e011001010220 RDX:0000000000000001
RDI:00007ffe214fd727 RSI:0b0e011001010220
RBP:00007ffe214fd6d0 RSP:00007ffe214fd6a8
R8 :00007fedfd316902 R9 :6449737574617453
R10:00007fedcaf6f173 R11:0000000000000293
R12:0000000000000000 R13:0000000000000000
R14:00059b930cf002a5 R15:000000000000000f
RIP:00007fedffa66088 EFL:0000000000010246
CSGSFS:002b000000000033
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6b7) -> 0000000000000000
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6b6) -> 00007feddf3fde40
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6b5) -> 00007ffe214fd768
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6b4) -> 00007feddf3fd120
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6b3) -> 00007fedca4b1dd0
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6b2) -> 0000000000000000
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6b1) -> 00007fedcd08a7c0
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6b0) -> 00007fedfd31753a
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6af) -> 00007ffe214fd730
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6ae) -> 00007fedfd31693b
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6ad) -> 00007ffe214fd730
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6ac) -> 00007feddf3fd120
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6ab) -> 00007ffe214fd727
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6aa) -> 0000000000000001
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6a9) -> 00007ffe214fd768
58129:S 07 Jan 2020 21:59:23.178 # (00007ffe214fd6a8) -> 00007fedfd3130ef

------ FAST MEMORY TEST ------
58129:S 07 Jan 2020 21:59:23.179 # Bio thread for job type #0 terminated
58129:S 07 Jan 2020 21:59:23.179 # Bio thread for job type #1 terminated
58129:S 07 Jan 2020 21:59:23.179 # Bio thread for job type #2 terminated
*** Preparing to test memory region 562284c49000 (94208 bytes)
*** Preparing to test memory region 7fedc9000000 (239075328 bytes)
*** Preparing to test memory region 7fedd77fe000 (8388608 bytes)
*** Preparing to test memory region 7fedd7fff000 (8388608 bytes)
*** Preparing to test memory region 7fedd8800000 (25165824 bytes)
*** Preparing to test memory region 7fedda400000 (25165824 bytes)
*** Preparing to test memory region 7feddc000000 (88080384 bytes)
*** Preparing to test memory region 7fede1800000 (109051904 bytes)
*** Preparing to test memory region 7fede8c00000 (121634816 bytes)
*** Preparing to test memory region 7fedf0400000 (29360128 bytes)
*** Preparing to test memory region 7fedf227a000 (8388608 bytes)
*** Preparing to test memory region 7fedf2a7b000 (8388608 bytes)
*** Preparing to test memory region 7fedf327c000 (8388608 bytes)
*** Preparing to test memory region 7fedf3a7d000 (8388608 bytes)
*** Preparing to test memory region 7fedf427e000 (8388608 bytes)
*** Preparing to test memory region 7fedf4a7f000 (8388608 bytes)
*** Preparing to test memory region 7fedf5280000 (8388608 bytes)
*** Preparing to test memory region 7fedf5a81000 (8388608 bytes)
*** Preparing to test memory region 7fedf6282000 (8388608 bytes)
*** Preparing to test memory region 7fedf6a83000 (8388608 bytes)
*** Preparing to test memory region 7fedf7284000 (8388608 bytes)
*** Preparing to test memory region 7fedf7a85000 (8388608 bytes)
*** Preparing to test memory region 7fedf8286000 (8388608 bytes)
*** Preparing to test memory region 7fedf8a87000 (8388608 bytes)
*** Preparing to test memory region 7fedf9288000 (8388608 bytes)
*** Preparing to test memory region 7fedf9a89000 (8388608 bytes)
*** Preparing to test memory region 7fedfa28a000 (8388608 bytes)
*** Preparing to test memory region 7fedfaa8b000 (8388608 bytes)
*** Preparing to test memory region 7fedfb28c000 (8388608 bytes)
*** Preparing to test memory region 7fedfba8d000 (8388608 bytes)
*** Preparing to test memory region 7fedfc28e000 (8388608 bytes)
*** Preparing to test memory region 7fedfca8f000 (8388608 bytes)
*** Preparing to test memory region 7fedfd7fa000 (12288 bytes)
*** Preparing to test memory region 7fedfd7fe000 (8388608 bytes)
*** Preparing to test memory region 7fedfdfff000 (8388608 bytes)
*** Preparing to test memory region 7fedfe800000 (8388608 bytes)
*** Preparing to test memory region 7fedff000000 (8388608 bytes)
*** Preparing to test memory region 7fedffcd8000 (16384 bytes)
*** Preparing to test memory region 7fedffef5000 (16384 bytes)
*** Preparing to test memory region 7fee0084b000 (4096 bytes)
*** Preparing to test memory region 7fee0108c000 (4096 bytes)
*** Preparing to test memory region 7fee014a7000 (24576 bytes)
*** Preparing to test memory region 7fee014b6000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.

------ DUMPING CODE AROUND EIP ------
Symbol: (null) (base: (nil))
Module: /lib/x86_64-linux-gnu/libc.so.6 (base 0x7fedff93d000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=(nil) -D -b binary -m i386:x86-64 /tmp/dump.bin
------

=== REDIS BUG REPORT END. Make sure to include from START to END. ===

       Please report the crash by opening an issue on github:

           http://github.com/antirez/redis/issues

  Suspect RAM error? Use redis-server --test-memory to verify it.

8854:C 07 Jan 2020 21:59:27.214 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
8854:C 07 Jan 2020 21:59:27.214 # Redis version=5.0.3, bits=64, commit=00000000, modified=0, pid=8854, just started
8854:C 07 Jan 2020 21:59:27.214 # Configuration loaded
                _._                                                  
           _.-``__ ''-._                                             
      _.-``    `.  `_.  ''-._           Redis 5.0.3 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._                                   
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 8855
  `-._    `-._  `-./  _.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |           http://redis.io        
  `-._    `-._`-.__.-'_.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |                                  
  `-._    `-._`-.__.-'_.-'    _.-'                                   
      `-._    `-.__.-'    _.-'                                       
          `-._        _.-'                                           
              `-.__.-'                                               

8855:S 07 Jan 2020 21:59:27.219 # Server initialized
8855:S 07 Jan 2020 21:59:27.220 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
8855:S 07 Jan 2020 21:59:27.220 * <ft> RediSearch version 1.4.20 (Git=v1.4.20)
8855:S 07 Jan 2020 21:59:27.220 * <ft> concurrency: OFF(SAFEMODE), gc: ON, prefix min length: 2, prefix max expansions: 200, query timeout (ms): 500, timeout policy: return, cursor read size: 1000, cursor max idle (ms): 300000, max doctable size: 1000000, search pool size: 20, index pool size: 8, 
8855:S 07 Jan 2020 21:59:27.236 * <ft> Initialized thread pool!
8855:S 07 Jan 2020 21:59:27.236 * Module 'ft' loaded from /var/lib/redis/redisearch.so

gkorland · 2020-10-19T14:02:13Z

@dme-development is the issue still relevant? did you try 1.4.28 / 1.6.14?

dme-development · 2020-10-19T14:43:56Z

@gkorland: impossible for me to say. I switched companies and haven't worked on RediSearch for months. I guess you can close the issue.

github-actions · 2025-04-09T02:09:00Z

This issue is stale because it has been open for 60 days with no activity.

gkorland assigned MeirShpilraien Oct 15, 2019

MeirShpilraien mentioned this issue Nov 11, 2019

Fork gc short read fixes #979

Merged

dme-development changed the title ~~RediSearch crash on v1.4.16~~ RediSearch crash on v1.4.16 & also on v1.4.20 Jan 23, 2020

emmanuelkeller added this to the 1.4.18 milestone Dec 14, 2020

emmanuelkeller added the c:bug label Dec 14, 2020

github-actions bot added the stale label Apr 9, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

RediSearch crash on v1.4.16 & also on v1.4.20 #947

RediSearch crash on v1.4.16 & also on v1.4.20 #947

dme-development commented Oct 14, 2019

MeirShpilraien commented Oct 15, 2019

dme-development commented Oct 15, 2019

MeirShpilraien commented Oct 15, 2019

dme-development commented Oct 15, 2019

MeirShpilraien commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

ebinezar commented Nov 5, 2019

MeirShpilraien commented Nov 5, 2019

dme-development commented Dec 11, 2019

MeirShpilraien commented Dec 11, 2019

MeirShpilraien commented Dec 11, 2019

MeirShpilraien commented Dec 11, 2019

dme-development commented Dec 11, 2019

MeirShpilraien commented Dec 22, 2019

dme-development commented Dec 23, 2019

MeirShpilraien commented Dec 23, 2019

MeirShpilraien commented Jan 2, 2020

dme-development commented Jan 8, 2020

gkorland commented Oct 19, 2020

dme-development commented Oct 19, 2020

github-actions bot commented Apr 9, 2025

RediSearch crash on v1.4.16 & also on v1.4.20 #947

RediSearch crash on v1.4.16 & also on v1.4.20 #947

Comments

dme-development commented Oct 14, 2019

Server

Clients

Memory

Persistence

Stats

Replication

CPU

Commandstats

Cluster

Keyspace

MeirShpilraien commented Oct 15, 2019

dme-development commented Oct 15, 2019

MeirShpilraien commented Oct 15, 2019

dme-development commented Oct 15, 2019

MeirShpilraien commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

MeirShpilraien commented Oct 16, 2019

dme-development commented Oct 16, 2019

ebinezar commented Nov 5, 2019

MeirShpilraien commented Nov 5, 2019

dme-development commented Dec 11, 2019

MeirShpilraien commented Dec 11, 2019

MeirShpilraien commented Dec 11, 2019

MeirShpilraien commented Dec 11, 2019

dme-development commented Dec 11, 2019

MeirShpilraien commented Dec 22, 2019

dme-development commented Dec 23, 2019

MeirShpilraien commented Dec 23, 2019

MeirShpilraien commented Jan 2, 2020

dme-development commented Jan 8, 2020

gkorland commented Oct 19, 2020

dme-development commented Oct 19, 2020

github-actions bot commented Apr 9, 2025