You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-04 - 23:21

x86 Intel Xeon E3-1220 @3100 MHz, Linux 4.19.1-rt3 (Profile)

Latency plot of system in rack #2, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sat Feb 04, 2023 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
68842580,0sleep30-21swapper/310:56:123
7102540,0sleep10-21swapper/109:50:211
223842530,0sleep30-21swapper/309:39:583
1360624937,7sleep10-21swapper/107:08:011
116502490,0sleep10-21swapper/110:49:381
116502490,0sleep10-21swapper/110:49:371
38442480,0sleep10-21swapper/110:23:301
29182480,0sleep00-21swapper/009:26:530
229362450,0sleep20-21swapper/212:12:532
103662330,0sleep20-21swapper/209:36:452
1363923110,7sleep20-21swapper/207:08:262
1371822715,7sleep00-21swapper/007:09:240
119832219,7sleep30-21swapper/307:05:113
60552170,0sleep00-21swapper/010:07:540
52042170,0sleep00-21swapper/011:04:020
250582170,1sleep1231rcuc/109:40:241
146972150,1sleep214696-21bash10:01:562
151772140,0sleep20-21swapper/209:21:552
151422140,0sleep30-21swapper/312:02:523
312132130,0sleep10-21swapper/110:30:141
312132130,0sleep10-21swapper/110:30:141
179902130,0sleep20-21swapper/211:55:262
1388299130,1cyclictest7206-21systemd-cgroups11:28:392
185362120,0sleep20-21swapper/210:19:102
13883991210,1cyclictest13810-21grep10:25:453
1388399120,1cyclictest619-21systemd-logind11:28:453
1388399120,1cyclictest24770-21tty11:00:353
13883991110,0cyclictest0-21swapper/311:06:353
1388399110,10cyclictest13880-21bash11:30:153
13882991110,0cyclictest0-21swapper/211:01:592
13882991110,0cyclictest0-21swapper/209:57:582
1388299110,10cyclictest0-21swapper/211:39:002
1388299110,10cyclictest0-21swapper/210:25:282
1388299110,10cyclictest0-21swapper/210:11:482
1388299110,10cyclictest0-21swapper/209:18:582
1388299110,0cyclictest0-21swapper/210:37:292
1387999118,1cyclictest24250-21sshd10:52:351
1387999110,10cyclictest0-21swapper/111:59:151
1387999110,0cyclictest0-21swapper/110:10:051
13873991110,0cyclictest0-21swapper/011:43:350
1387399110,10cyclictest3681-21tty09:51:050
1387399110,10cyclictest0-21swapper/010:45:250
1387399110,10cyclictest0-21swapper/010:45:250
1387399110,10cyclictest0-21swapper/009:15:350
1388399109,0cyclictest0-21swapper/312:30:553
1388399109,0cyclictest0-21swapper/311:44:553
1388399109,0cyclictest0-21swapper/311:39:053
1388399109,0cyclictest0-21swapper/310:30:163
1388399109,0cyclictest0-21swapper/310:30:153
1388399100,0cyclictest0-21swapper/309:49:153
1388399100,0cyclictest0-21swapper/309:17:563
1388299109,0cyclictest8546-21sshd10:40:292
1388299109,0cyclictest0-21swapper/212:33:492
1388299109,0cyclictest0-21swapper/211:30:092
1388299109,0cyclictest0-21swapper/210:55:492
1388299109,0cyclictest0-21swapper/210:23:582
1388299109,0cyclictest0-21swapper/209:44:282
1388299108,1cyclictest23893-21/usr/sbin/munin08:50:182
1388299100,0cyclictest0-21swapper/211:44:492
1387999109,0cyclictest0-21swapper/112:29:251
1387999109,0cyclictest0-21swapper/112:22:151
1387999109,0cyclictest0-21swapper/112:07:551
1387999100,9cyclictest0-21swapper/112:36:361
1387999100,9cyclictest0-21swapper/111:10:461
1387999100,9cyclictest0-21swapper/110:19:151
1387999100,9cyclictest0-21swapper/110:02:251
1387999100,0cyclictest0-21swapper/111:35:561
1387999100,0cyclictest0-21swapper/109:35:251
1387999100,0cyclictest0-21swapper/109:24:551
1387999100,0cyclictest0-21swapper/108:35:151
1387399109,0cyclictest0-21swapper/009:57:150
1387399108,1cyclictest31426-21sshd09:10:050
1387399102,4cyclictest20496-21munin-run07:25:000
1387399100,9cyclictest0-21swapper/011:56:350
1387399100,0cyclictest0-21swapper/012:18:050
1387399100,0cyclictest0-21swapper/011:37:460
1387399100,0cyclictest0-21swapper/010:57:450
138839998,0cyclictest0-21swapper/311:55:063
138839998,0cyclictest0-21swapper/311:50:453
138839998,0cyclictest0-21swapper/310:19:453
138839998,0cyclictest0-21swapper/310:07:363
138839998,0cyclictest0-21swapper/309:55:153
138839990,0cyclictest0-21swapper/310:22:453
138829998,0cyclictest0-21swapper/212:26:392
138829998,0cyclictest0-21swapper/211:18:192
138829990,0cyclictest0-21swapper/208:14:282
138829990,0cyclictest0-21swapper/207:45:282
138799998,0cyclictest0-21swapper/112:12:161
138799998,0cyclictest0-21swapper/111:25:351
138799998,0cyclictest0-21swapper/109:47:151
138799996,2cyclictest614-21dbus-daemon12:30:151
138799990,0cyclictest0-21swapper/111:49:061
138739998,0cyclictest0-21swapper/012:38:060
138739998,0cyclictest0-21swapper/012:30:550
138739998,0cyclictest0-21swapper/012:00:560
138739998,0cyclictest0-21swapper/009:40:550
138739998,0cyclictest0-21swapper/008:09:550
138739990,0cyclictest0-21swapper/009:46:460
17577280,1sleep117580-21bash10:26:461
138839987,0cyclictest0-21swapper/312:35:153
138839986,1cyclictest643-21gdbus11:17:363
138839986,1cyclictest598-21avahi-daemon09:51:563
138839986,1cyclictest15024-21bash09:30:053
138839986,1cyclictest0-21swapper/309:13:453
138839985,2cyclictest598-21avahi-daemon12:05:353
138839985,2cyclictest598-21avahi-daemon11:45:233
138839985,2cyclictest598-21avahi-daemon10:48:463
138839985,2cyclictest598-21avahi-daemon10:48:453
138839985,2cyclictest598-21avahi-daemon10:42:583
138839985,2cyclictest598-21avahi-daemon10:37:263
138839985,2cyclictest598-21avahi-daemon10:01:083
138839985,2cyclictest598-21avahi-daemon09:44:333
138829987,0cyclictest0-21swapper/212:16:392
138829987,0cyclictest0-21swapper/209:51:482
138829987,0cyclictest0-21swapper/209:31:092
138829987,0cyclictest0-21swapper/208:58:282
138829986,1cyclictest598-21avahi-daemon12:00:282
138829985,2cyclictest598-21avahi-daemon12:23:302
138829985,2cyclictest598-21avahi-daemon11:47:332
138829985,2cyclictest598-21avahi-daemon11:11:502
138829985,2cyclictest598-21avahi-daemon11:08:442
138829985,2cyclictest598-21avahi-daemon10:53:212
138829985,2cyclictest598-21avahi-daemon10:49:332
138829985,2cyclictest598-21avahi-daemon10:49:322
138829985,2cyclictest598-21avahi-daemon09:49:162
138829985,2cyclictest598-21avahi-daemon09:26:382
138829984,3cyclictest633-21polkitd09:12:072
138799987,0cyclictest0-21swapper/110:08:351
138799985,2cyclictest598-21avahi-daemon12:17:261
138799985,2cyclictest598-21avahi-daemon11:31:511
138799985,2cyclictest598-21avahi-daemon11:16:001
138799985,2cyclictest598-21avahi-daemon10:58:391
138739987,0cyclictest0-21swapper/011:30:250
138739987,0cyclictest0-21swapper/011:11:160
138739987,0cyclictest0-21swapper/010:42:260
138739986,2cyclictest4441-21kworker/0:110:50:360
138739986,2cyclictest420-21kworker/0:212:22:480
138739986,2cyclictest30344-21kworker/0:309:35:040
138739986,2cyclictest27820-21kworker/0:210:02:080
138739986,2cyclictest26358-21kworker/0:112:27:010
138739986,2cyclictest18940-21kworker/0:109:34:360
138739986,2cyclictest14916-21kworker/0:011:28:290
138739986,1cyclictest598-21avahi-daemon11:50:160
138739986,1cyclictest598-21avahi-daemon10:27:400
138739985,2cyclictest598-21avahi-daemon12:05:460
138739985,2cyclictest598-21avahi-daemon11:45:560
138739985,2cyclictest598-21avahi-daemon11:18:520
138739985,2cyclictest598-21avahi-daemon10:36:530
138739985,2cyclictest598-21avahi-daemon10:31:280
138739985,2cyclictest598-21avahi-daemon10:31:280
138739985,2cyclictest598-21avahi-daemon10:22:020
138839976,0cyclictest0-21swapper/311:21:263
138839976,0cyclictest0-21swapper/310:52:553
138839975,1cyclictest598-21avahi-daemon12:25:293
138839975,1cyclictest598-21avahi-daemon12:20:403
138839975,1cyclictest598-21avahi-daemon12:15:023
138839975,1cyclictest598-21avahi-daemon11:12:453
138839975,1cyclictest598-21avahi-daemon10:10:523
138839975,1cyclictest598-21avahi-daemon09:25:293
138839974,2cyclictest598-21avahi-daemon12:13:153
138839974,2cyclictest598-21avahi-daemon09:20:323
138829976,0cyclictest0-21swapper/212:05:092
138829975,1cyclictest598-21avahi-daemon11:53:122
138829975,1cyclictest598-21avahi-daemon10:09:442
138829974,2cyclictest633-21polkitd12:36:162
138829973,1cyclictest633-21polkitd11:21:532
138829972,2cyclictest614-21dbus-daemon10:31:142
138829972,2cyclictest614-21dbus-daemon10:31:132
138799976,0cyclictest0-21swapper/108:05:351
138799975,1cyclictest598-21avahi-daemon12:00:131
138799975,1cyclictest598-21avahi-daemon11:50:121
138799975,1cyclictest598-21avahi-daemon11:20:281
138799975,1cyclictest598-21avahi-daemon11:06:281
138799975,1cyclictest598-21avahi-daemon10:40:441
138799975,1cyclictest598-21avahi-daemon10:39:221
138799975,1cyclictest598-21avahi-daemon09:32:411
138799975,1cyclictest598-21avahi-daemon09:26:291
138799975,1cyclictest598-21avahi-daemon09:11:051
138799974,2cyclictest598-21avahi-daemon11:02:451
138799974,2cyclictest598-21avahi-daemon09:55:051
138799974,2cyclictest598-21avahi-daemon09:17:171
138739975,2cyclictest420-21kworker/0:212:13:120
138739975,2cyclictest25901-21kworker/0:311:20:560
138739975,1cyclictest598-21avahi-daemon11:06:190
138739974,2cyclictest598-21avahi-daemon10:15:160
138739974,2cyclictest598-21avahi-daemon10:11:250
138739974,2cyclictest598-21avahi-daemon09:21:510
138839965,0cyclictest0-21swapper/308:24:253
138839964,1cyclictest31034-21tr07:50:123
138839963,2cyclictest970-21snmpd08:03:063
138839963,2cyclictest970-21snmpd07:48:033
138839960,5cyclictest0-21swapper/307:15:053
138829964,1cyclictest598-21avahi-daemon09:04:552
138829960,0cyclictest0-21swapper/207:29:582
138799965,0cyclictest0-21swapper/107:34:451
138799964,1cyclictest614-21dbus-daemon11:40:101
138799964,1cyclictest1-21systemd08:55:011
138799963,2cyclictest970-21snmpd07:27:231
138799963,2cyclictest970-21snmpd07:12:231
138739966,0cyclictest32680-21kworker/0:208:21:140
138739966,0cyclictest32680-21kworker/0:208:15:580
138739966,0cyclictest32680-21kworker/0:208:10:300
138739966,0cyclictest32680-21kworker/0:208:01:140
138739966,0cyclictest32680-21kworker/0:207:55:060
138739966,0cyclictest28532-21kworker/0:009:06:140
138739966,0cyclictest22778-21kworker/0:109:00:540
138739966,0cyclictest22778-21kworker/0:108:55:070
138739966,0cyclictest22778-21kworker/0:108:51:220
138739966,0cyclictest20470-21kworker/0:107:50:340
138739966,0cyclictest20470-21kworker/0:107:45:100
138739966,0cyclictest20470-21kworker/0:107:41:140
138739966,0cyclictest20470-21kworker/0:107:35:540
138739966,0cyclictest20470-21kworker/0:107:30:420
138739966,0cyclictest20470-21kworker/0:107:25:460
138739966,0cyclictest15844-21kworker/0:207:16:060
138739966,0cyclictest12553-21kworker/0:308:45:060
138739966,0cyclictest12553-21kworker/0:308:40:420
138739966,0cyclictest12553-21kworker/0:308:40:420
138739966,0cyclictest12553-21kworker/0:308:35:160
138739966,0cyclictest12553-21kworker/0:308:30:060
138739966,0cyclictest12553-21kworker/0:308:25:110
138739965,0cyclictest11734-21kworker/0:007:11:580
26579250,0sleep10-21swapper/107:40:001
138839953,1cyclictest970-21snmpd09:06:593
138839953,1cyclictest970-21snmpd08:37:493
138839953,1cyclictest970-21snmpd08:30:583
138839953,1cyclictest970-21snmpd07:56:483
138839953,1cyclictest970-21snmpd07:41:573
138839953,1cyclictest970-21snmpd07:35:303
138839953,1cyclictest970-21snmpd07:30:413
138839953,1cyclictest598-21avahi-daemon08:11:353
138839953,1cyclictest5153-21cat08:05:163
138839953,1cyclictest23481-21cat08:50:153
138839953,1cyclictest21441-21cat08:45:153
138839953,1cyclictest19189-21cat07:20:233
138839953,1cyclictest13195-21hddtemp_smartct08:25:233
138839952,2cyclictest970-21snmpd08:43:293
138839952,2cyclictest970-21snmpd08:43:283
138839952,2cyclictest614-21dbus-daemon08:55:013
138839952,1cyclictest27847-21cut09:00:163
138839950,4cyclictest9497-21cut08:15:223
138829953,1cyclictest970-21snmpd09:05:362
138829953,1cyclictest970-21snmpd08:42:072
138829953,1cyclictest970-21snmpd08:42:072
138829953,1cyclictest970-21snmpd08:27:492
138829953,1cyclictest970-21snmpd08:21:012
138829953,1cyclictest970-21snmpd08:17:102
138829953,1cyclictest970-21snmpd07:53:302
138829953,1cyclictest970-21snmpd07:42:242
138829953,1cyclictest970-21snmpd07:37:032
138829953,1cyclictest970-21snmpd07:15:082
138829953,1cyclictest643-21gdbus08:35:002
138829953,1cyclictest633-21polkitd07:10:002
138829953,1cyclictest598-21avahi-daemon07:20:042
138829953,1cyclictest3107-21cat08:00:152
138829953,1cyclictest23628-21ntp_states07:30:182
138829953,1cyclictest21442-21cat08:45:152
138829953,1cyclictest15233-21hddtemp_smartct08:30:142
138829952,2cyclictest1497-21cut07:55:192
138829950,4cyclictest0-21swapper/208:05:182
138799954,0cyclictest0-21swapper/108:14:251
138799953,1cyclictest970-21snmpd08:52:141
138799953,1cyclictest970-21snmpd08:45:041
138799953,1cyclictest970-21snmpd08:25:221
138799953,1cyclictest970-21snmpd08:16:101
138799953,1cyclictest970-21snmpd07:56:241
138799953,1cyclictest970-21snmpd07:50:391
138799953,1cyclictest970-21snmpd07:37:001
138799953,1cyclictest970-21snmpd07:17:591
138799953,1cyclictest614-21dbus-daemon07:20:001
138799953,1cyclictest3456-21ntpdc08:00:171
138799952,2cyclictest970-21snmpd09:00:381
138799952,2cyclictest970-21snmpd08:40:551
138799952,2cyclictest970-21snmpd08:40:551
138799952,2cyclictest30571-21seq09:06:071
138799950,4cyclictest16266-21sshd08:30:251
138839942,1cyclictest14061-21chrt07:10:103
138839941,2cyclictest970-21snmpd07:25:083
138799942,1cyclictest29353-21cat07:45:151
138799942,1cyclictest11066-21gltestperf08:20:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional