You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-04 - 03:18

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #9, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack9slot0.osadl.org (updated Sun Dec 04, 2022 00:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
529321110,0sleep3421rcuc/322:05:143
57221040,0sleep2331rcuc/200:10:472
188232780,0sleep00-21swapper/022:26:440
3022760,1sleep232720-21sd-pam00:13:152
247642740,0sleep20-21swapper/223:26:182
189142720,0sleep30-21swapper/321:25:223
298342710,0sleep0141rcuc/023:47:200
69182700,1sleep36916-21bash22:20:423
236112700,0sleep21922899cyclictest00:23:022
236112700,0sleep21922899cyclictest00:23:022
175672700,0sleep30-21swapper/323:17:573
77402680,1sleep10-21swapper/121:22:041
7072670,0sleep0703-21sshd00:36:540
285312670,0sleep10-21swapper/122:35:071
299812660,0sleep2331rcuc/221:46:462
267232660,0sleep10-21swapper/122:55:351
176612650,0sleep017658-21systemd-cgroups21:53:210
53532640,1sleep05348-21systemd21:29:200
304512640,0sleep20-21swapper/221:49:182
200112620,0sleep00-21swapper/000:14:540
58382610,0sleep00-21swapper/021:42:230
46372610,0sleep00-21swapper/021:47:200
30242610,0sleep30-21swapper/322:51:083
42372600,0sleep30-21swapper/323:40:063
309822600,0sleep10-21swapper/123:57:391
219702600,0sleep3421rcuc/300:22:543
219702600,0sleep3421rcuc/300:22:543
1890526046,8sleep30-21swapper/319:06:463
179342600,0sleep30-21swapper/323:43:463
46162590,0sleep20-21swapper/223:37:322
38282580,0sleep10-21swapper/122:22:561
48072570,0sleep30-21swapper/322:15:203
316692570,1sleep0101ktimersoftd/023:16:340
41822560,0sleep10-21swapper/100:24:091
41822560,0sleep10-21swapper/100:24:091
177802560,0sleep20-21swapper/222:49:432
146952550,2sleep11922799cyclictest23:15:111
1879225424,9sleep00-21swapper/019:05:220
1881025125,8sleep10-21swapper/119:05:351
153682470,0sleep30-21swapper/300:09:203
1886524127,8sleep20-21swapper/219:06:162
297682300,0sleep10-21swapper/121:46:451
1922999230,21cyclictest808-21dbus-daemon21:37:263
1922999230,10cyclictest16297-21bash23:07:403
1922999230,10cyclictest16158-21sshd21:53:143
287802220,0sleep00-21swapper/021:33:450
1922999222,7cyclictest885-21polkitd23:59:563
1922999220,9cyclictest1771-21consoletype21:08:473
1922999220,8cyclictest30975-21sshd22:02:153
1922999220,8cyclictest2865-21bash21:44:363
1922999220,8cyclictest15332-21sshd22:54:393
1922999220,10cyclictest1-21systemd22:28:193
158342220,0sleep20-21swapper/222:31:352
1922999212,8cyclictest808-21dbus-daemon22:58:023
1922999210,9cyclictest9313-21sshd23:53:153
1922999210,9cyclictest21132-21grepconf.sh21:48:333
1922999210,8cyclictest808-21dbus-daemon23:05:103
1922999210,10cyclictest27311-21id00:12:523
78852200,0sleep20-21swapper/222:07:542
303972200,1sleep030395-21sshd21:08:280
292652200,0sleep1808-21dbus-daemon23:18:551
24172200,0sleep10-21swapper/121:34:181
1922999202,9cyclictest4518-21sshd22:43:363
1922999202,8cyclictest835-21systemd-logind23:12:363
1922999200,9cyclictest9854-21grepconf.sh21:29:413
1922999200,9cyclictest16119-21systemd-cgroups22:08:323
1922999200,8cyclictest808-21dbus-daemon21:37:383
1922999200,8cyclictest4425-21sshd23:27:153
1922999200,8cyclictest30424-21grepconf.sh23:52:293
1922999200,8cyclictest30424-21grepconf.sh23:52:293
1922999200,8cyclictest19564-21sshd00:17:313
1922999200,8cyclictest18271-21grepconf.sh00:30:283
1922999200,8cyclictest1-21systemd23:28:033
1922999200,8cyclictest11800-21systemd21:19:483
1922999200,7cyclictest8388-21grepconf.sh23:32:403
1922999200,7cyclictest0-21swapper/322:23:493
1922999200,7cyclictest0-21swapper/321:13:403
1922999200,7cyclictest0-21swapper/321:13:403
1922999200,10cyclictest20019-21systemd22:34:263
1922899207,3cyclictest35-21ksoftirqd/221:19:002
19228992010,2cyclictest35-21ksoftirqd/223:59:302
19228992010,1cyclictest35-21ksoftirqd/223:45:042
19228992010,1cyclictest35-21ksoftirqd/221:55:242
180032200,2sleep11922799cyclictest21:48:171
119812200,0sleep30-21swapper/300:35:093
1922999190,8cyclictest28785-21bash00:02:433
1922999190,10cyclictest9945-21sshd22:38:503
1922899198,1cyclictest35-21ksoftirqd/200:36:422
1922899197,5cyclictest35-21ksoftirqd/223:01:202
1922899197,3cyclictest35-21ksoftirqd/222:37:492
19228991914,1cyclictest35-21ksoftirqd/223:32:462
19226991916,1cyclictest9-21ksoftirqd/021:47:470
148272190,0sleep2331rcuc/222:00:572
129302190,0sleep00-21swapper/022:41:470
1922899189,1cyclictest35-21ksoftirqd/221:22:592
1922899188,1cyclictest35-21ksoftirqd/223:02:552
1922899188,1cyclictest35-21ksoftirqd/222:53:002
1922899188,1cyclictest35-21ksoftirqd/222:42:592
1922899188,1cyclictest35-21ksoftirqd/222:02:502
1922899188,1cyclictest35-21ksoftirqd/200:17:522
1922899187,1cyclictest35-21ksoftirqd/221:30:192
1922899187,1cyclictest35-21ksoftirqd/221:09:162
1922899186,4cyclictest35-21ksoftirqd/223:13:042
1922899186,3cyclictest35-21ksoftirqd/222:15:362
1922899186,1cyclictest35-21ksoftirqd/223:19:582
1922899186,1cyclictest35-21ksoftirqd/221:38:042
19228991812,1cyclictest35-21ksoftirqd/200:03:032
19226991815,1cyclictest9-21ksoftirqd/022:17:410
151992180,0sleep215200-21systemd-cgroups21:14:552
151992180,0sleep215200-21systemd-cgroups21:14:552
23182170,0sleep00-21swapper/023:52:450
1922899179,1cyclictest35-21ksoftirqd/222:20:552
1922899177,1cyclictest35-21ksoftirqd/222:22:442
1922899176,4cyclictest35-21ksoftirqd/222:34:062
1922899176,3cyclictest35-21ksoftirqd/221:34:202
1922899176,1cyclictest35-21ksoftirqd/200:30:372
1922899175,3cyclictest35-21ksoftirqd/223:47:542
1922899175,3cyclictest35-21ksoftirqd/223:47:542
1922899173,5cyclictest35-21ksoftirqd/223:09:252
19228991710,4cyclictest35-21ksoftirqd/223:32:032
159012170,0sleep00-21swapper/022:54:420
126862170,0sleep10-21swapper/122:15:591
244402160,0sleep10-21swapper/121:13:021
244402160,0sleep10-21swapper/121:13:021
1922899168,3cyclictest35-21ksoftirqd/223:52:452
19227991612,2cyclictest26-21ksoftirqd/122:20:271
19227991612,2cyclictest26-21ksoftirqd/121:58:231
19227991512,1cyclictest13376-21bash23:40:491
19227991511,1cyclictest26-21ksoftirqd/122:49:571
1922799150,2cyclictest18165-21sshd21:53:241
1922799150,1cyclictest0-21swapper/100:28:021
279182140,0sleep00-21swapper/021:21:060
19227991411,1cyclictest0-21swapper/123:10:021
19227991410,1cyclictest0-21swapper/100:14:591
1922799140,12cyclictest17920-21df21:27:491
19226991412,1cyclictest9-21ksoftirqd/022:34:290
1922699140,2cyclictest856-21NetworkManager23:28:040
1922699140,2cyclictest13672-21grepconf.sh00:19:390
1922699140,1cyclictest6357-21systemd-cgroups00:06:050
1922699140,1cyclictest121rcu_sched23:04:580
1922699140,12cyclictest11120-21kworker/0:222:12:560
156202140,1sleep115618-21sshd21:22:401
1922999134,6cyclictest8444-21grep20:47:513
19229991310,2cyclictest0-21swapper/320:16:143
1922999130,7cyclictest16781-21perl20:02:463
1922999130,12cyclictest0-21swapper/319:17:203
1922999130,10cyclictest504-21/usr/sbin/munin19:32:433
1922799130,12cyclictest14138-21sshd22:03:221
19226991311,1cyclictest0-21swapper/023:18:250
19226991310,2cyclictest9-21ksoftirqd/021:12:470
19226991310,2cyclictest9-21ksoftirqd/021:12:470
19226991310,1cyclictest9-21ksoftirqd/022:57:360
19226991310,1cyclictest9-21ksoftirqd/022:30:160
1922699130,1cyclictest1-21systemd23:41:250
1922699130,1cyclictest121rcu_sched00:12:300
1922699130,1cyclictest0-21swapper/022:09:460
1922999120,9cyclictest30649-21switchtime20:27:543
1922999120,9cyclictest13268-21missed_timers20:57:503
1922999120,7cyclictest5152-21tune2fs20:42:453
1922999120,7cyclictest29730-21unixbench_singl19:22:543
1922999120,7cyclictest10920-21/usr/sbin/munin19:52:443
1922999120,6cyclictest26302-21latency19:17:483
1922999120,4cyclictest0-21swapper/320:17:513
1922999120,2cyclictest0-21swapper/319:08:453
1922999120,11cyclictest0-21swapper/320:24:013
19228991210,1cyclictest0-21swapper/220:47:532
1922799129,1cyclictest26-21ksoftirqd/123:46:371
1922799128,1cyclictest26-21ksoftirqd/122:11:511
1922799128,1cyclictest26-21ksoftirqd/121:38:521
1922799127,2cyclictest808-21dbus-daemon23:03:291
1922799121,1cyclictest121rcu_sched23:35:561
19227991210,1cyclictest26-21ksoftirqd/122:31:171
1922799120,1cyclictest8377-21sshd23:50:421
1922799120,1cyclictest8377-21sshd23:50:421
1922799120,1cyclictest0-21swapper/122:38:191
1922799120,1cyclictest0-21swapper/100:07:051
1922699129,1cyclictest9-21ksoftirqd/023:49:320
1922699129,1cyclictest9-21ksoftirqd/023:49:320
1922699125,4cyclictest22406-21sshd23:23:330
19226991210,1cyclictest9-21ksoftirqd/023:34:570
19226991210,1cyclictest9-21ksoftirqd/022:47:300
19226991210,1cyclictest9-21ksoftirqd/021:59:460
19226991210,1cyclictest9-21ksoftirqd/000:28:550
19226991210,1cyclictest9-21ksoftirqd/000:22:510
19226991210,1cyclictest9-21ksoftirqd/000:22:510
1922699120,1cyclictest1528-21nfsd22:47:520
1922699120,1cyclictest121rcu_sched23:09:430
1922999112,5cyclictest674-40kipmi020:52:463
1922999110,7cyclictest8640-21expr19:47:433
1922999110,7cyclictest31664-21atenall_r9power20:32:423
1922999110,7cyclictest31398-21gawk19:27:483
1922999110,7cyclictest2617-21head20:37:463
1922999110,6cyclictest5825-21cut19:42:423
1922999110,6cyclictest3404-21cpuspeed_turbos19:37:443
1922999110,6cyclictest14595-21sed19:57:483
1922899113,7cyclictest0-21swapper/220:12:482
1922899110,0cyclictest0-21swapper/220:23:152
1922799118,1cyclictest26-21ksoftirqd/123:52:541
1922799117,3cyclictest26-21ksoftirqd/122:43:281
1922799111,1cyclictest121rcu_sched23:31:231
1922799111,1cyclictest121rcu_sched21:08:551
19227991110,0cyclictest0-21swapper/123:00:171
1922799110,10cyclictest0-21swapper/121:03:111
1922799110,10cyclictest0-21swapper/121:03:111
1922699119,1cyclictest9-21ksoftirqd/022:06:080
1922699118,1cyclictest9-21ksoftirqd/021:24:170
1922699110,1cyclictest28299-21kworker/0:523:57:400
1922699110,10cyclictest0-21swapper/019:47:490
1922999100,7cyclictest0-21swapper/320:07:483
1922999100,5cyclictest0-21swapper/321:02:443
1922999100,5cyclictest0-21swapper/321:02:443
1922899109,0cyclictest0-21swapper/220:07:532
1922899100,9cyclictest0-21swapper/219:32:352
1922899100,0cyclictest0-21swapper/220:33:572
1922799109,0cyclictest0-21swapper/119:53:221
1922799108,1cyclictest26-21ksoftirqd/100:20:391
1922799108,1cyclictest0-21swapper/100:32:311
1922799102,5cyclictest18992-21sshd23:23:151
1922699104,1cyclictest0-21swapper/019:27:300
192289998,0cyclictest0-21swapper/219:09:142
192289993,3cyclictest28213-21kworker/2:119:18:222
192289992,4cyclictest35-21ksoftirqd/219:59:322
192289992,1cyclictest111rcu_preempt19:42:452
192289990,8cyclictest0-21swapper/220:31:502
192289990,0cyclictest0-21swapper/220:42:172
192279990,8cyclictest0-21swapper/119:34:401
192279990,1cyclictest121rcu_sched00:07:391
192289987,0cyclictest0-21swapper/220:42:312
192289985,3cyclictest0-21swapper/219:32:242
192289984,3cyclictest0-21swapper/219:42:302
192289982,0cyclictest674-40kipmi019:22:472
192289980,7cyclictest0-21swapper/220:06:372
192289980,5cyclictest121rcu_sched20:22:252
192289980,1cyclictest0-21swapper/221:02:522
192289980,1cyclictest0-21swapper/221:02:522
192279987,0cyclictest0-21swapper/120:37:241
192279987,0cyclictest0-21swapper/120:01:021
192279987,0cyclictest0-21swapper/119:38:301
192279987,0cyclictest0-21swapper/119:31:041
192279982,2cyclictest0-21swapper/120:27:481
192279980,0cyclictest0-21swapper/120:26:561
192279980,0cyclictest0-21swapper/120:16:291
192269987,0cyclictest0-21swapper/021:00:390
192269987,0cyclictest0-21swapper/019:44:410
192269986,1cyclictest28785-21ls20:27:310
192269980,7cyclictest0-21swapper/020:35:120
192269980,7cyclictest0-21swapper/020:09:250
192289975,1cyclictest22042-21swap19:12:312
192289972,0cyclictest674-40kipmi019:47:472
192289970,1cyclictest510-21jbd2/dm-1-820:57:312
192289970,1cyclictest0-21swapper/219:52:422
192289970,0cyclictest0-21swapper/220:52:492
192279976,0cyclictest0-21swapper/119:16:531
192279970,1cyclictest7969-21ipmi_fans20:47:471
192279970,1cyclictest25003-21missed_timers20:17:511
192279970,1cyclictest21103-21sed20:12:311
192279970,1cyclictest19285-21sed19:07:421
192279970,1cyclictest14080-21users20:57:561
192279970,1cyclictest10583-21chrt19:51:171
192279970,1cyclictest10416-21hddtemp_smartct20:52:451
192279970,1cyclictest0-21swapper/119:46:491
192269975,1cyclictest4145-21dump-pmu-power20:42:310
192269975,1cyclictest12351-21/usr/sbin/munin19:52:510
192269970,1cyclictest25667-21df_inode19:17:430
192269970,1cyclictest21704-21df_inode20:12:440
192269970,1cyclictest20675-21ntp_states19:07:510
192269970,1cyclictest17707-21smart_sda20:02:540
192269970,1cyclictest1528-21nfsd19:32:570
192269970,1cyclictest11148-21sensors20:52:520
192269970,1cyclictest0-21swapper/020:47:470
192269970,1cyclictest0-21swapper/019:37:540
192269970,1cyclictest0-21swapper/019:15:230
192269970,0cyclictest0-21swapper/021:05:390
192269970,0cyclictest0-21swapper/021:05:390
192279965,0cyclictest1528-21nfsd19:22:571
192279964,1cyclictest31419-21kworker/1:020:42:351
192279962,2cyclictest0-21swapper/119:17:471
192279960,0cyclictest0-21swapper/120:37:431
192279960,0cyclictest0-21swapper/120:02:541
192269964,1cyclictest4375-21/usr/sbin/munin20:42:470
192269964,1cyclictest23394-21kworker/0:220:29:230
192269962,4cyclictest0-21swapper/019:27:480
192269960,5cyclictest0-21swapper/020:17:320
192269960,5cyclictest0-21swapper/019:57:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional