You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 12:49

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #9, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack9slot0.osadl.org (updated Mon Jun 27, 2022 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2562721270,1sleep09-21ksoftirqd/000:30:170
2194821270,1sleep021944-21kworker/u8:422:15:260
2670621160,0sleep0141rcuc/023:38:580
64792730,0sleep26475-21fschecks_count23:12:512
327002680,0sleep30-21swapper/323:43:463
242012680,1sleep124200-21sshd23:07:251
149432680,1sleep215-21kswork23:40:292
315932670,3sleep235699cyclictest23:54:442
256542670,0sleep20-21swapper/222:54:002
142962650,1sleep235699cyclictest21:30:272
80842640,1sleep1241rcuc/123:53:021
299802640,1sleep229967-21bash22:18:092
170772640,0sleep30-21swapper/321:39:223
126092640,1sleep20-21swapper/221:34:402
126092640,1sleep20-21swapper/221:34:402
75522630,2sleep235699cyclictest22:07:552
242282630,0sleep10-21swapper/122:42:441
211742630,1sleep321170-21systemd-cgroups23:04:593
201472630,0sleep10-21swapper/121:04:051
160172610,0sleep00-21swapper/021:50:330
160172610,0sleep00-21swapper/021:50:330
269572600,0sleep30-21swapper/321:13:293
3248625931,8sleep20-21swapper/219:01:132
76142580,0sleep20-21swapper/221:56:372
159272580,2sleep034599cyclictest23:58:060
9402560,0sleep30-21swapper/321:58:183
9402560,0sleep30-21swapper/321:58:183
108192560,0sleep00-21swapper/021:30:130
28772530,0sleep00-21swapper/021:05:080
3237325238,8sleep10-21swapper/118:59:471
194962480,0sleep00-21swapper/022:58:020
11452450,0sleep10-21swapper/122:20:441
3231024429,9sleep30-21swapper/318:59:053
3229524329,8sleep00-21swapper/018:58:540
199992300,1sleep219995-21unixbench-2d22:33:042
137122280,1sleep30-21swapper/322:59:583
350992615,3cyclictest26-21ksoftirqd/122:13:021
208072230,0sleep20-21swapper/221:24:062
50692220,0sleep00-21swapper/021:16:270
35099229,2cyclictest26-21ksoftirqd/121:39:341
123652220,3sleep235699cyclictest22:28:072
100202220,0sleep110021-21systemd-cgroups22:12:271
63772210,0sleep0141rcuc/023:17:220
35099219,2cyclictest26-21ksoftirqd/123:10:551
35099217,1cyclictest26-21ksoftirqd/121:21:401
35099211,3cyclictest29784-21sshd21:13:411
350992110,1cyclictest26-21ksoftirqd/122:47:571
231322210,0sleep30-21swapper/321:33:093
231322210,0sleep30-21swapper/321:33:093
188052210,0sleep10-21swapper/121:59:361
188052210,0sleep10-21swapper/121:59:361
11152210,1sleep20-21swapper/221:18:172
35099209,3cyclictest26-21ksoftirqd/121:24:211
35099209,1cyclictest26-21ksoftirqd/123:28:091
35099208,2cyclictest26-21ksoftirqd/122:29:021
35099207,3cyclictest26-21ksoftirqd/123:48:401
35099207,3cyclictest26-21ksoftirqd/100:27:101
350992010,1cyclictest26-21ksoftirqd/121:08:321
350992010,1cyclictest26-21ksoftirqd/121:08:321
350992010,1cyclictest26-21ksoftirqd/100:28:491
115102200,1sleep11718-21nfsd00:20:241
97072190,0sleep20-21swapper/222:05:462
63402190,2sleep135099cyclictest21:32:071
45722190,1sleep2331rcuc/221:12:042
45722190,1sleep2331rcuc/221:12:042
362991913,1cyclictest44-21ksoftirqd/321:07:513
362991913,1cyclictest44-21ksoftirqd/321:07:513
35099199,1cyclictest26-21ksoftirqd/100:04:581
35099198,4cyclictest26-21ksoftirqd/100:10:281
35099198,3cyclictest26-21ksoftirqd/122:25:261
35099197,3cyclictest26-21ksoftirqd/123:33:021
35099197,3cyclictest26-21ksoftirqd/123:24:431
35099197,3cyclictest26-21ksoftirqd/123:14:591
35099196,3cyclictest26-21ksoftirqd/123:42:591
350991913,3cyclictest26-21ksoftirqd/122:38:501
350991911,1cyclictest26-21ksoftirqd/121:35:591
350991911,1cyclictest26-21ksoftirqd/121:35:591
350991910,1cyclictest26-21ksoftirqd/100:16:191
34599190,1cyclictest111rcu_preempt21:19:030
311112190,0sleep20-21swapper/221:16:012
282352190,0sleep30-21swapper/322:11:283
146732190,1sleep114674-21systemd-cgroups23:40:281
146282190,0sleep30-21swapper/322:51:043
35099188,1cyclictest26-21ksoftirqd/123:17:591
35099187,3cyclictest26-21ksoftirqd/122:59:401
35099187,1cyclictest26-21ksoftirqd/122:54:311
35099186,3cyclictest26-21ksoftirqd/123:59:061
35099186,3cyclictest26-21ksoftirqd/122:35:561
35099186,1cyclictest26-21ksoftirqd/121:47:071
35099183,4cyclictest5050-21sshd21:54:121
35099182,3cyclictest1-21systemd21:52:261
35099182,3cyclictest1-21systemd21:52:261
34599181,1cyclictest121rcu_sched22:38:070
220112180,0sleep20-21swapper/221:59:492
220112180,0sleep20-21swapper/221:59:492
170742180,0sleep317075-21grepconf.sh00:14:003
161642180,0sleep30-21swapper/300:00:263
356991713,1cyclictest1-21systemd23:46:352
35099177,3cyclictest26-21ksoftirqd/122:02:521
345991713,2cyclictest9-21ksoftirqd/021:23:180
34599170,1cyclictest121rcu_sched22:27:340
34599170,15cyclictest6743-21sshd22:18:500
180382170,1sleep31-21systemd21:23:553
173842170,1sleep01-21systemd22:46:520
356991614,1cyclictest0-21swapper/223:09:152
356991613,2cyclictest6884-21sshd00:28:572
356991613,2cyclictest16202-21sshd22:24:012
356991612,2cyclictest35-21ksoftirqd/223:27:132
345991613,1cyclictest9-21ksoftirqd/021:53:070
34599160,1cyclictest111rcu_preempt23:29:570
34599160,15cyclictest848-21NetworkManager22:06:210
362991513,1cyclictest0-21swapper/300:07:033
36299151,13cyclictest1-21systemd21:51:153
36299151,13cyclictest1-21systemd21:51:153
362991511,2cyclictest44-21ksoftirqd/323:35:163
356991512,2cyclictest1-21systemd21:41:392
356991512,1cyclictest35-21ksoftirqd/222:59:382
356991512,1cyclictest35-21ksoftirqd/221:43:012
356991511,3cyclictest806-21dbus-daemon21:50:552
356991511,3cyclictest806-21dbus-daemon21:50:552
356991511,3cyclictest598-21systemd-journal00:21:552
35699150,13cyclictest0-21swapper/200:04:462
34599152,1cyclictest121rcu_sched00:09:480
345991513,1cyclictest9-21ksoftirqd/023:34:210
345991512,1cyclictest0-21swapper/023:08:190
345991511,2cyclictest25995-21sshd00:14:390
345991511,1cyclictest9-21ksoftirqd/021:46:260
345991511,1cyclictest9-21ksoftirqd/021:35:080
345991511,1cyclictest9-21ksoftirqd/021:35:080
34599150,1cyclictest111rcu_preempt00:20:590
223032150,0sleep3598-21systemd-journal23:16:133
210702150,0sleep00-21swapper/023:22:550
130812150,0sleep20-21swapper/200:09:062
36299149,4cyclictest44-21ksoftirqd/322:55:253
362991412,1cyclictest44-21ksoftirqd/322:42:383
362991412,1cyclictest44-21ksoftirqd/321:17:423
362991412,1cyclictest44-21ksoftirqd/300:18:053
362991411,1cyclictest44-21ksoftirqd/300:29:543
362991410,3cyclictest838-21systemd-logind23:47:413
36299140,13cyclictest0-21swapper/322:13:593
35699144,1cyclictest806-21dbus-daemon22:39:162
356991412,1cyclictest22955-21sshd23:34:092
356991410,3cyclictest806-21dbus-daemon21:04:092
356991410,2cyclictest35-21ksoftirqd/223:17:542
345991413,0cyclictest24138-21cat20:47:540
345991412,1cyclictest9-21ksoftirqd/022:56:250
345991412,1cyclictest9-21ksoftirqd/022:47:510
345991411,2cyclictest9-21ksoftirqd/000:25:070
34599140,2cyclictest2998-21grep00:06:100
34599140,2cyclictest121rcu_sched22:33:040
34599140,1cyclictest121rcu_sched23:21:330
240182140,1sleep324014-21systemd21:53:133
36299139,3cyclictest44-21ksoftirqd/323:55:433
36299138,1cyclictest44-21ksoftirqd/322:30:133
362991311,1cyclictest44-21ksoftirqd/323:24:483
362991311,1cyclictest44-21ksoftirqd/323:20:553
362991311,1cyclictest44-21ksoftirqd/323:07:593
362991311,1cyclictest44-21ksoftirqd/322:05:383
362991311,1cyclictest44-21ksoftirqd/321:42:403
36299130,12cyclictest16180-21kworker/3:200:07:553
36299130,12cyclictest0-21swapper/319:33:003
35699139,3cyclictest32391-21bash23:32:352
356991310,1cyclictest35-21ksoftirqd/223:58:342
356991310,1cyclictest20858-21sshd00:23:112
35699130,1cyclictest35-21ksoftirqd/200:16:192
35699130,1cyclictest0-21swapper/222:13:112
35699130,11cyclictest0-21swapper/222:48:132
34599139,1cyclictest9-21ksoftirqd/021:58:570
34599139,1cyclictest9-21ksoftirqd/021:58:570
34599134,1cyclictest9-21ksoftirqd/023:49:080
345991311,1cyclictest9-21ksoftirqd/023:53:030
345991311,1cyclictest9-21ksoftirqd/023:43:450
345991311,1cyclictest9-21ksoftirqd/023:04:350
345991311,1cyclictest9-21ksoftirqd/022:31:330
345991311,1cyclictest9-21ksoftirqd/022:08:120
345991311,1cyclictest9-21ksoftirqd/021:38:040
345991311,1cyclictest9-21ksoftirqd/021:07:580
345991311,1cyclictest9-21ksoftirqd/021:07:580
184872130,1sleep318486-21sshd23:38:213
36299129,1cyclictest44-21ksoftirqd/322:23:073
36299129,1cyclictest0-21swapper/321:28:263
36299128,2cyclictest15763-21fw_conntrack00:22:533
36299128,1cyclictest6499-21systemd22:34:303
36299128,1cyclictest44-21ksoftirqd/323:27:483
36299128,1cyclictest44-21ksoftirqd/322:43:353
362991210,1cyclictest44-21ksoftirqd/322:17:593
362991210,1cyclictest44-21ksoftirqd/321:03:043
35699120,2cyclictest13706-21sshd22:44:232
612-21110,0sshd0-21swapper/223:48:052
36299110,10cyclictest0-21swapper/320:23:033
36299110,0cyclictest0-21swapper/320:53:083
35699114,0cyclictest0-21swapper/220:33:552
35699110,4cyclictest0-21swapper/220:03:052
35699110,2cyclictest22160-21sshd23:02:522
35699110,10cyclictest0-21swapper/220:51:562
35699110,10cyclictest0-21swapper/220:44:092
35099119,1cyclictest29834-21kworker/1:220:31:411
35099119,1cyclictest29834-21kworker/1:219:25:491
350991110,0cyclictest29834-21kworker/1:219:58:451
35099110,10cyclictest0-21swapper/120:56:471
36299109,0cyclictest0-21swapper/319:55:313
36299109,0cyclictest0-21swapper/319:23:203
36299103,3cyclictest0-21swapper/319:43:073
36299100,9cyclictest0-21swapper/320:02:083
36299100,9cyclictest0-21swapper/319:31:003
36299100,9cyclictest0-21swapper/319:19:303
36299100,9cyclictest0-21swapper/319:14:173
36299100,0cyclictest0-21swapper/320:32:413
36299100,0cyclictest0-21swapper/319:47:513
35699109,0cyclictest0-21swapper/220:19:322
35699109,0cyclictest0-21swapper/219:51:042
35699109,0cyclictest0-21swapper/219:19:222
35699109,0cyclictest0-21swapper/219:13:402
35699109,0cyclictest0-21swapper/219:04:432
35699100,9cyclictest0-21swapper/219:23:392
35699100,0cyclictest0-21swapper/220:56:462
35699100,0cyclictest0-21swapper/220:38:492
35699100,0cyclictest0-21swapper/220:16:542
35699100,0cyclictest0-21swapper/220:09:372
35699100,0cyclictest0-21swapper/219:57:142
35699100,0cyclictest0-21swapper/219:37:272
35699100,0cyclictest0-21swapper/219:27:572
35099109,0cyclictest29834-21kworker/1:220:38:371
35099109,0cyclictest29834-21kworker/1:219:53:331
35099109,0cyclictest29834-21kworker/1:219:39:411
35099109,0cyclictest0-21swapper/120:59:141
35099109,0cyclictest0-21swapper/119:05:241
35099108,1cyclictest29834-21kworker/1:220:05:411
35099100,9cyclictest0-21swapper/119:51:241
35099100,9cyclictest0-21swapper/119:13:251
35099100,0cyclictest0-21swapper/120:17:041
3629998,0cyclictest0-21swapper/320:45:213
3629998,0cyclictest0-21swapper/320:17:493
3629998,0cyclictest0-21swapper/320:12:353
3629998,0cyclictest0-21swapper/319:06:163
3629990,8cyclictest0-21swapper/321:00:553
3569998,0cyclictest0-21swapper/220:24:172
3569995,3cyclictest1718-21nfsd19:38:152
3509998,0cyclictest29834-21kworker/1:220:19:331
3509998,0cyclictest0-21swapper/120:44:081
3509998,0cyclictest0-21swapper/120:11:501
3509998,0cyclictest0-21swapper/119:45:351
3509998,0cyclictest0-21swapper/119:18:381
3509997,1cyclictest29834-21kworker/1:220:50:451
3509997,1cyclictest29834-21kworker/1:219:29:171
3509992,3cyclictest26-21ksoftirqd/120:22:531
3459995,2cyclictest661-40kipmi020:27:550
3629987,0cyclictest0-21swapper/320:47:473
3569987,0cyclictest0-21swapper/219:44:482
3509987,0cyclictest0-21swapper/120:33:541
3509987,0cyclictest0-21swapper/119:33:021
3509981,1cyclictest26-21ksoftirqd/119:07:411
3459980,7cyclictest0-21swapper/019:03:020
30876280,0sleep20-21swapper/219:57:562
3629976,0cyclictest0-21swapper/319:37:443
3629975,1cyclictest88150irq/26-p4p1-rx-20:38:023
3629974,0cyclictest0-21swapper/319:10:073
3629970,4cyclictest0-21swapper/320:15:593
3629970,4cyclictest0-21swapper/320:02:543
3629970,1cyclictest14408-21ps20:27:593
3569973,4cyclictest0-21swapper/219:07:432
3569971,2cyclictest0-21swapper/220:57:562
3569970,1cyclictest0-21swapper/220:27:412
3459975,1cyclictest18989-21taskset19:35:360
3459972,4cyclictest0-21swapper/019:42:550
3459971,1cyclictest837-21rngd20:59:050
3459970,4cyclictest0-21swapper/019:22:560
3459970,2cyclictest0-21swapper/019:52:540
3459970,1cyclictest9689-21chrt20:18:290
3459970,1cyclictest25333-21/usr/sbin/munin19:47:530
3459970,1cyclictest1718-21nfsd20:43:210
3459970,1cyclictest1718-21nfsd20:04:220
3459970,1cyclictest15422-21/usr/sbin/munin20:32:570
3459970,1cyclictest0-21swapper/020:23:010
3459970,1cyclictest0-21swapper/019:37:530
3459970,1cyclictest0-21swapper/019:13:490
3459963,2cyclictest904-21snmpd19:07:410
3459960,5cyclictest0-21swapper/020:12:540
3459960,5cyclictest0-21swapper/019:57:520
3459960,5cyclictest0-21swapper/019:27:400
3459960,5cyclictest0-21swapper/019:17:430
3459960,2cyclictest0-21swapper/020:07:550
3459960,0cyclictest0-21swapper/020:52:470
3459960,0cyclictest0-21swapper/020:37:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional