You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 09:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Thu Nov 20, 2025 00:46:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
48506021480,3sleep40-21swapper/419:05:314
4837682124105,17sleep00-21swapper/019:05:200
4847512121116,3sleep20-21swapper/219:05:302
485723999730,35cyclictest0-21swapper/622:58:136
5613802920,1sleep2561353-21ssh21:25:162
485677999124,37cyclictest0-21swapper/019:18:130
485685998916,41cyclictest0-21swapper/100:18:131
485685998816,41cyclictest0-21swapper/119:43:131
485677998616,38cyclictest0-21swapper/023:53:130
485677998514,39cyclictest0-21swapper/020:53:120
48546328543,13sleep30-21swapper/319:09:333
7608882840,0sleep70-21swapper/700:04:287
48538828344,33sleep10-21swapper/119:08:261
485723998216,36cyclictest0-21swapper/600:08:136
485723998215,37cyclictest0-21swapper/619:28:136
48446928161,18sleep50-21swapper/519:05:255
485723997914,35cyclictest0-21swapper/620:03:136
485685997915,36cyclictest0-21swapper/120:38:131
5820762780,2sleep335-21ksoftirqd/321:40:233
485723997513,30cyclictest0-21swapper/623:08:126
5840212720,0sleep70-21swapper/721:43:077
48525727051,13sleep70-21swapper/719:06:317
5153052680,0sleep40-21swapper/420:25:184
48537526842,13sleep60-21swapper/619:08:156
485702996355,8cyclictest0-21swapper/321:03:133
485702996221,37cyclictest0-21swapper/321:23:133
485702996221,37cyclictest0-21swapper/321:23:133
485702996115,35cyclictest0-21swapper/321:38:133
48573099460,13cyclictest0-21swapper/723:43:137
485730994416,28cyclictest0-21swapper/721:58:137
485730994416,28cyclictest0-21swapper/700:28:127
485730994415,29cyclictest0-21swapper/722:43:137
485730994415,29cyclictest0-21swapper/722:43:137
485730994124,17cyclictest0-21swapper/720:18:137
485730994114,27cyclictest0-21swapper/722:23:137
485730993916,23cyclictest0-21swapper/722:13:137
485730993916,22cyclictest0-21swapper/723:33:137
485730993910,28cyclictest541224-21diskmemload00:38:137
485694993511,24cyclictest0-21swapper/220:33:592
485723993410,1cyclictest0-21swapper/600:27:596
485694993410,24cyclictest0-21swapper/221:13:592
485694993410,24cyclictest0-21swapper/220:05:592
485677993410,24cyclictest0-21swapper/019:47:580
48569499339,24cyclictest0-21swapper/221:55:592
48569499328,24cyclictest0-21swapper/222:14:582
48568599328,24cyclictest0-21swapper/122:59:591
48567799328,24cyclictest0-21swapper/020:27:590
216999320,14rtkit-daemon0-21swapper/621:18:136
485730993115,15cyclictest0-21swapper/723:58:127
485694993113,3cyclictest0-21swapper/220:58:132
48567799317,24cyclictest0-21swapper/019:31:590
485730993014,15cyclictest0-21swapper/722:53:137
485723993014,15cyclictest0-21swapper/600:33:136
485702993014,15cyclictest0-21swapper/320:13:133
485694993010,19cyclictest0-21swapper/221:48:132
48567799307,0cyclictest0-21swapper/020:35:590
485723992913,15cyclictest0-21swapper/623:28:136
485694992913,15cyclictest0-21swapper/222:33:132
48567799295,24cyclictest0-21swapper/020:32:590
485723992812,15cyclictest0-21swapper/620:33:136
485716992828,0cyclictest0-21swapper/522:07:255
48569499284,24cyclictest0-21swapper/223:56:592
48569499284,24cyclictest0-21swapper/221:51:592
48569499284,24cyclictest0-21swapper/200:11:592
485694992812,15cyclictest0-21swapper/219:38:132
7258042270,0sleep30-21swapper/323:35:173
485723992711,15cyclictest0-21swapper/621:53:136
485723992711,15cyclictest0-21swapper/619:13:136
48568599279,17cyclictest0-21swapper/100:03:131
485677992711,15cyclictest0-21swapper/000:23:130
48573099269,16cyclictest0-21swapper/723:23:137
485702992626,0cyclictest0-21swapper/300:38:273
48569499262,24cyclictest0-21swapper/223:00:592
48569499262,24cyclictest0-21swapper/219:21:592
485694992610,15cyclictest0-21swapper/223:18:132
48572399251,24cyclictest0-21swapper/619:42:596
48569499251,24cyclictest0-21swapper/200:39:582
5669372240,1sleep763-21ksoftirqd/721:30:097
5256582240,0sleep7525655-21latency_hist20:45:007
48571099241,0cyclictest0-21swapper/423:51:594
485694992423,1cyclictest2107-21gnome-shell19:46:592
48567799248,15cyclictest0-21swapper/019:58:130
216999240,0rtkit-daemon0-21swapper/623:24:062
7544512230,1sleep50-21swapper/523:59:155
485716992322,1cyclictest2107-21gnome-shell21:33:595
48571099237,15cyclictest0-21swapper/423:38:134
485694992321,1cyclictest2107-21gnome-shell20:01:592
48567799237,15cyclictest0-21swapper/020:08:130
6863622220,1sleep0686355-21aten2.4-expect23:05:110
48569499222,13cyclictest0-21swapper/222:18:132
48573099215,15cyclictest0-21swapper/723:13:137
48571699218,13cyclictest0-21swapper/520:23:135
485716992111,10cyclictest0-21swapper/523:48:135
485716992110,10cyclictest0-21swapper/522:38:135
48570299216,14cyclictest0-21swapper/320:43:133
216999210,1rtkit-daemon2168-21rtkit-daemon22:25:196
7855332200,0sleep20-21swapper/200:23:552
7555732200,0sleep60-21swapper/600:00:126
48573099203,16cyclictest0-21swapper/720:48:137
485716992013,7cyclictest0-21swapper/523:03:135
485716992012,8cyclictest0-21swapper/522:48:135
485716992010,10cyclictest0-21swapper/522:28:135
485710992019,1cyclictest2107-21gnome-shell00:07:594
485710992019,1cyclictest0-21swapper/422:11:594
485677992018,2cyclictest2107-21gnome-shell00:25:590
7025482190,0sleep60-21swapper/623:17:026
6660222190,1sleep121-21ksoftirqd/122:48:371
6423672190,0sleep40-21swapper/422:30:064
485723991918,1cyclictest56-21ksoftirqd/623:36:486
485723991918,1cyclictest0-21swapper/622:39:546
48571699194,15cyclictest0-21swapper/521:28:135
485716991913,6cyclictest0-21swapper/522:03:135
48571699191,1cyclictest0-21swapper/523:38:195
48571699190,1cyclictest0-21swapper/523:08:245
48571099192,9cyclictest0-21swapper/400:12:174
485710991918,1cyclictest2107-21gnome-shell23:28:594
485710991918,1cyclictest2107-21gnome-shell21:27:594
485702991918,1cyclictest696952-21ssh23:12:593
48568599193,15cyclictest0-21swapper/119:33:131
485677991917,1cyclictest0-21swapper/022:15:120
48571099180,18cyclictest729022-21kworker/4:223:55:024
48569499182,15cyclictest0-21swapper/221:33:132
48567799180,18cyclictest0-21swapper/021:55:150
7779782170,0sleep20-21swapper/200:17:062
485710991717,0cyclictest0-21swapper/423:20:594
485710991717,0cyclictest0-21swapper/423:07:594
485702991717,0cyclictest0-21swapper/323:15:413
485694991716,1cyclictest0-21swapper/220:28:132
48569499170,6cyclictest0-21swapper/219:53:132
48569499170,6cyclictest0-21swapper/219:53:132
48569499170,13cyclictest0-21swapper/222:03:412
216999170,2rtkit-daemon2122-21JS17:37:036
7134742160,0sleep228-21ksoftirqd/223:25:222
48572399161,14cyclictest0-21swapper/622:08:136
48571699169,7cyclictest855-21in:imjournal23:25:475
485716991615,1cyclictest49-21ksoftirqd/500:23:315
485716991615,1cyclictest0-21swapper/521:13:135
485716991611,4cyclictest986-21runrttasks23:16:045
485710991615,1cyclictest2107-21gnome-shell00:33:594
485694991612,4cyclictest0-21swapper/221:08:132
485685991616,0cyclictest0-21swapper/122:22:451
485677991616,0cyclictest0-21swapper/020:42:460
485677991616,0cyclictest0-21swapper/000:18:130
485716991514,1cyclictest0-21swapper/523:54:155
48571099151,14cyclictest527986-21kworker/4:221:46:034
485702991515,0cyclictest0-21swapper/321:45:463
485694991515,0cyclictest0-21swapper/220:12:592
485694991514,1cyclictest2107-21gnome-shell19:44:592
485694991512,3cyclictest0-21swapper/221:15:432
485694991512,3cyclictest0-21swapper/200:27:262
485677991513,1cyclictest2247-21gsd-power00:04:150
216999150,1rtkit-daemon823-21earlyoom23:54:372
7210742140,1sleep30-21swapper/323:31:343
5640202140,0sleep10-21swapper/121:26:351
485730991413,1cyclictest0-21swapper/722:07:497
48571699140,1cyclictest0-21swapper/522:57:585
485710991414,0cyclictest0-21swapper/421:21:594
485710991414,0cyclictest0-21swapper/421:21:594
485710991413,1cyclictest0-21swapper/422:52:594
48570299140,14cyclictest0-21swapper/321:58:553
48569499140,14cyclictest0-21swapper/222:21:442
485685991413,1cyclictest15350irq/135-ahci[0021:35:141
485677991414,0cyclictest0-21swapper/022:45:230
485677991414,0cyclictest0-21swapper/021:44:240
48567799141,13cyclictest0-21swapper/021:20:100
48567799141,13cyclictest0-21swapper/021:20:100
48567799140,1cyclictest541224-21diskmemload22:53:200
48567799140,14cyclictest0-21swapper/021:00:200
216999140,1rtkit-daemon823-21earlyoom21:00:026
216999140,0rtkit-daemon0-21swapper/600:31:532
216999140,0rtkit-daemon0-21swapper/220:35:546
48573099139,3cyclictest829-21irqbalance21:01:567
48573099131,3cyclictest121rcu_preempt21:48:007
485730991312,1cyclictest0-21swapper/721:15:477
48573099130,13cyclictest0-21swapper/723:01:107
48573099130,13cyclictest0-21swapper/722:37:457
48573099130,13cyclictest0-21swapper/722:30:067
48573099130,13cyclictest0-21swapper/721:27:017
48573099130,13cyclictest0-21swapper/721:22:087
48573099130,13cyclictest0-21swapper/721:22:087
48573099130,13cyclictest0-21swapper/700:31:347
48573099130,13cyclictest0-21swapper/700:14:307
48573099130,0cyclictest0-21swapper/721:10:167
48573099130,0cyclictest0-21swapper/700:18:347
485723991312,1cyclictest0-21swapper/623:04:186
48571699133,7cyclictest937-21lldpd21:38:085
48571699132,10cyclictest0-21swapper/522:12:165
485716991313,0cyclictest0-21swapper/523:33:155
485716991313,0cyclictest0-21swapper/500:30:315
48571699130,1cyclictest0-21swapper/500:35:415
48571699130,13cyclictest0-21swapper/523:13:555
48571699130,13cyclictest0-21swapper/522:40:455
48571699130,13cyclictest0-21swapper/522:40:445
48571699130,13cyclictest0-21swapper/521:50:505
48571699130,13cyclictest0-21swapper/500:17:305
485710991313,0cyclictest0-21swapper/421:32:154
485710991313,0cyclictest0-21swapper/421:12:044
485710991312,1cyclictest2107-21gnome-shell22:07:584
485710991312,1cyclictest0-21swapper/423:10:284
485710991312,1cyclictest0-21swapper/421:57:564
485710991312,1cyclictest0-21swapper/421:52:254
485710991312,1cyclictest0-21swapper/400:22:104
48571099130,13cyclictest0-21swapper/423:40:524
48571099130,13cyclictest0-21swapper/400:18:454
48571099130,0cyclictest0-21swapper/422:38:454
48571099130,0cyclictest0-21swapper/422:20:024
485702991312,1cyclictest2107-21gnome-shell22:23:593
48570299130,13cyclictest0-21swapper/300:13:053
48570299130,13cyclictest0-21swapper/300:06:153
48570299130,0cyclictest0-21swapper/321:10:193
48570299130,0cyclictest0-21swapper/300:29:303
485694991312,1cyclictest2107-21gnome-shell19:25:592
48569499130,13cyclictest0-21swapper/222:40:262
48569499130,13cyclictest0-21swapper/222:40:252
48569499130,13cyclictest0-21swapper/220:35:142
485685991313,0cyclictest0-21swapper/123:57:431
485685991313,0cyclictest0-21swapper/123:25:411
485685991313,0cyclictest0-21swapper/122:35:561
485685991313,0cyclictest0-21swapper/122:33:101
485685991312,1cyclictest0-21swapper/122:05:221
48568599130,13cyclictest0-21swapper/123:03:341
48568599130,13cyclictest0-21swapper/122:17:531
48568599130,13cyclictest0-21swapper/121:46:001
48568599130,13cyclictest0-21swapper/100:24:221
48568599130,0cyclictest0-21swapper/123:47:581
48568599130,0cyclictest0-21swapper/121:23:051
48568599130,0cyclictest0-21swapper/121:23:051
48568599130,0cyclictest0-21swapper/100:36:061
485677991313,0cyclictest0-21swapper/023:15:270
485677991313,0cyclictest0-21swapper/023:00:580
485677991313,0cyclictest0-21swapper/022:56:060
485677991312,1cyclictest97850irq/166-enp0s3121:46:520
48567799130,13cyclictest97850irq/166-enp0s3122:36:550
48567799130,13cyclictest0-21swapper/023:12:410
48567799130,13cyclictest0-21swapper/000:32:320
48567799130,0cyclictest0-21swapper/000:07:590
216999130,1rtkit-daemon855-21in:imjournal22:51:552
216999130,1rtkit-daemon2110-21gmain22:45:032
216999130,1rtkit-daemon1107-21sendmail20:52:002
216999130,0rtkit-daemon0-21swapper/622:58:422
216999130,0rtkit-daemon0-21swapper/622:07:102
216999130,0rtkit-daemon0-21swapper/221:21:252
216999130,0rtkit-daemon0-21swapper/221:21:242
7722382120,0sleep10-21swapper/100:12:491
7031472120,1sleep10-21swapper/123:17:541
5167052120,0sleep50-21swapper/520:30:095
485730991212,0cyclictest0-21swapper/722:58:247
485730991212,0cyclictest0-21swapper/721:50:367
485730991212,0cyclictest0-21swapper/720:11:597
485730991211,0cyclictest0-21swapper/720:09:277
48572399124,6cyclictest829-21irqbalance21:45:566
485723991211,1cyclictest541224-21diskmemload00:37:066
485723991211,1cyclictest2107-21gnome-shell23:44:596
485723991211,1cyclictest2107-21gnome-shell22:10:586
48572399120,1cyclictest603143-21ssh21:58:266
48572399120,1cyclictest0-21swapper/623:12:266
485716991212,0cyclictest0-21swapper/522:31:485
485716991211,1cyclictest0-21swapper/519:23:135
48571699120,0cyclictest0-21swapper/523:21:525
48571099122,4cyclictest823-21earlyoom22:40:014
48571099122,4cyclictest823-21earlyoom22:40:014
485710991212,0cyclictest0-21swapper/423:02:104
485710991212,0cyclictest0-21swapper/422:17:174
485710991211,1cyclictest2107-21gnome-shell21:41:584
48571099120,12cyclictest0-21swapper/420:44:564
485702991212,0cyclictest0-21swapper/323:53:543
485702991212,0cyclictest0-21swapper/323:41:223
485702991212,0cyclictest0-21swapper/322:42:303
485702991212,0cyclictest0-21swapper/322:42:293
485702991212,0cyclictest0-21swapper/322:25:543
485702991212,0cyclictest0-21swapper/322:08:313
485702991210,2cyclictest479175-21kworker/3:019:36:393
48570299120,0cyclictest0-21swapper/323:27:233
48569499122,8cyclictest845-21rngd22:26:552
485694991212,0cyclictest0-21swapper/200:04:112
485694991211,1cyclictest0-21swapper/223:30:502
48569499120,12cyclictest0-21swapper/220:20:062
485685991212,0cyclictest0-21swapper/123:50:041
485685991212,0cyclictest0-21swapper/123:22:551
485685991212,0cyclictest0-21swapper/121:40:281
485685991212,0cyclictest0-21swapper/121:30:041
485685991211,1cyclictest0-21swapper/119:58:511
485685991210,1cyclictest541224-21diskmemload22:26:351
48567799124,6cyclictest2297-21pool-gsd-smartc22:06:280
485677991212,0cyclictest0-21swapper/022:10:340
485677991212,0cyclictest0-21swapper/021:30:330
48567799120,1cyclictest0-21swapper/021:35:200
48567799120,0cyclictest0-21swapper/023:20:590
48567799120,0cyclictest0-21swapper/019:14:380
216999120,2rtkit-daemon486427-21munin-node22:37:412
216999120,1rtkit-daemon2168-21rtkit-daemon00:15:136
216999120,1rtkit-daemon1134-21snmpd19:51:426
216999120,1rtkit-daemon1134-21snmpd19:51:416
216999120,0rtkit-daemon2168-21rtkit-daemon00:22:056
216999120,0rtkit-daemon0-21swapper/623:40:302
216999120,0rtkit-daemon0-21swapper/621:36:102
216999120,0rtkit-daemon0-21swapper/619:18:042
216999120,0rtkit-daemon0-21swapper/223:14:472
216999120,0rtkit-daemon0-21swapper/220:50:166
5529372110,0sleep40-21swapper/421:18:464
5446402110,1sleep00-21swapper/021:10:570
485730991111,0cyclictest0-21swapper/723:45:337
485730991111,0cyclictest0-21swapper/722:46:427
48572399111,9cyclictest739877-21taskset23:46:256
48572399111,5cyclictest587-21systemd-journal22:47:376
485723991110,1cyclictest0-21swapper/619:20:336
48572399110,0cyclictest0-21swapper/622:24:576
485716991111,0cyclictest0-21swapper/521:48:045
485716991111,0cyclictest0-21swapper/500:10:015
48571699110,1cyclictest0-21swapper/521:01:435
48571699110,1cyclictest0-21swapper/519:42:305
48571699110,11cyclictest0-21swapper/520:54:545
48571699110,11cyclictest0-21swapper/520:46:465
48571699110,11cyclictest0-21swapper/520:03:405
48571699110,11cyclictest0-21swapper/519:56:215
485710991111,0cyclictest0-21swapper/422:47:414
485710991110,1cyclictest0-21swapper/421:39:594
485710991110,1cyclictest0-21swapper/420:04:364
485710991110,1cyclictest0-21swapper/419:33:224
48571099110,11cyclictest0-21swapper/419:27:224
48571099110,11cyclictest0-21swapper/419:15:494
485702991111,0cyclictest0-21swapper/323:07:233
485702991111,0cyclictest0-21swapper/323:04:363
485702991111,0cyclictest0-21swapper/321:32:353
485702991111,0cyclictest0-21swapper/320:18:553
485702991110,1cyclictest645374-21kworker/3:122:35:193
485702991110,1cyclictest2107-21gnome-shell22:48:593
48570299110,11cyclictest0-21swapper/319:58:263
48570299110,11cyclictest0-21swapper/319:26:343
48570299110,0cyclictest0-21swapper/320:48:413
48569499110,0cyclictest0-21swapper/220:45:092
48568599112,8cyclictest1134-21snmpd23:10:501
485685991111,0cyclictest0-21swapper/122:01:571
485685991111,0cyclictest0-21swapper/121:11:521
485685991111,0cyclictest0-21swapper/120:46:001
485685991110,1cyclictest21-21ksoftirqd/122:41:021
485685991110,1cyclictest21-21ksoftirqd/122:41:021
485685991110,1cyclictest0-21swapper/121:50:531
48567799119,1cyclictest800860-21awk00:35:180
485677991111,0cyclictest0-21swapper/023:47:190
485677991111,0cyclictest0-21swapper/023:37:340
485677991111,0cyclictest0-21swapper/021:27:470
485677991111,0cyclictest0-21swapper/000:11:230
48567799110,11cyclictest0-21swapper/023:42:260
48567799110,11cyclictest0-21swapper/019:28:080
216999110,1rtkit-daemon2168-21rtkit-daemon00:09:122
216999110,0rtkit-daemon0-21swapper/623:46:212
216999110,0rtkit-daemon0-21swapper/619:57:292
216999110,0rtkit-daemon0-21swapper/222:50:186
216999110,0rtkit-daemon0-21swapper/222:40:366
216999110,0rtkit-daemon0-21swapper/222:40:366
216999110,0rtkit-daemon0-21swapper/221:34:556
216999110,0rtkit-daemon0-21swapper/220:13:126
485730991010,0cyclictest0-21swapper/723:36:277
485730991010,0cyclictest0-21swapper/722:27:217
485730991010,0cyclictest0-21swapper/721:05:337
485730991010,0cyclictest0-21swapper/720:01:297
48572399109,1cyclictest2107-21gnome-shell21:37:596
48572399105,3cyclictest512435-21/usr/sbin/munin20:20:236
485723991010,0cyclictest0-21swapper/621:43:296
485723991010,0cyclictest0-21swapper/620:41:516
485723991010,0cyclictest0-21swapper/619:32:356
48572399100,6cyclictest746052-21systemd-userwor23:54:346
48571699109,1cyclictest0-21swapper/521:55:035
48571699109,1cyclictest0-21swapper/521:17:305
48571699105,4cyclictest901-21NetworkManager21:40:575
48571699104,4cyclictest844-21nscd23:44:185
485716991010,0cyclictest0-21swapper/522:21:245
485716991010,0cyclictest0-21swapper/521:09:515
485716991010,0cyclictest0-21swapper/520:42:035
485716991010,0cyclictest0-21swapper/520:29:325
485716991010,0cyclictest0-21swapper/520:18:185
485716991010,0cyclictest0-21swapper/519:35:425
485716991010,0cyclictest0-21swapper/519:12:075
485716991010,0cyclictest0-21swapper/500:06:355
485716991010,0cyclictest0-21swapper/500:00:265
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional