You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 14:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Wed Nov 19, 2025 00:46:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1399062960,1sleep442-21ksoftirqd/419:15:254
13293429644,13sleep60-21swapper/619:09:196
4663962900,0sleep70-21swapper/700:36:097
133183998917,39cyclictest0-21swapper/222:48:132
133183998817,40cyclictest0-21swapper/221:28:132
133183998816,39cyclictest0-21swapper/220:28:142
133183998816,39cyclictest0-21swapper/220:28:142
133183998716,39cyclictest0-21swapper/200:28:142
13104528767,18sleep00-21swapper/019:05:190
133183998617,38cyclictest0-21swapper/220:18:132
13294128642,13sleep40-21swapper/419:09:264
1548732850,0sleep7621rcuc/719:40:197
133183998416,35cyclictest0-21swapper/223:53:132
133174998415,38cyclictest0-21swapper/121:03:131
133183998315,35cyclictest0-21swapper/219:43:142
133174998316,37cyclictest0-21swapper/120:53:141
13278128343,34sleep30-21swapper/319:07:073
13294427943,30sleep70-21swapper/719:09:297
13317499750,39cyclictest0-21swapper/119:33:141
4358162720,0sleep20-21swapper/200:11:362
13279927245,14sleep20-21swapper/219:07:232
3184562710,0sleep010-21ksoftirqd/022:37:070
13285926944,12sleep50-21swapper/519:08:155
2934692680,0sleep60-21swapper/622:16:556
1988022680,0sleep442-21ksoftirqd/420:50:264
1796922680,0sleep20-21swapper/220:20:202
13268226648,12sleep10-21swapper/119:05:451
1344062650,0sleep50-21swapper/519:10:155
1564812340,0sleep6551rcuc/619:45:156
133183993411,0cyclictest0-21swapper/219:53:592
133183993014,15cyclictest0-21swapper/222:08:132
133174993014,15cyclictest0-21swapper/120:43:141
13319899290,28cyclictest401028-21awk23:45:004
13318399285,0cyclictest0-21swapper/220:38:582
133212992711,15cyclictest0-21swapper/623:38:146
133174992727,0cyclictest0-21swapper/100:22:421
2266012260,0sleep00-21swapper/021:23:540
133212992610,15cyclictest0-21swapper/622:28:136
216999250,0rtkit-daemon0-21swapper/623:34:142
13321299259,15cyclictest0-21swapper/622:58:136
13318399259,15cyclictest0-21swapper/223:03:142
13318399258,16cyclictest0-21swapper/219:58:132
13318399250,25cyclictest0-21swapper/223:13:112
4502452240,1sleep442-21ksoftirqd/400:24:374
13321299248,15cyclictest0-21swapper/621:38:146
13321999230,22cyclictest0-21swapper/721:59:027
13321999230,22cyclictest0-21swapper/721:59:027
13321299237,15cyclictest0-21swapper/621:48:136
133206992323,0cyclictest0-21swapper/522:39:225
4468192220,0sleep60-21swapper/600:20:216
133190992221,1cyclictest2107-21gnome-shell22:28:583
13318399221,20cyclictest0-21swapper/220:05:152
133174992221,1cyclictest0-21swapper/120:05:081
133166992221,1cyclictest2107-21gnome-shell20:35:590
3042762210,0sleep00-21swapper/022:25:210
133219992120,1cyclictest0-21swapper/722:28:587
13321299214,16cyclictest0-21swapper/620:38:146
133206992120,1cyclictest2107-21gnome-shell20:09:585
3146662200,0sleep60-21swapper/622:35:056
1783172200,0sleep40-21swapper/420:20:144
13318399200,19cyclictest0-21swapper/200:07:292
133212991919,0cyclictest0-21swapper/623:19:476
133212991918,1cyclictest2107-21gnome-shell19:59:596
13317499193,15cyclictest0-21swapper/100:33:131
133174991918,1cyclictest21-21ksoftirqd/123:12:331
13317499190,19cyclictest0-21swapper/123:36:581
13317499190,19cyclictest0-21swapper/123:19:591
13317499190,0cyclictest0-21swapper/119:46:581
3562472180,0sleep60-21swapper/623:07:566
3072472180,0sleep10-21swapper/122:28:511
2426402180,0sleep10-21swapper/121:35:241
133219991818,0cyclictest0-21swapper/719:49:557
133206991816,1cyclictest2107-21gnome-shell19:49:595
133198991817,1cyclictest0-21swapper/419:43:314
133190991817,1cyclictest35-21ksoftirqd/322:59:373
133190991817,1cyclictest0-21swapper/322:32:583
133183991817,0cyclictest0-21swapper/221:00:162
133174991817,1cyclictest2107-21gnome-shell21:34:591
133174991816,1cyclictest2107-21gnome-shell22:39:581
216999170,1rtkit-daemon2168-21rtkit-daemon20:34:362
133219991716,1cyclictest2107-21gnome-shell22:32:597
133219991716,1cyclictest0-21swapper/720:21:587
13319899172,3cyclictest121rcu_preempt22:27:394
133190991716,1cyclictest331069-21kworker/3:123:01:003
133190991711,5cyclictest1134-21snmpd23:15:153
133174991715,1cyclictest2107-21gnome-shell22:07:581
133166991717,0cyclictest0-21swapper/021:45:150
216999160,1rtkit-daemon2168-21rtkit-daemon21:11:482
216999160,1rtkit-daemon2168-21rtkit-daemon00:33:186
133219991615,1cyclictest0-21swapper/723:22:587
13321299160,1cyclictest0-21swapper/620:03:146
133206991616,0cyclictest0-21swapper/520:37:255
13320699161,1cyclictest121rcu_preempt00:30:145
133198991612,2cyclictest823-21earlyoom23:56:284
133190991615,1cyclictest2107-21gnome-shell23:22:593
133190991615,1cyclictest2107-21gnome-shell22:14:583
133190991615,1cyclictest0-21swapper/323:06:583
13318399168,6cyclictest2166-21packagekitd21:36:142
13317499169,5cyclictest823-21earlyoom22:45:481
13317499160,15cyclictest0-21swapper/122:53:141
13316699160,1cyclictest121rcu_preempt23:43:240
2806592150,1sleep40-21swapper/422:06:194
2678592150,1sleep30-21swapper/321:55:453
2678592150,1sleep30-21swapper/321:55:453
2635242150,0sleep20-21swapper/221:53:272
216999150,1rtkit-daemon823-21earlyoom20:41:386
216999150,1rtkit-daemon2168-21rtkit-daemon21:09:376
216999150,1rtkit-daemon2168-21rtkit-daemon19:29:126
1377822150,0sleep10-21swapper/119:15:141
133219991514,1cyclictest2107-21gnome-shell23:06:587
133219991514,1cyclictest2107-21gnome-shell21:12:587
133219991514,1cyclictest0-21swapper/722:14:597
133219991513,1cyclictest2107-21gnome-shell00:23:597
13321999150,1cyclictest0-21swapper/723:45:047
13320699150,15cyclictest0-21swapper/523:07:595
13320699150,15cyclictest0-21swapper/500:25:595
133198991515,0cyclictest0-21swapper/400:10:114
133198991513,1cyclictest2107-21gnome-shell22:37:584
133198991511,3cyclictest99050irq/162-enp10s000:29:144
133190991514,1cyclictest0-21swapper/321:12:593
133190991514,1cyclictest0-21swapper/300:23:583
133174991512,3cyclictest845-21rngd23:23:481
133166991515,0cyclictest0-21swapper/023:36:550
4689922140,1sleep10-21swapper/100:39:571
2939602140,0sleep00-21swapper/022:17:360
216999140,7rtkit-daemon0-21swapper/200:38:132
216999140,1rtkit-daemon2168-21rtkit-daemon23:36:152
133219991413,1cyclictest0-21swapper/722:57:157
13321999140,1cyclictest0-21swapper/723:41:287
13321999140,1cyclictest0-21swapper/723:26:517
13321999140,1cyclictest0-21swapper/723:02:177
13321999140,1cyclictest0-21swapper/720:47:107
13321999140,1cyclictest0-21swapper/719:35:207
13321999140,1cyclictest0-21swapper/700:06:597
13321999140,1cyclictest0-21swapper/700:00:497
13321999140,14cyclictest0-21swapper/722:53:407
13321299144,5cyclictest937-21lldpd23:31:446
133206991413,1cyclictest2107-21gnome-shell21:26:595
13320699140,1cyclictest0-21swapper/522:18:335
13320699140,1cyclictest0-21swapper/519:35:185
13319899140,14cyclictest0-21swapper/422:50:324
133190991413,1cyclictest845-21rngd21:30:513
13319099140,1cyclictest0-21swapper/321:50:373
13319099140,1cyclictest0-21swapper/321:47:023
13319099140,14cyclictest0-21swapper/323:35:203
13319099140,14cyclictest0-21swapper/322:05:353
13319099140,14cyclictest0-21swapper/321:44:163
13319099140,14cyclictest0-21swapper/321:20:033
13318399142,1cyclictest121rcu_preempt21:30:482
13318399140,1cyclictest0-21swapper/222:32:122
133174991413,1cyclictest21-21ksoftirqd/123:52:051
133174991413,1cyclictest0-21swapper/123:57:591
13317499140,14cyclictest0-21swapper/100:04:091
133166991414,0cyclictest0-21swapper/020:10:220
133166991413,1cyclictest0-21swapper/023:32:010
133166991413,1cyclictest0-21swapper/023:17:240
133166991413,1cyclictest0-21swapper/023:01:560
133166991413,1cyclictest0-21swapper/021:35:060
13316699141,12cyclictest0-21swapper/000:21:290
13316699140,4cyclictest0-21swapper/022:41:480
3799092130,1sleep40-21swapper/423:26:224
2764892130,1sleep10-21swapper/122:04:161
216999130,2rtkit-daemon0-21swapper/623:50:546
216999130,1rtkit-daemon300146-21ssh22:22:342
216999130,1rtkit-daemon1134-21snmpd00:30:152
133219991313,0cyclictest0-21swapper/721:19:507
133219991313,0cyclictest0-21swapper/720:35:177
13321999130,13cyclictest0-21swapper/722:46:307
13321999130,13cyclictest0-21swapper/721:37:547
13321999130,0cyclictest0-21swapper/721:53:217
133212991312,1cyclictest2107-21gnome-shell22:21:596
13321299130,0cyclictest0-21swapper/623:42:046
13321299130,0cyclictest0-21swapper/623:29:316
13321299130,0cyclictest0-21swapper/622:08:246
13320699133,9cyclictest208710-21diskmemload00:38:595
13320699133,1cyclictest121rcu_preempt22:53:245
133206991313,0cyclictest0-21swapper/521:12:135
133206991312,1cyclictest282275-21ssh22:08:385
13320699130,13cyclictest0-21swapper/500:24:555
13320699130,13cyclictest0-21swapper/500:05:525
13320699130,0cyclictest0-21swapper/521:43:565
133198991313,0cyclictest0-21swapper/423:47:264
133198991313,0cyclictest0-21swapper/423:07:354
133198991313,0cyclictest0-21swapper/421:45:184
133198991312,1cyclictest2107-21gnome-shell19:48:584
133198991312,1cyclictest0-21swapper/423:20:174
13319899130,13cyclictest0-21swapper/423:37:404
13319899130,13cyclictest0-21swapper/421:42:344
13319899130,13cyclictest0-21swapper/400:08:054
13319899130,0cyclictest0-21swapper/423:03:224
13319899130,0cyclictest0-21swapper/422:44:004
13319099137,5cyclictest2123-21JS17:37:033
133190991313,0cyclictest0-21swapper/322:36:293
133190991313,0cyclictest0-21swapper/322:24:063
133190991313,0cyclictest0-21swapper/321:17:173
13319099130,13cyclictest0-21swapper/323:25:343
13319099130,13cyclictest0-21swapper/323:12:523
13319099130,13cyclictest0-21swapper/321:35:583
13319099130,13cyclictest0-21swapper/300:33:143
13319099130,13cyclictest0-21swapper/300:07:523
133183991313,0cyclictest0-21swapper/222:38:522
133183991312,1cyclictest0-21swapper/223:15:182
13318399130,13cyclictest0-21swapper/223:24:242
13318399130,13cyclictest0-21swapper/223:08:582
13318399130,13cyclictest0-21swapper/222:57:352
13318399130,13cyclictest0-21swapper/222:00:502
13318399130,0cyclictest0-21swapper/222:15:482
13317499130,1cyclictest0-21swapper/121:23:131
13317499130,13cyclictest0-21swapper/121:41:041
13317499130,0cyclictest0-21swapper/121:58:481
13317499130,0cyclictest0-21swapper/121:58:481
133166991313,0cyclictest0-21swapper/023:58:210
133166991313,0cyclictest0-21swapper/022:49:060
133166991313,0cyclictest0-21swapper/000:34:380
133166991312,1cyclictest97850irq/166-enp0s3121:13:280
133166991312,1cyclictest97850irq/166-enp0s3100:03:060
133166991311,1cyclictest844-21nscd22:57:000
13316699130,7cyclictest587-21systemd-journal21:27:590
13316699130,1cyclictest0-21swapper/021:32:210
13316699130,1cyclictest0-21swapper/000:07:190
13316699130,13cyclictest0-21swapper/023:47:180
13316699130,13cyclictest0-21swapper/021:40:380
13316699130,13cyclictest0-21swapper/000:38:020
13316699130,11cyclictest0-21swapper/023:26:010
216999120,1rtkit-daemon2168-21rtkit-daemon19:34:576
216999120,0rtkit-daemon0-21swapper/200:19:376
13321999122,7cyclictest2240-21gsd-housekeepin21:47:297
133219991212,0cyclictest0-21swapper/721:32:217
133219991212,0cyclictest0-21swapper/721:26:497
133219991212,0cyclictest0-21swapper/700:25:327
133219991212,0cyclictest0-21swapper/700:15:187
133219991212,0cyclictest0-21swapper/700:13:107
13321999120,1cyclictest0-21swapper/720:53:147
13321999120,1cyclictest0-21swapper/719:51:137
13321299123,6cyclictest587-21systemd-journal23:10:016
13321299122,6cyclictest823-21earlyoom22:52:036
133212991212,0cyclictest0-21swapper/622:14:046
133212991212,0cyclictest0-21swapper/621:22:126
133212991211,1cyclictest0-21swapper/623:55:526
133212991211,1cyclictest0-21swapper/620:31:396
13320699123,5cyclictest823-21earlyoom23:21:495
133206991212,0cyclictest0-21swapper/523:32:525
133206991212,0cyclictest0-21swapper/523:14:495
133206991212,0cyclictest0-21swapper/522:59:225
133206991211,1cyclictest208710-21diskmemload21:31:335
133206991211,1cyclictest0-21swapper/522:30:355
133206991211,1cyclictest0-21swapper/521:37:445
133206991211,1cyclictest0-21swapper/521:17:065
133206991211,1cyclictest0-21swapper/520:02:585
133206991211,1cyclictest0-21swapper/519:30:055
133206991211,1cyclictest0-21swapper/519:28:085
13320699120,12cyclictest0-21swapper/522:45:525
13320699120,12cyclictest0-21swapper/520:30:065
13320699120,12cyclictest0-21swapper/519:40:315
13320699120,0cyclictest0-21swapper/523:59:035
13319899125,4cyclictest823-21earlyoom21:13:124
133198991212,0cyclictest0-21swapper/423:11:494
133198991212,0cyclictest0-21swapper/422:45:284
133198991212,0cyclictest0-21swapper/422:30:514
133198991212,0cyclictest0-21swapper/421:31:304
133198991212,0cyclictest0-21swapper/421:28:434
133198991212,0cyclictest0-21swapper/419:10:114
133198991212,0cyclictest0-21swapper/400:31:344
133198991211,1cyclictest0-21swapper/423:30:024
133198991211,1cyclictest0-21swapper/420:45:104
133198991210,2cyclictest407850-21aten2.4-expect23:50:124
13319899120,11cyclictest0-21swapper/420:59:094
13319099129,1cyclictest208710-21diskmemload22:01:533
133190991212,0cyclictest0-21swapper/321:27:423
133190991212,0cyclictest0-21swapper/300:36:383
133190991210,1cyclictest844-21nscd23:59:083
13319099120,1cyclictest0-21swapper/319:36:373
13319099120,12cyclictest0-21swapper/319:34:013
133183991212,0cyclictest0-21swapper/221:58:432
133183991212,0cyclictest0-21swapper/221:58:422
13317499121,8cyclictest121rcu_preempt23:47:391
133174991212,0cyclictest0-21swapper/122:40:251
133174991212,0cyclictest0-21swapper/122:13:451
133174991212,0cyclictest0-21swapper/121:17:281
133174991212,0cyclictest0-21swapper/120:56:111
133174991212,0cyclictest0-21swapper/100:19:171
13317499120,12cyclictest0-21swapper/120:32:551
133166991212,0cyclictest0-21swapper/023:50:040
133166991212,0cyclictest0-21swapper/023:08:170
133166991212,0cyclictest0-21swapper/022:01:460
133166991212,0cyclictest0-21swapper/021:05:220
133166991212,0cyclictest0-21swapper/000:19:400
3767172110,0sleep50-21swapper/523:25:105
3757142110,1sleep656-21ksoftirqd/623:24:156
216999110,5rtkit-daemon336369-21ssh22:51:062
216999110,5rtkit-daemon0-21swapper/621:59:306
216999110,5rtkit-daemon0-21swapper/621:59:306
216999110,1rtkit-daemon0-21swapper/621:09:262
216999110,0rtkit-daemon2168-21rtkit-daemon23:40:372
216999110,0rtkit-daemon0-21swapper/600:21:282
216999110,0rtkit-daemon0-21swapper/222:30:556
216999110,0rtkit-daemon0-21swapper/221:54:066
216999110,0rtkit-daemon0-21swapper/221:47:262
216999110,0rtkit-daemon0-21swapper/221:26:176
216999110,0rtkit-daemon0-21swapper/219:10:486
13321999112,7cyclictest381175-21kworker/u16:223:35:227
13321999111,5cyclictest0-21swapper/719:12:367
133219991111,0cyclictest0-21swapper/723:33:497
133219991111,0cyclictest0-21swapper/721:02:377
133219991111,0cyclictest0-21swapper/719:20:387
133219991110,1cyclictest0-21swapper/722:08:177
13321299119,2cyclictest252190-21latency_hist21:45:006
133212991110,1cyclictest0-21swapper/623:47:356
13321299110,11cyclictest0-21swapper/620:15:426
13320699112,8cyclictest2297-21pool-gsd-smartc23:15:215
13320699111,8cyclictest844-21nscd19:20:335
133206991110,1cyclictest0-21swapper/522:40:505
133206991110,1cyclictest0-21swapper/521:46:425
133206991110,1cyclictest0-21swapper/520:56:365
133206991110,1cyclictest0-21swapper/520:49:175
13319899116,3cyclictest0-21swapper/421:05:224
133198991111,0cyclictest0-21swapper/421:03:124
133198991111,0cyclictest0-21swapper/420:33:554
133198991111,0cyclictest0-21swapper/420:00:564
133198991110,1cyclictest0-21swapper/420:10:314
133190991111,0cyclictest0-21swapper/323:32:343
133190991111,0cyclictest0-21swapper/321:06:523
133190991111,0cyclictest0-21swapper/300:19:333
133190991111,0cyclictest0-21swapper/300:04:263
13319099110,1cyclictest0-21swapper/320:53:133
13319099110,11cyclictest0-21swapper/321:02:483
13319099110,11cyclictest0-21swapper/320:47:223
13319099110,11cyclictest0-21swapper/320:23:273
13319099110,11cyclictest0-21swapper/320:07:413
13318399119,1cyclictest28-21ksoftirqd/223:25:152
133183991111,0cyclictest0-21swapper/222:40:212
133183991111,0cyclictest0-21swapper/221:17:252
133183991111,0cyclictest0-21swapper/219:31:332
133183991111,0cyclictest0-21swapper/200:04:062
133183991110,1cyclictest0-21swapper/222:10:192
133183991110,1cyclictest0-21swapper/219:15:082
133183991110,1cyclictest0-21swapper/200:19:122
13318399110,11cyclictest0-21swapper/223:45:152
13318399110,11cyclictest0-21swapper/220:50:052
13318399110,11cyclictest0-21swapper/219:36:072
133174991111,0cyclictest0-21swapper/123:06:151
133174991111,0cyclictest0-21swapper/122:55:331
133174991111,0cyclictest0-21swapper/122:34:341
133174991111,0cyclictest0-21swapper/122:17:191
133174991111,0cyclictest0-21swapper/100:10:191
13317499110,11cyclictest0-21swapper/119:20:541
13316699117,2cyclictest872-21nscd22:20:200
133166991111,0cyclictest0-21swapper/023:24:220
133166991111,0cyclictest0-21swapper/021:51:520
133166991111,0cyclictest0-21swapper/021:00:380
133166991111,0cyclictest0-21swapper/020:32:020
133166991111,0cyclictest0-21swapper/000:27:090
133166991111,0cyclictest0-21swapper/000:13:300
13316699110,1cyclictest0-21swapper/020:41:180
13316699110,1cyclictest0-21swapper/019:47:280
2892432100,0sleep50-21swapper/522:14:455
216999100,0rtkit-daemon0-21swapper/620:49:072
216999100,0rtkit-daemon0-21swapper/619:23:512
216999100,0rtkit-daemon0-21swapper/220:21:446
216999100,0rtkit-daemon0-21swapper/220:11:316
216999100,0rtkit-daemon0-21swapper/219:51:466
13321999104,5cyclictest136027-21kworker/7:122:00:497
13321999102,5cyclictest937-21lldpd23:15:147
133219991010,0cyclictest0-21swapper/723:14:577
133219991010,0cyclictest0-21swapper/721:21:577
133219991010,0cyclictest0-21swapper/720:27:597
133219991010,0cyclictest0-21swapper/720:27:587
133219991010,0cyclictest0-21swapper/700:32:217
13321299109,1cyclictest56-21ksoftirqd/621:14:586
13321299106,4cyclictest0-21swapper/600:08:206
13321299104,5cyclictest845-21rngd21:32:016
13321299102,1cyclictest121rcu_preempt23:01:386
133212991010,0cyclictest0-21swapper/622:45:486
133212991010,0cyclictest0-21swapper/622:00:356
133212991010,0cyclictest0-21swapper/619:15:136
133212991010,0cyclictest0-21swapper/600:35:346
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional