You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 00:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Wed Nov 26, 2025 12:46:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28785812133115,2sleep10-21swapper/107:07:101
287850729946,13sleep30-21swapper/307:06:073
2879007999125,35cyclictest0-21swapper/710:23:147
2879007999125,35cyclictest0-21swapper/710:23:137
2878959998716,39cyclictest0-21swapper/109:28:141
2879000998627,37cyclictest0-21swapper/608:38:146
2879007998516,38cyclictest0-21swapper/712:23:147
2879000998416,38cyclictest0-21swapper/609:13:146
2879007998317,36cyclictest0-21swapper/710:48:147
2879000998317,30cyclictest0-21swapper/607:18:146
2879000998316,37cyclictest0-21swapper/611:23:136
2879000998316,35cyclictest0-21swapper/610:38:146
287871228343,33sleep50-21swapper/507:08:595
287864528342,34sleep60-21swapper/607:08:036
2879007998214,36cyclictest0-21swapper/711:58:137
2878959998215,37cyclictest0-21swapper/109:03:141
2879007998116,36cyclictest0-21swapper/712:08:137
2879000998117,35cyclictest0-21swapper/610:58:146
2879007997917,38cyclictest0-21swapper/707:53:147
2879007997915,35cyclictest0-21swapper/711:33:147
287866627644,19sleep00-21swapper/007:08:210
29393552740,0sleep763-21ksoftirqd/708:45:127
2878953997318,20cyclictest0-21swapper/012:33:130
30375282720,0sleep70-21swapper/711:20:197
287814627156,9sleep40-21swapper/407:05:284
287849726943,13sleep20-21swapper/207:05:582
287864626842,13sleep70-21swapper/707:08:047
2878953993410,24cyclictest0-21swapper/007:31:590
2878953993410,24cyclictest0-21swapper/007:31:590
287900099339,24cyclictest0-21swapper/609:22:586
287895999339,24cyclictest0-21swapper/112:27:591
287900099328,24cyclictest0-21swapper/611:39:596
287896799328,24cyclictest0-21swapper/208:58:592
287896799328,24cyclictest0-21swapper/208:58:592
2879007993014,15cyclictest0-21swapper/707:23:147
287898699306,24cyclictest0-21swapper/408:41:594
287898699306,24cyclictest0-21swapper/407:45:594
287896799306,24cyclictest0-21swapper/211:10:582
287896799306,24cyclictest0-21swapper/207:17:582
287895399306,24cyclictest0-21swapper/012:26:580
2879000992913,15cyclictest0-21swapper/612:28:146
2879000992913,15cyclictest0-21swapper/609:43:146
2878994992928,1cyclictest0-21swapper/507:43:145
287896799295,24cyclictest0-21swapper/208:49:592
2878967992928,1cyclictest0-21swapper/211:50:122
2878967992928,1cyclictest0-21swapper/211:50:122
2878959992914,15cyclictest0-21swapper/110:18:141
2879000992812,15cyclictest0-21swapper/608:58:146
2879000992812,15cyclictest0-21swapper/608:58:146
287896799284,24cyclictest0-21swapper/212:39:592
287896799284,24cyclictest0-21swapper/210:02:592
287895399284,24cyclictest0-21swapper/007:28:580
2878959992711,15cyclictest0-21swapper/110:33:131
2879000992610,15cyclictest0-21swapper/612:38:146
2879000992610,15cyclictest0-21swapper/610:28:136
2879000992610,15cyclictest0-21swapper/608:13:146
2878994992614,12cyclictest0-21swapper/508:43:145
2878986992614,12cyclictest0-21swapper/408:03:144
2878967992625,1cyclictest0-21swapper/208:18:142
287896799262,24cyclictest0-21swapper/211:26:592
287896799262,24cyclictest0-21swapper/210:18:592
287900099259,15cyclictest0-21swapper/611:43:146
287899499259,15cyclictest0-21swapper/509:58:145
2878967992524,1cyclictest0-21swapper/211:48:142
2878967992524,1cyclictest0-21swapper/209:48:142
287895399251,24cyclictest0-21swapper/011:25:590
287895399251,24cyclictest0-21swapper/011:09:590
287895399250,1cyclictest0-21swapper/010:12:590
287895399250,1cyclictest0-21swapper/007:35:590
29250042240,1sleep32925006-21gltestperf08:20:173
2879000992423,1cyclictest2107-21gnome-shell08:21:596
287900099240,24cyclictest0-21swapper/607:53:596
2878994992410,14cyclictest0-21swapper/507:33:145
2878994992410,14cyclictest0-21swapper/507:33:145
287897499241,0cyclictest0-21swapper/312:28:593
2878967992423,1cyclictest2107-21gnome-shell11:43:592
287895999248,15cyclictest0-21swapper/109:18:141
287895399248,15cyclictest0-21swapper/011:18:140
287895399245,11cyclictest0-21swapper/008:48:140
287900799237,13cyclictest0-21swapper/709:08:147
287900099237,15cyclictest0-21swapper/611:53:146
287900099237,15cyclictest0-21swapper/611:53:146
287899499238,14cyclictest0-21swapper/510:08:145
2878967992315,8cyclictest0-21swapper/209:33:142
2878967992312,11cyclictest0-21swapper/210:13:142
2878967992311,12cyclictest0-21swapper/212:03:142
2878967992311,12cyclictest0-21swapper/211:38:142
2879000992221,1cyclictest2107-21gnome-shell09:45:586
2878994992221,1cyclictest2107-21gnome-shell09:30:595
287896799228,14cyclictest0-21swapper/207:28:142
287896799227,15cyclictest0-21swapper/210:43:142
287896799227,15cyclictest0-21swapper/209:23:142
287896799227,15cyclictest0-21swapper/208:53:142
287896799227,15cyclictest0-21swapper/207:38:142
2878967992221,1cyclictest0-21swapper/208:28:142
287895999226,15cyclictest0-21swapper/112:13:141
287895999226,15cyclictest0-21swapper/109:53:131
287900099215,15cyclictest0-21swapper/607:48:146
2878986992120,1cyclictest0-21swapper/410:30:594
287896799216,15cyclictest0-21swapper/212:18:142
287896799215,15cyclictest0-21swapper/210:53:142
2878953992120,1cyclictest2107-21gnome-shell10:51:590
287899499203,10cyclictest0-21swapper/511:08:145
2878994992019,1cyclictest2107-21gnome-shell07:57:595
2878994992019,1cyclictest2107-21gnome-shell07:37:595
2878994992019,1cyclictest0-21swapper/511:38:595
2878994992019,1cyclictest0-21swapper/511:27:595
2878986992019,1cyclictest42-21ksoftirqd/408:08:364
2878967992020,0cyclictest0-21swapper/209:53:592
2878967992013,7cyclictest0-21swapper/211:03:142
2878959992020,0cyclictest0-21swapper/111:59:551
28893222190,0sleep50-21swapper/507:25:005
2879007991918,1cyclictest2107-21gnome-shell12:28:597
2879000991918,1cyclictest2107-21gnome-shell10:22:596
2879000991918,1cyclictest2107-21gnome-shell10:22:596
2878986991919,0cyclictest0-21swapper/411:23:594
287895999193,15cyclictest0-21swapper/107:13:141
2878953991919,0cyclictest0-21swapper/011:48:590
2878953991919,0cyclictest0-21swapper/009:55:590
2878953991919,0cyclictest0-21swapper/008:18:590
2878994991818,0cyclictest0-21swapper/512:23:595
2878994991818,0cyclictest0-21swapper/509:27:365
287895399183,8cyclictest0-21swapper/008:13:470
287899499173,13cyclictest0-21swapper/508:23:145
2878994991716,1cyclictest2107-21gnome-shell07:49:595
2878974991717,0cyclictest0-21swapper/311:32:103
216999170,1rtkit-daemon2168-21rtkit-daemon10:44:380
2879007991616,0cyclictest0-21swapper/707:43:597
2879000991615,1cyclictest2107-21gnome-shell11:46:596
2878986991616,0cyclictest0-21swapper/407:33:584
2878986991616,0cyclictest0-21swapper/407:33:584
2878953991616,0cyclictest0-21swapper/009:37:460
2878953991614,2cyclictest10-21ksoftirqd/007:43:090
216999160,2rtkit-daemon937-21lldpd11:11:130
29720582150,0sleep60-21swapper/609:35:176
287900099156,4cyclictest0-21swapper/607:36:476
2879000991514,1cyclictest2107-21gnome-shell12:19:596
2878994991515,0cyclictest0-21swapper/508:12:385
2878994991513,1cyclictest2886046-21latency_hist07:20:005
2878986991510,4cyclictest844-21nscd08:35:154
287897499150,14cyclictest0-21swapper/307:15:153
2878967991514,1cyclictest28-21ksoftirqd/211:20:212
287896799150,15cyclictest0-21swapper/210:22:592
287896799150,15cyclictest0-21swapper/210:22:592
287895399150,15cyclictest0-21swapper/009:43:590
287895399150,15cyclictest0-21swapper/007:22:590
287895399150,13cyclictest0-21swapper/008:08:140
287895399150,0cyclictest0-21swapper/009:16:590
216999150,1rtkit-daemon823-21earlyoom10:08:160
216999150,1rtkit-daemon2168-21rtkit-daemon11:59:200
216999150,1rtkit-daemon2168-21rtkit-daemon11:10:174
2879000991413,1cyclictest56-21ksoftirqd/610:15:226
2878986991414,0cyclictest0-21swapper/409:46:594
287898699140,14cyclictest0-21swapper/412:36:304
2878974991413,1cyclictest0-21swapper/310:45:593
2878974991413,1cyclictest0-21swapper/309:45:003
287895999140,1cyclictest0-21swapper/108:20:231
29006382130,0sleep20-21swapper/207:40:192
2878994991313,0cyclictest0-21swapper/512:35:435
2878994991312,1cyclictest2107-21gnome-shell09:09:595
287899499130,0cyclictest0-21swapper/510:52:095
2878986991310,2cyclictest0-21swapper/410:18:594
287897499138,5cyclictest2954880-21/usr/sbin/munin09:10:183
287897499136,6cyclictest1-21systemd10:42:593
287897499132,5cyclictest30264472sleep311:05:103
2878974991312,1cyclictest0-21swapper/309:25:493
287897499130,13cyclictest0-21swapper/308:37:323
287897499130,0cyclictest0-21swapper/310:55:153
287897499130,0cyclictest0-21swapper/307:55:153
287896799132,7cyclictest937-21lldpd11:55:142
287895999130,13cyclictest0-21swapper/111:20:241
2878953991313,0cyclictest0-21swapper/010:19:120
287895399130,13cyclictest0-21swapper/009:53:510
29220522120,1sleep70-21swapper/708:15:177
287900799125,5cyclictest3004669-21/usr/sbin/munin10:30:167
2879007991212,0cyclictest0-21swapper/707:13:547
2879007991211,1cyclictest0-21swapper/711:10:297
287900099120,12cyclictest0-21swapper/608:50:276
287900099120,11cyclictest0-21swapper/609:01:226
2878994991212,0cyclictest0-21swapper/509:41:595
2878994991212,0cyclictest0-21swapper/508:00:265
287899499120,1cyclictest0-21swapper/510:04:215
2878986991212,0cyclictest0-21swapper/410:58:594
287897499123,8cyclictest360964-1kworker/3:2H11:50:353
287897499123,8cyclictest360964-1kworker/3:2H11:50:353
2878974991211,1cyclictest0-21swapper/311:49:053
2878974991211,1cyclictest0-21swapper/311:43:333
2878974991211,1cyclictest0-21swapper/310:38:213
2878974991211,1cyclictest0-21swapper/310:05:013
287897499120,12cyclictest0-21swapper/312:12:593
287897499120,12cyclictest0-21swapper/308:34:563
287897499120,11cyclictest0-21swapper/312:16:243
287897499120,11cyclictest0-21swapper/309:51:023
287897499120,11cyclictest0-21swapper/308:40:083
287897499120,11cyclictest0-21swapper/307:28:353
287897499120,0cyclictest0-21swapper/310:34:563
287896799120,12cyclictest0-21swapper/207:20:182
2878959991212,0cyclictest0-21swapper/111:29:101
2878959991211,1cyclictest21-21ksoftirqd/109:23:171
287895999120,1cyclictest0-21swapper/107:57:571
287895999120,12cyclictest0-21swapper/107:49:011
287895999120,0cyclictest0-21swapper/110:56:101
287895399128,2cyclictest0-21swapper/009:25:000
287895399120,1cyclictest0-21swapper/008:35:150
287895399120,12cyclictest0-21swapper/010:48:590
287895399120,0cyclictest0-21swapper/011:00:220
216999120,1rtkit-daemon890-21gmain10:39:260
216999120,1rtkit-daemon890-21gmain09:24:584
216999120,1rtkit-daemon2882064-21munin-node11:42:364
216999120,1rtkit-daemon1134-21snmpd09:11:484
29325672110,2sleep50-21swapper/508:33:095
2879007991111,0cyclictest0-21swapper/710:43:007
2879007991110,1cyclictest63-21ksoftirqd/709:32:517
287900799110,7cyclictest823-21earlyoom11:15:247
287900799110,0cyclictest0-21swapper/712:30:297
2879000991110,1cyclictest0-21swapper/611:16:596
2879000991110,1cyclictest0-21swapper/610:42:116
2879000991110,1cyclictest0-21swapper/608:32:556
2879000991110,1cyclictest0-21swapper/607:13:246
287900099110,11cyclictest0-21swapper/611:33:056
287900099110,11cyclictest0-21swapper/607:31:466
287900099110,11cyclictest0-21swapper/607:31:466
287900099110,0cyclictest0-21swapper/611:05:366
287900099110,0cyclictest0-21swapper/609:50:486
2878994991111,0cyclictest0-21swapper/508:55:245
2878994991111,0cyclictest0-21swapper/508:55:245
2878994991111,0cyclictest0-21swapper/508:46:175
287899499110,11cyclictest0-21swapper/512:30:515
287899499110,11cyclictest0-21swapper/512:11:405
287899499110,11cyclictest0-21swapper/511:22:245
287899499110,11cyclictest0-21swapper/511:02:535
287899499110,11cyclictest0-21swapper/509:16:225
287899499110,0cyclictest0-21swapper/511:53:085
287899499110,0cyclictest0-21swapper/511:53:085
287899499110,0cyclictest0-21swapper/510:37:115
2878986991110,1cyclictest2107-21gnome-shell07:21:584
287898699110,1cyclictest0-21swapper/411:49:214
287898699110,11cyclictest0-21swapper/411:31:084
287898699110,11cyclictest0-21swapper/411:04:184
287898699110,11cyclictest0-21swapper/409:50:584
287898699110,11cyclictest0-21swapper/408:51:564
287898699110,11cyclictest0-21swapper/408:18:264
287898699110,11cyclictest0-21swapper/407:40:134
287897499119,1cyclictest0-21swapper/309:40:183
287897499116,5cyclictest1-21systemd11:28:593
2878974991110,1cyclictest3687512-21kworker/3:207:50:183
2878974991110,1cyclictest2988770-21kworker/3:112:07:023
2878974991110,1cyclictest2988770-21kworker/3:111:38:023
2878974991110,1cyclictest2963861-21kworker/3:009:34:263
2878974991110,1cyclictest0-21swapper/311:01:163
2878974991110,1cyclictest0-21swapper/310:12:593
2878974991110,1cyclictest0-21swapper/308:47:173
2878974991110,1cyclictest0-21swapper/307:41:163
287897499110,11cyclictest0-21swapper/310:21:363
287897499110,11cyclictest0-21swapper/310:21:363
287897499110,11cyclictest0-21swapper/308:04:123
287897499110,11cyclictest0-21swapper/307:48:163
287897499110,0cyclictest0-21swapper/311:18:013
287897499110,0cyclictest0-21swapper/311:12:393
287897499110,0cyclictest0-21swapper/308:12:293
287896799111,7cyclictest937-21lldpd09:14:062
287896799110,11cyclictest0-21swapper/210:32:492
287896799110,11cyclictest0-21swapper/208:13:092
287896799110,11cyclictest0-21swapper/207:33:382
287896799110,11cyclictest0-21swapper/207:33:382
287895999110,9cyclictest0-21swapper/110:49:031
287895999110,11cyclictest0-21swapper/110:28:221
287895999110,11cyclictest0-21swapper/110:23:391
287895999110,11cyclictest0-21swapper/110:23:391
287895999110,11cyclictest0-21swapper/109:58:551
287895999110,11cyclictest0-21swapper/109:33:341
287895999110,11cyclictest0-21swapper/107:17:471
2878953991111,0cyclictest0-21swapper/012:00:510
287895399110,11cyclictest0-21swapper/009:08:390
216999110,1rtkit-daemon855-21in:imjournal11:05:404
216999110,0rtkit-daemon0-21swapper/410:30:020
216999110,0rtkit-daemon0-21swapper/410:24:490
216999110,0rtkit-daemon0-21swapper/410:24:490
216999110,0rtkit-daemon0-21swapper/408:56:430
216999110,0rtkit-daemon0-21swapper/408:56:430
216999110,0rtkit-daemon0-21swapper/012:27:274
216999110,0rtkit-daemon0-21swapper/012:09:064
216999110,0rtkit-daemon0-21swapper/011:26:564
216999110,0rtkit-daemon0-21swapper/010:07:464
216999110,0rtkit-daemon0-21swapper/009:05:184
216999110,0rtkit-daemon0-21swapper/008:58:334
216999110,0rtkit-daemon0-21swapper/008:58:334
216999110,0rtkit-daemon0-21swapper/008:24:474
287900799103,6cyclictest2892302-21kworker/7:210:55:237
287900799102,3cyclictest2956190-21hddtemp_smartct09:10:177
287900799101,6cyclictest2882502-21switchtime07:15:007
2879007991010,0cyclictest0-21swapper/712:04:377
2879007991010,0cyclictest0-21swapper/709:59:357
2879007991010,0cyclictest0-21swapper/709:52:167
2879007991010,0cyclictest0-21swapper/708:14:237
2879007991010,0cyclictest0-21swapper/707:57:097
287900799100,9cyclictest0-21swapper/709:23:537
287900799100,10cyclictest0-21swapper/712:16:117
287900799100,0cyclictest0-21swapper/711:51:387
287900799100,0cyclictest0-21swapper/711:51:377
287900799100,0cyclictest0-21swapper/710:04:187
287900799100,0cyclictest0-21swapper/709:35:317
287900799100,0cyclictest0-21swapper/708:38:467
287900099109,1cyclictest0-21swapper/611:10:586
287900099109,1cyclictest0-21swapper/607:57:476
287900099103,3cyclictest1134-21snmpd10:30:186
2879000991010,0cyclictest0-21swapper/611:27:436
287900099100,10cyclictest0-21swapper/610:07:236
287900099100,10cyclictest0-21swapper/609:58:466
287900099100,10cyclictest0-21swapper/609:09:106
287900099100,0cyclictest0-21swapper/612:11:086
287900099100,0cyclictest0-21swapper/609:19:056
287900099100,0cyclictest0-21swapper/607:21:416
287899499109,1cyclictest0-21swapper/508:50:515
287899499103,4cyclictest3050803-21systemd-userwor11:48:095
2878994991010,0cyclictest0-21swapper/512:08:545
2878994991010,0cyclictest0-21swapper/511:44:015
2878994991010,0cyclictest0-21swapper/511:12:195
2878994991010,0cyclictest0-21swapper/510:33:465
2878994991010,0cyclictest0-21swapper/510:11:005
287899499100,10cyclictest0-21swapper/510:47:265
287899499100,0cyclictest0-21swapper/512:18:295
287898699103,5cyclictest2999655-21fw_conntrack10:20:154
287898699103,5cyclictest2999655-21fw_conntrack10:20:144
2878986991010,0cyclictest0-21swapper/412:10:294
2878986991010,0cyclictest0-21swapper/411:52:064
2878986991010,0cyclictest0-21swapper/411:52:064
2878986991010,0cyclictest0-21swapper/410:49:404
2878986991010,0cyclictest0-21swapper/409:58:564
2878986991010,0cyclictest0-21swapper/409:43:004
2878986991010,0cyclictest0-21swapper/408:27:234
2878986991010,0cyclictest0-21swapper/407:55:314
287898699100,10cyclictest0-21swapper/410:26:444
287898699100,0cyclictest0-21swapper/407:14:134
287897499109,1cyclictest3687512-21kworker/3:208:56:343
287897499109,1cyclictest3687512-21kworker/3:208:56:343
287897499109,1cyclictest2988770-21kworker/3:112:20:063
287897499109,1cyclictest2988770-21kworker/3:111:20:263
287897499109,1cyclictest2963861-21kworker/3:009:59:503
287897499109,1cyclictest0-21swapper/312:35:353
287897499109,1cyclictest0-21swapper/311:58:013
287897499109,1cyclictest0-21swapper/310:54:363
287897499109,1cyclictest0-21swapper/309:38:143
287897499109,1cyclictest0-21swapper/307:34:563
287897499109,1cyclictest0-21swapper/307:34:563
287897499109,1cyclictest0-21swapper/307:24:123
287897499103,4cyclictest2987322-21sed10:00:153
287897499101,8cyclictest2927850-21sort08:25:163
287896799109,1cyclictest28-21ksoftirqd/211:33:222
287896799109,1cyclictest0-21swapper/208:40:472
2878967991010,0cyclictest0-21swapper/208:37:322
287896799100,0cyclictest0-21swapper/210:48:262
287896799100,0cyclictest0-21swapper/208:34:172
287895999109,1cyclictest3053277-21smart_sda11:45:221
287895999102,5cyclictest3030956-21if_enp5s011:10:161
2878959991010,0cyclictest0-21swapper/112:23:101
2878959991010,0cyclictest0-21swapper/111:15:411
2878959991010,0cyclictest0-21swapper/111:01:321
2878959991010,0cyclictest0-21swapper/110:03:391
2878959991010,0cyclictest0-21swapper/109:40:531
2878959991010,0cyclictest0-21swapper/107:40:041
287895999100,0cyclictest0-21swapper/111:33:531
287895399109,1cyclictest0-21swapper/007:53:320
287895399107,2cyclictest0-21swapper/009:10:210
2878953991010,0cyclictest0-21swapper/012:20:010
2878953991010,0cyclictest0-21swapper/011:40:510
2878953991010,0cyclictest0-21swapper/009:29:080
2878953991010,0cyclictest0-21swapper/008:03:460
216999100,0rtkit-daemon0-21swapper/411:39:270
216999100,0rtkit-daemon0-21swapper/407:47:510
216999100,0rtkit-daemon0-21swapper/012:00:444
216999100,0rtkit-daemon0-21swapper/011:57:404
216999100,0rtkit-daemon0-21swapper/008:11:354
216999100,0rtkit-daemon0-21swapper/007:29:344
3008788290,0sleep40-21swapper/410:35:144
28790079999,0cyclictest0-21swapper/710:52:267
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional