You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 20:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Sun Nov 30, 2025 12:46:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2169991220,25rtkit-daemon0-21swapper/609:43:156
66174210788,3sleep10-21swapper/107:05:251
6433829443,12sleep70-21swapper/707:05:087
67257998916,39cyclictest0-21swapper/207:23:142
216999890,73rtkit-daemon0-21swapper/207:05:102
67280998815,40cyclictest0-21swapper/511:03:145
67280998815,40cyclictest0-21swapper/511:03:145
67257998716,39cyclictest0-21swapper/207:48:152
67280998515,38cyclictest0-21swapper/508:43:155
67257998516,38cyclictest0-21swapper/209:08:152
67240998517,36cyclictest0-21swapper/011:13:140
67257998316,37cyclictest0-21swapper/209:53:152
67257998316,34cyclictest0-21swapper/212:08:152
6693528341,13sleep60-21swapper/607:08:206
67280998116,36cyclictest0-21swapper/510:13:145
67280998115,35cyclictest0-21swapper/510:03:155
67257998116,34cyclictest0-21swapper/211:58:142
67294997615,34cyclictest0-21swapper/711:33:157
67294997614,35cyclictest0-21swapper/710:48:157
677512750,2sleep656-21ksoftirqd/607:10:126
6725799755,33cyclictest0-21swapper/209:28:152
67294997417,37cyclictest0-21swapper/712:33:147
67294997417,37cyclictest0-21swapper/712:33:147
67294997416,36cyclictest0-21swapper/707:13:157
6680527441,27sleep00-21swapper/007:06:300
818202730,1sleep6551rcuc/607:30:156
67294997116,38cyclictest0-21swapper/708:33:157
67294997115,35cyclictest0-21swapper/711:48:157
67294997114,35cyclictest0-21swapper/710:38:157
1093812700,1sleep549-21ksoftirqd/508:15:155
67294996916,40cyclictest0-21swapper/710:28:157
6433526944,12sleep40-21swapper/407:05:054
2058282680,0sleep60-21swapper/610:50:146
6689626641,12sleep50-21swapper/507:07:475
6682926444,14sleep30-21swapper/307:06:483
216999360,0rtkit-daemon0-21swapper/609:09:086
67246993410,24cyclictest0-21swapper/110:26:581
67264993314,19cyclictest0-21swapper/308:18:143
6724699339,24cyclictest0-21swapper/110:55:591
6724699339,24cyclictest0-21swapper/110:11:581
6729499328,24cyclictest0-21swapper/707:51:587
6724699328,24cyclictest0-21swapper/108:50:581
67240993216,15cyclictest0-21swapper/010:33:140
67257993116,15cyclictest0-21swapper/210:53:152
6724099317,24cyclictest0-21swapper/007:23:580
67280993014,15cyclictest0-21swapper/510:23:145
67264993016,14cyclictest0-21swapper/308:53:153
67264993014,16cyclictest0-21swapper/308:08:143
67264993014,16cyclictest0-21swapper/308:08:143
6724699306,24cyclictest0-21swapper/111:12:591
67240993014,15cyclictest0-21swapper/010:43:140
6725799296,0cyclictest0-21swapper/210:30:592
67257992913,15cyclictest0-21swapper/208:28:152
67257992913,15cyclictest0-21swapper/208:13:152
67257992913,15cyclictest0-21swapper/208:03:142
6724099295,24cyclictest0-21swapper/008:59:590
6728699284,24cyclictest0-21swapper/611:36:586
6724699284,24cyclictest0-21swapper/107:21:591
6724699283,24cyclictest0-21swapper/107:45:581
67246992812,15cyclictest0-21swapper/109:03:141
6724099284,24cyclictest0-21swapper/009:52:590
6728699273,24cyclictest0-21swapper/609:17:596
67257992711,7cyclictest0-21swapper/211:38:152
6724699273,24cyclictest0-21swapper/109:58:581
6729499268,5cyclictest0-21swapper/711:08:157
67286992626,0cyclictest0-21swapper/611:50:336
67264992615,11cyclictest0-21swapper/307:58:153
6724699262,24cyclictest0-21swapper/110:51:591
6724699262,24cyclictest0-21swapper/109:37:581
6724699262,24cyclictest0-21swapper/109:29:591
6724699261,24cyclictest0-21swapper/109:21:591
6729499259,15cyclictest0-21swapper/709:48:147
6729499259,15cyclictest0-21swapper/709:13:147
6728099259,15cyclictest0-21swapper/512:13:155
6724699259,15cyclictest0-21swapper/112:18:151
67246992524,1cyclictest2107-21gnome-shell11:30:591
6729499248,15cyclictest0-21swapper/709:23:157
6725799248,15cyclictest0-21swapper/208:58:152
6725799248,15cyclictest0-21swapper/207:38:142
67257992423,1cyclictest0-21swapper/211:50:042
6724699240,24cyclictest0-21swapper/109:54:581
6724099240,24cyclictest0-21swapper/011:33:580
6728099237,15cyclictest0-21swapper/512:28:145
6728099230,0cyclictest0-21swapper/510:30:585
6729499226,15cyclictest0-21swapper/711:18:157
67286992221,1cyclictest2107-21gnome-shell08:46:586
6729499215,15cyclictest0-21swapper/710:08:157
67286992120,1cyclictest0-21swapper/611:16:596
6728099215,15cyclictest0-21swapper/507:53:145
6726499217,13cyclictest0-21swapper/307:43:153
6724699215,15cyclictest0-21swapper/108:23:141
67246992120,1cyclictest2107-21gnome-shell11:06:591
67286992019,1cyclictest2107-21gnome-shell12:20:596
6728099208,1cyclictest0-21swapper/512:38:145
67272992019,1cyclictest2107-21gnome-shell08:52:584
67246992020,0cyclictest0-21swapper/112:11:581
216999200,0rtkit-daemon0-21swapper/609:38:376
878802190,2sleep656-21ksoftirqd/607:40:166
6729499193,15cyclictest180150-21kworker/7:010:18:147
67286991919,0cyclictest0-21swapper/607:37:026
67286991918,1cyclictest56-21ksoftirqd/611:20:246
67257991918,1cyclictest2107-21gnome-shell09:17:582
1951032190,0sleep3341rcuc/310:30:253
67272991814,4cyclictest0-21swapper/411:53:144
67272991811,7cyclictest0-21swapper/407:18:154
67272991811,5cyclictest2127-21JS17:37:034
1733142180,2sleep335-21ksoftirqd/309:55:263
1485732180,0sleep0148576-21unixbench_multi09:15:260
67294991716,0cyclictest0-21swapper/712:06:527
67286991715,1cyclictest2107-21gnome-shell10:42:586
67280991717,0cyclictest0-21swapper/511:59:035
67280991715,1cyclictest0-21swapper/510:25:135
6728099171,13cyclictest0-21swapper/511:28:145
67272991716,1cyclictest2107-21gnome-shell12:37:594
6727299171,15cyclictest0-21swapper/412:23:144
67257991717,0cyclictest0-21swapper/212:38:112
6725799171,15cyclictest0-21swapper/208:48:152
6724699173,3cyclictest823-21earlyoom12:35:131
6724699171,15cyclictest0-21swapper/109:18:141
6724099172,9cyclictest103471-21sh08:05:140
6724099172,9cyclictest103471-21sh08:05:140
216999170,1rtkit-daemon0-21swapper/607:15:482
216999170,0rtkit-daemon0-21swapper/608:20:206
67272991615,1cyclictest2107-21gnome-shell09:12:584
6724699162,4cyclictest823-21earlyoom11:15:251
6724699162,13cyclictest0-21swapper/108:38:141
67246991616,0cyclictest0-21swapper/111:24:591
6724699160,7cyclictest0-21swapper/109:33:141
6724699160,7cyclictest0-21swapper/109:33:141
67240991615,1cyclictest0-21swapper/011:51:550
216999160,1rtkit-daemon2168-21rtkit-daemon11:28:590
6728699152,8cyclictest891-21gdbus12:15:006
67286991514,1cyclictest2107-21gnome-shell12:28:596
67286991514,1cyclictest2107-21gnome-shell10:22:596
67286991513,1cyclictest2107-21gnome-shell10:07:586
6728099151,12cyclictest0-21swapper/507:28:145
6725799158,6cyclictest2168-21rtkit-daemon08:06:472
6725799158,6cyclictest2168-21rtkit-daemon08:06:472
67257991514,1cyclictest0-21swapper/211:11:592
67246991515,0cyclictest0-21swapper/108:29:581
67246991515,0cyclictest0-21swapper/107:34:591
6724699150,11cyclictest0-21swapper/111:41:021
6724699150,11cyclictest0-21swapper/111:00:321
6724699150,11cyclictest0-21swapper/111:00:321
216999150,1rtkit-daemon823-21earlyoom12:04:370
67294991413,1cyclictest0-21swapper/709:38:147
67286991413,1cyclictest56-21ksoftirqd/608:05:016
67264991414,0cyclictest0-21swapper/307:22:583
67257991414,0cyclictest0-21swapper/210:03:592
67246991414,0cyclictest0-21swapper/108:44:461
67246991412,2cyclictest0-21swapper/112:03:091
67246991411,0cyclictest0-21swapper/110:30:371
67246991410,0cyclictest0-21swapper/109:05:251
6724699140,0cyclictest0-21swapper/112:25:461
216999140,4rtkit-daemon28-21ksoftirqd/208:34:396
216999140,0rtkit-daemon0-21swapper/209:21:572
67294991312,1cyclictest0-21swapper/707:20:227
67286991312,1cyclictest0-21swapper/610:18:006
67286991312,1cyclictest0-21swapper/609:31:106
67286991312,1cyclictest0-21swapper/609:31:106
67286991312,1cyclictest0-21swapper/608:37:116
67286991312,1cyclictest0-21swapper/607:55:256
6728699130,13cyclictest0-21swapper/611:55:246
6728699130,12cyclictest0-21swapper/612:07:086
6728099130,13cyclictest0-21swapper/507:45:135
67272991312,1cyclictest0-21swapper/412:06:134
67272991312,1cyclictest0-21swapper/408:20:224
67264991313,0cyclictest0-21swapper/307:46:403
67264991312,1cyclictest2107-21gnome-shell11:10:583
67257991312,1cyclictest28-21ksoftirqd/207:11:332
6725799130,0cyclictest0-21swapper/210:40:172
67246991312,1cyclictest21-21ksoftirqd/112:21:221
67246991312,1cyclictest2107-21gnome-shell11:29:591
216999130,0rtkit-daemon0-21swapper/410:35:250
67286991211,1cyclictest0-21swapper/611:43:146
67286991211,1cyclictest0-21swapper/611:26:486
67286991211,1cyclictest0-21swapper/610:45:096
67286991211,1cyclictest0-21swapper/609:45:096
6728099120,11cyclictest254787-21latency_hist12:10:015
67272991212,0cyclictest0-21swapper/408:33:124
67272991212,0cyclictest0-21swapper/408:08:104
67272991212,0cyclictest0-21swapper/408:08:104
6727299120,12cyclictest0-21swapper/410:40:224
67264991211,1cyclictest0-21swapper/311:55:473
6726499120,12cyclictest0-21swapper/311:23:443
6726499120,12cyclictest0-21swapper/307:33:593
6726499120,0cyclictest0-21swapper/310:47:093
6724699120,12cyclictest0-21swapper/112:09:581
67240991211,1cyclictest0-21swapper/012:25:250
67240991211,1cyclictest0-21swapper/009:48:590
6724099120,1cyclictest0-21swapper/009:05:440
216999120,0rtkit-daemon0-21swapper/411:47:090
216999120,0rtkit-daemon0-21swapper/411:37:580
216999120,0rtkit-daemon0-21swapper/012:30:204
216999120,0rtkit-daemon0-21swapper/012:30:194
216999120,0rtkit-daemon0-21swapper/010:00:164
67294991111,0cyclictest0-21swapper/710:00:327
67294991111,0cyclictest0-21swapper/708:55:007
6728699115,4cyclictest145102-21runrttasks09:10:226
6728699112,7cyclictest823-21earlyoom11:34:006
67286991110,1cyclictest56-21ksoftirqd/609:00:136
67286991110,1cyclictest0-21swapper/612:00:586
67286991110,1cyclictest0-21swapper/608:57:506
6728699110,11cyclictest0-21swapper/610:59:186
6728699110,11cyclictest0-21swapper/609:22:346
6728699110,0cyclictest0-21swapper/612:36:536
6728699110,0cyclictest0-21swapper/608:19:086
67280991111,0cyclictest0-21swapper/509:31:045
67280991111,0cyclictest0-21swapper/509:31:045
67280991110,1cyclictest0-21swapper/510:50:445
67280991110,1cyclictest0-21swapper/509:58:135
6728099110,11cyclictest0-21swapper/508:30:255
6727299112,4cyclictest587-21systemd-journal07:44:594
67272991111,0cyclictest0-21swapper/411:07:024
6727299110,11cyclictest0-21swapper/411:45:354
6727299110,11cyclictest0-21swapper/411:28:504
6727299110,11cyclictest0-21swapper/409:51:254
6727299110,11cyclictest0-21swapper/409:26:524
6727299110,11cyclictest0-21swapper/408:19:424
6727299110,11cyclictest0-21swapper/407:59:144
6727299110,11cyclictest0-21swapper/407:45:224
6727299110,11cyclictest0-21swapper/407:11:454
6727299110,0cyclictest0-21swapper/407:27:414
67264991111,0cyclictest0-21swapper/312:05:233
67264991111,0cyclictest0-21swapper/311:50:163
67264991111,0cyclictest0-21swapper/311:34:573
67264991110,1cyclictest0-21swapper/311:27:583
6726499110,1cyclictest0-21swapper/308:33:493
6726499110,11cyclictest0-21swapper/312:17:443
6726499110,11cyclictest0-21swapper/311:37:433
6726499110,11cyclictest0-21swapper/309:50:453
6726499110,11cyclictest0-21swapper/308:43:243
6725799112,5cyclictest27817-21kworker/2:009:45:162
6725799111,1cyclictest121rcu_preempt08:35:162
67257991110,1cyclictest0-21swapper/211:19:302
67257991110,1cyclictest0-21swapper/207:30:322
6725799110,11cyclictest0-21swapper/212:27:072
6725799110,11cyclictest0-21swapper/211:26:282
67240991111,0cyclictest0-21swapper/008:45:150
67240991110,1cyclictest0-21swapper/008:12:050
6724099110,1cyclictest0-21swapper/012:31:360
6724099110,1cyclictest0-21swapper/012:31:360
6724099110,1cyclictest0-21swapper/010:01:300
6724099110,11cyclictest0-21swapper/008:44:360
6724099110,11cyclictest0-21swapper/007:40:320
6724099110,11cyclictest0-21swapper/007:36:090
6724099110,0cyclictest0-21swapper/008:38:160
216999110,1rtkit-daemon2297-21pool-gsd-smartc12:23:000
216999110,0rtkit-daemon0-21swapper/609:12:552
216999110,0rtkit-daemon0-21swapper/607:59:202
216999110,0rtkit-daemon0-21swapper/412:14:000
216999110,0rtkit-daemon0-21swapper/410:22:030
216999110,0rtkit-daemon0-21swapper/410:08:550
216999110,0rtkit-daemon0-21swapper/012:15:244
216999110,0rtkit-daemon0-21swapper/012:00:184
216999110,0rtkit-daemon0-21swapper/010:56:544
67294991010,0cyclictest0-21swapper/711:50:137
67294991010,0cyclictest0-21swapper/711:12:547
67294991010,0cyclictest0-21swapper/711:01:417
67294991010,0cyclictest0-21swapper/711:01:417
67294991010,0cyclictest0-21swapper/710:40:037
67294991010,0cyclictest0-21swapper/710:11:457
67294991010,0cyclictest0-21swapper/709:51:157
67294991010,0cyclictest0-21swapper/708:25:357
67294991010,0cyclictest0-21swapper/708:24:567
67294991010,0cyclictest0-21swapper/708:12:057
6729499100,10cyclictest0-21swapper/708:53:427
6729499100,0cyclictest0-21swapper/709:15:397
6729499100,0cyclictest0-21swapper/708:05:057
6729499100,0cyclictest0-21swapper/708:05:057
6728699109,1cyclictest56-21ksoftirqd/609:55:536
6728699109,1cyclictest56-21ksoftirqd/609:30:006
6728699108,1cyclictest0-21swapper/611:05:006
6728699108,1cyclictest0-21swapper/611:05:006
6728699105,2cyclictest986-21runrttasks08:43:596
6728699103,5cyclictest116463-21hddtemp_smartct08:25:166
6728699102,6cyclictest114804-21kworker/6:208:50:156
6728699100,6cyclictest190732-21fschecks_count10:25:156
6728699100,0cyclictest0-21swapper/610:36:536
67280991010,0cyclictest0-21swapper/511:39:425
67280991010,0cyclictest0-21swapper/511:22:175
67280991010,0cyclictest0-21swapper/508:20:495
6728099100,10cyclictest0-21swapper/510:19:415
6728099100,10cyclictest0-21swapper/507:57:145
6728099100,0cyclictest0-21swapper/511:42:275
6727299103,4cyclictest220219-21users11:10:264
6727299101,8cyclictest67228-21cyclictest09:20:114
67272991010,0cyclictest0-21swapper/409:59:234
67272991010,0cyclictest0-21swapper/408:42:094
6727299100,2cyclictest0-21swapper/409:36:344
6727299100,10cyclictest0-21swapper/411:56:374
6727299100,10cyclictest0-21swapper/410:16:094
6727299100,0cyclictest0-21swapper/411:02:494
6727299100,0cyclictest0-21swapper/411:02:494
6727299100,0cyclictest0-21swapper/410:26:334
6727299100,0cyclictest0-21swapper/407:52:534
6726499109,1cyclictest0-21swapper/309:36:463
6726499109,1cyclictest0-21swapper/308:58:523
6726499103,5cyclictest176044-21runrttasks10:00:223
67264991010,0cyclictest0-21swapper/312:11:343
67264991010,0cyclictest0-21swapper/312:01:583
67264991010,0cyclictest0-21swapper/311:47:293
67264991010,0cyclictest0-21swapper/311:05:323
67264991010,0cyclictest0-21swapper/311:03:253
67264991010,0cyclictest0-21swapper/311:03:253
67264991010,0cyclictest0-21swapper/310:59:113
67264991010,0cyclictest0-21swapper/310:43:443
67264991010,0cyclictest0-21swapper/310:37:333
67264991010,0cyclictest0-21swapper/310:19:303
67264991010,0cyclictest0-21swapper/310:06:403
67264991010,0cyclictest0-21swapper/309:43:263
6726499100,10cyclictest0-21swapper/308:22:553
6726499100,0cyclictest0-21swapper/310:14:393
6725799109,1cyclictest28-21ksoftirqd/209:30:212
6725799109,1cyclictest28-21ksoftirqd/209:30:212
67257991010,0cyclictest0-21swapper/212:23:422
67257991010,0cyclictest0-21swapper/211:07:372
67257991010,0cyclictest0-21swapper/210:10:422
67257991010,0cyclictest0-21swapper/208:30:522
67257991010,0cyclictest0-21swapper/207:54:262
6725799100,10cyclictest0-21swapper/211:03:242
6725799100,10cyclictest0-21swapper/211:03:242
6725799100,10cyclictest0-21swapper/210:46:292
6725799100,10cyclictest0-21swapper/207:44:222
6725799100,0cyclictest0-21swapper/209:39:292
6725799100,0cyclictest0-21swapper/208:16:432
67246991010,0cyclictest0-21swapper/109:45:251
67246991010,0cyclictest0-21swapper/108:12:441
6724699100,10cyclictest0-21swapper/107:37:561
6724699100,0cyclictest0-21swapper/108:05:061
6724699100,0cyclictest0-21swapper/108:05:051
6724699100,0cyclictest0-21swapper/107:58:071
6724099108,1cyclictest0-21swapper/011:05:240
67240991010,0cyclictest0-21swapper/012:06:590
67240991010,0cyclictest0-21swapper/011:20:020
67240991010,0cyclictest0-21swapper/009:32:240
67240991010,0cyclictest0-21swapper/009:32:230
6724099100,10cyclictest0-21swapper/011:03:170
6724099100,10cyclictest0-21swapper/011:03:170
6724099100,10cyclictest0-21swapper/008:31:160
6724099100,10cyclictest0-21swapper/008:21:400
216999100,0rtkit-daemon0-21swapper/608:40:282
216999100,0rtkit-daemon0-21swapper/607:28:502
216999100,0rtkit-daemon0-21swapper/411:44:300
216999100,0rtkit-daemon0-21swapper/410:51:450
216999100,0rtkit-daemon0-21swapper/011:44:394
216999100,0rtkit-daemon0-21swapper/011:23:544
216999100,0rtkit-daemon0-21swapper/010:31:374
216999100,0rtkit-daemon0-21swapper/010:14:114
1629362100,0sleep50-21swapper/509:40:145
77081290,1sleep50-21swapper/507:20:295
672949999,0cyclictest0-21swapper/712:37:077
672949999,0cyclictest0-21swapper/712:19:147
672949999,0cyclictest0-21swapper/711:29:397
672949999,0cyclictest0-21swapper/711:22:407
672949999,0cyclictest0-21swapper/710:55:207
672949999,0cyclictest0-21swapper/707:33:327
672949999,0cyclictest0-21swapper/707:28:307
672949995,4cyclictest233390-21/usr/sbin/munin11:35:137
672949991,5cyclictest2110-21gmain08:15:157
672869996,3cyclictest56-21ksoftirqd/607:50:176
672869995,2cyclictest267051-21systemd-userwor12:32:166
672869995,2cyclictest267051-21systemd-userwor12:32:166
672869994,2cyclictest73027-21systemd-userwor07:19:556
672869994,2cyclictest239038-21systemd-userwor11:46:406
672869992,5cyclictest374766-21kworker/6:207:25:246
672869990,4cyclictest0-21swapper/608:08:246
672869990,4cyclictest0-21swapper/608:08:246
672809999,0cyclictest0-21swapper/512:33:205
672809999,0cyclictest0-21swapper/512:33:205
672809999,0cyclictest0-21swapper/512:24:245
672809999,0cyclictest0-21swapper/511:34:095
672809999,0cyclictest0-21swapper/510:42:265
672809999,0cyclictest0-21swapper/510:08:095
672809998,1cyclictest0-21swapper/511:12:315
672809993,5cyclictest249601-21df12:00:155
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional