You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 03:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Sun Nov 30, 2025 00:46:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40324372950,0sleep60-21swapper/619:45:196
1001172930,0sleep60-21swapper/623:55:176
4008059998817,38cyclictest0-21swapper/023:33:140
400768828745,13sleep00-21swapper/019:07:080
4008066998617,38cyclictest0-21swapper/123:43:141
4008066998616,39cyclictest0-21swapper/119:28:141
4008059998614,39cyclictest0-21swapper/020:13:140
4008066998515,39cyclictest0-21swapper/119:38:141
4008066998515,39cyclictest0-21swapper/119:38:141
4008059998516,35cyclictest0-21swapper/020:48:140
4008066998416,35cyclictest0-21swapper/120:03:131
400779028446,13sleep40-21swapper/419:08:334
4008066998117,32cyclictest0-21swapper/122:23:141
4008066998116,35cyclictest0-21swapper/121:13:131
41385202790,0sleep20-21swapper/221:52:022
40287222790,0sleep70-21swapper/719:40:157
400557427960,17sleep10-21swapper/119:05:161
596812770,1sleep228-21ksoftirqd/223:24:062
1383612760,0sleep00-21swapper/000:25:240
710612750,0sleep40-21swapper/423:32:244
4008059997515,34cyclictest0-21swapper/021:58:140
41890562740,0sleep60-21swapper/622:32:116
41055742740,0sleep70-21swapper/721:25:247
976172730,0sleep70-21swapper/723:54:237
976172730,0sleep70-21swapper/723:54:237
40742482720,0sleep656-21ksoftirqd/620:54:556
400785827146,12sleep60-21swapper/619:09:316
337102710,0sleep20-21swapper/223:02:592
816592700,0sleep228-21ksoftirqd/223:40:232
400774227051,13sleep30-21swapper/319:07:513
400767627044,12sleep70-21swapper/719:06:597
4008059996916,34cyclictest0-21swapper/020:28:130
400784326843,12sleep20-21swapper/219:09:192
1355262680,0sleep20-21swapper/200:24:382
4008059996617,35cyclictest0-21swapper/021:23:140
4008066996516,38cyclictest0-21swapper/123:23:141
400776226544,14sleep50-21swapper/519:08:095
604112630,0sleep00-21swapper/023:25:000
4008074995734,23cyclictest0-21swapper/219:18:132
4008074995715,37cyclictest0-21swapper/220:38:142
4008104994915,33cyclictest0-21swapper/600:23:136
4008104994815,33cyclictest0-21swapper/621:38:146
4008066993712,24cyclictest146199-21ssh00:31:581
40232062350,2sleep549-21ksoftirqd/519:30:205
4008111993511,24cyclictest0-21swapper/719:12:597
4008079993511,24cyclictest0-21swapper/322:56:593
4008066993410,24cyclictest0-21swapper/123:30:581
4008059993411,0cyclictest0-21swapper/020:17:590
400811199317,24cyclictest0-21swapper/721:35:597
4008098993114,16cyclictest0-21swapper/500:08:145
400807999317,24cyclictest0-21swapper/319:35:593
400807999317,24cyclictest0-21swapper/319:35:593
400811199306,24cyclictest0-21swapper/721:40:597
4008098993014,15cyclictest0-21swapper/521:28:135
400807999306,24cyclictest0-21swapper/319:16:593
400806699306,24cyclictest0-21swapper/120:15:591
4008059993030,0cyclictest0-21swapper/000:20:530
4008059993014,15cyclictest0-21swapper/023:03:140
4008111992927,1cyclictest0-21swapper/722:40:547
4008098992913,15cyclictest0-21swapper/500:18:135
400806699295,24cyclictest0-21swapper/121:49:591
400806699295,24cyclictest0-21swapper/119:43:591
400806699295,24cyclictest0-21swapper/119:15:591
400806699294,24cyclictest4083607-21diskmemload23:36:591
400807999284,24cyclictest0-21swapper/322:05:593
400807499284,24cyclictest0-21swapper/220:47:592
400807499284,24cyclictest0-21swapper/219:24:592
4008059992813,15cyclictest0-21swapper/023:53:140
4008059992813,15cyclictest0-21swapper/023:53:130
4008059992812,15cyclictest0-21swapper/022:08:140
4008059992812,15cyclictest0-21swapper/020:58:140
4008059992812,15cyclictest0-21swapper/019:13:140
40446512270,0sleep20-21swapper/220:05:172
4008090992713,14cyclictest0-21swapper/420:23:144
400807999273,24cyclictest0-21swapper/323:00:593
4008098992610,15cyclictest0-21swapper/520:08:145
400807999263,0cyclictest0-21swapper/323:50:593
400807999263,0cyclictest0-21swapper/323:50:583
4008111992525,0cyclictest0-21swapper/722:21:337
400810499251,24cyclictest0-21swapper/621:16:596
400809099259,15cyclictest0-21swapper/421:43:144
4008090992524,1cyclictest2107-21gnome-shell23:20:594
400807999251,24cyclictest0-21swapper/322:32:593
400807499251,24cyclictest0-21swapper/220:20:592
400805999259,15cyclictest0-21swapper/022:38:140
400811199240,0cyclictest0-21swapper/721:05:597
4008098992424,0cyclictest0-21swapper/523:49:585
4008098992424,0cyclictest0-21swapper/520:41:415
400806699248,15cyclictest0-21swapper/122:43:141
1207852240,0sleep50-21swapper/500:11:355
400810499237,15cyclictest0-21swapper/623:38:146
400810499237,15cyclictest0-21swapper/622:28:146
400810499237,15cyclictest0-21swapper/622:28:136
400809099230,23cyclictest0-21swapper/400:38:594
400807999237,15cyclictest0-21swapper/321:08:143
400805999238,15cyclictest0-21swapper/021:33:130
41472912220,1sleep7621rcuc/721:59:597
4008111992221,1cyclictest0-21swapper/700:33:147
4008111992220,1cyclictest2107-21gnome-shell20:51:587
400810499226,15cyclictest0-21swapper/623:13:146
400807499225,9cyclictest0-21swapper/220:53:142
1471172220,0sleep00-21swapper/000:33:170
4008111992120,1cyclictest0-21swapper/719:20:597
400805999215,15cyclictest0-21swapper/019:58:140
813442200,1sleep763-21ksoftirqd/723:40:207
41832922200,0sleep00-21swapper/022:27:570
41832922200,0sleep00-21swapper/022:27:570
400811199207,13cyclictest0-21swapper/723:28:147
4008111992015,1cyclictest0-21swapper/722:33:147
400810499203,13cyclictest0-21swapper/622:18:136
400809899204,15cyclictest0-21swapper/522:58:145
4008079992020,0cyclictest0-21swapper/321:23:003
400807999200,0cyclictest0-21swapper/300:36:153
400807999200,0cyclictest0-21swapper/300:19:313
400805999204,15cyclictest0-21swapper/019:48:130
1482032200,0sleep40-21swapper/400:34:484
400811199199,10cyclictest0-21swapper/720:33:147
4008111991918,1cyclictest2107-21gnome-shell20:39:597
4008111991915,4cyclictest0-21swapper/722:53:147
4008111991914,5cyclictest0-21swapper/720:18:147
4008111991913,6cyclictest0-21swapper/723:08:137
4008111991913,6cyclictest0-21swapper/721:03:147
4008111991913,6cyclictest0-21swapper/721:03:147
4008111991910,9cyclictest0-21swapper/721:48:147
4008098991918,1cyclictest2107-21gnome-shell23:59:595
4008090991911,8cyclictest0-21swapper/400:28:144
4008079991918,1cyclictest2107-21gnome-shell21:48:593
400807499190,19cyclictest0-21swapper/200:37:042
4008066991911,2cyclictest844-21nscd23:59:031
4008059991919,0cyclictest0-21swapper/000:37:000
946832180,0sleep10-21swapper/123:50:241
946832180,0sleep10-21swapper/123:50:241
40972312180,0sleep20-21swapper/221:20:132
40295462180,0sleep30-21swapper/319:40:193
4008111991818,0cyclictest0-21swapper/719:52:597
4008111991815,3cyclictest0-21swapper/723:58:147
4008104991817,0cyclictest0-21swapper/619:44:086
4008098991817,1cyclictest0-21swapper/522:13:145
4008098991816,1cyclictest2107-21gnome-shell22:18:595
4008079991817,1cyclictest2107-21gnome-shell21:12:593
4008079991816,1cyclictest2107-21gnome-shell19:12:593
400807999181,16cyclictest4083607-21diskmemload23:29:193
216999180,0rtkit-daemon0-21swapper/200:37:476
41684422170,1sleep121-21ksoftirqd/122:15:241
4008111991717,0cyclictest0-21swapper/719:29:507
4008111991713,4cyclictest0-21swapper/719:33:147
400810499178,7cyclictest823-21earlyoom00:18:586
4008098991716,1cyclictest0-21swapper/522:48:145
400807999172,11cyclictest4083607-21diskmemload00:27:173
400807999170,1cyclictest0-21swapper/322:39:423
400807999170,16cyclictest0-21swapper/322:46:453
4008059991716,1cyclictest97850irq/166-enp0s3122:46:140
1093712170,1sleep656-21ksoftirqd/600:03:116
4008111991612,4cyclictest0-21swapper/723:18:147
400811199160,16cyclictest0-21swapper/720:40:157
400807999164,12cyclictest0-21swapper/323:48:143
4008079991613,3cyclictest0-21swapper/322:14:223
400807999160,13cyclictest0-21swapper/319:30:193
400807999160,0cyclictest0-21swapper/323:14:433
400807499160,10cyclictest0-21swapper/219:43:142
216999160,1rtkit-daemon823-21earlyoom21:56:126
216999160,1rtkit-daemon2168-21rtkit-daemon00:29:322
216999160,1rtkit-daemon0-21swapper/220:15:196
41577512150,0sleep763-21ksoftirqd/722:07:297
400810499150,1cyclictest0-21swapper/600:25:246
400810499150,0cyclictest0-21swapper/623:28:586
4008098991515,0cyclictest0-21swapper/521:18:595
4008098991514,1cyclictest0-21swapper/521:05:205
400809899151,10cyclictest41759542sleep522:21:295
400809099153,11cyclictest0-21swapper/420:00:004
400807999154,8cyclictest1021132sleep323:56:513
400807999152,12cyclictest0-21swapper/321:42:323
4008079991513,2cyclictest0-21swapper/300:03:303
4008079991512,3cyclictest0-21swapper/321:35:123
4008074991515,0cyclictest0-21swapper/223:48:582
400807499150,0cyclictest0-21swapper/221:32:592
4008066991514,1cyclictest2107-21gnome-shell22:08:591
400806699150,14cyclictest91581-21sh23:49:441
400806699150,14cyclictest154421-21sh00:39:491
400805999153,6cyclictest0-21swapper/000:03:140
400805999153,2cyclictest121rcu_preempt23:09:570
4008059991513,1cyclictest0-21swapper/000:15:230
293842150,1sleep40-21swapper/423:00:134
400811199140,1cyclictest0-21swapper/722:38:077
400811199140,14cyclictest0-21swapper/722:57:297
400810499149,4cyclictest871-21nscd22:38:566
400810499140,9cyclictest823-21earlyoom23:32:036
400810499140,0cyclictest0-21swapper/623:49:406
400809899144,4cyclictest4033869-21kworker/5:221:20:155
4008098991413,1cyclictest0-21swapper/500:30:195
400809099142,10cyclictest4011169-21munin-node00:06:114
4008090991414,0cyclictest0-21swapper/423:49:594
4008090991412,1cyclictest4112558-21sh21:31:114
400807999141,9cyclictest2107-21gnome-shell20:26:093
4008079991412,2cyclictest0-21swapper/323:44:383
4008079991412,2cyclictest0-21swapper/322:17:093
400807999140,2cyclictest0-21swapper/322:24:323
400807999140,1cyclictest4070358-21awk20:45:233
400807999140,1cyclictest0-21swapper/322:01:343
400807999140,1cyclictest0-21swapper/300:33:093
400807999140,14cyclictest0-21swapper/320:35:593
400807999140,13cyclictest0-21swapper/320:40:253
400807999140,10cyclictest0-21swapper/322:41:023
400807999140,0cyclictest0-21swapper/319:27:323
400807499143,6cyclictest823-21earlyoom23:28:022
400806699148,5cyclictest901-21NetworkManager23:26:421
400806699141,11cyclictest4011169-21munin-node20:50:031
216999140,1rtkit-daemon2168-21rtkit-daemon19:27:152
216999140,0rtkit-daemon0-21swapper/623:09:512
41634532130,0sleep00-21swapper/022:11:380
41088852130,1sleep40-21swapper/421:29:544
4008111991313,0cyclictest0-21swapper/720:57:007
400811199130,13cyclictest0-21swapper/723:36:107
400811199130,0cyclictest0-21swapper/721:13:067
4008104991313,0cyclictest0-21swapper/620:00:536
4008098991313,0cyclictest0-21swapper/522:06:435
4008098991313,0cyclictest0-21swapper/521:49:295
400809899130,13cyclictest0-21swapper/523:40:535
400809899130,13cyclictest0-21swapper/523:28:125
400809899130,13cyclictest0-21swapper/521:37:085
400809899130,13cyclictest0-21swapper/520:00:235
400809899130,0cyclictest0-21swapper/522:43:185
400809099138,5cyclictest40205942sleep419:25:234
400809099132,3cyclictest121rcu_preempt23:08:154
4008090991313,0cyclictest0-21swapper/423:38:394
400809099130,8cyclictest128364-21systemd-userwor00:20:294
400809099130,13cyclictest0-21swapper/422:08:544
400809099130,0cyclictest0-21swapper/421:11:304
400809099130,0cyclictest0-21swapper/400:00:554
400807999133,9cyclictest4083607-21diskmemload22:54:233
400807999133,8cyclictest4083607-21diskmemload21:55:083
400807999133,6cyclictest35650-21/usr/sbin/munin23:05:223
4008079991313,0cyclictest0-21swapper/321:50:193
400807999131,1cyclictest4083607-21diskmemload23:38:053
400807999130,13cyclictest0-21swapper/323:23:393
400807999130,13cyclictest0-21swapper/300:11:573
400807999130,0cyclictest0-21swapper/320:54:033
400807999130,0cyclictest0-21swapper/319:24:473
400807499133,9cyclictest0-21swapper/222:25:082
400807499133,9cyclictest0-21swapper/222:25:082
4008074991313,0cyclictest0-21swapper/222:49:252
4008074991312,1cyclictest0-21swapper/223:58:512
400807499130,13cyclictest0-21swapper/222:57:422
400807499130,13cyclictest0-21swapper/222:07:172
4008066991312,1cyclictest21-21ksoftirqd/122:54:571
400806699130,13cyclictest0-21swapper/122:56:141
400806699130,13cyclictest0-21swapper/122:39:391
400806699130,13cyclictest0-21swapper/122:12:001
400806699130,13cyclictest0-21swapper/121:51:201
400806699130,13cyclictest0-21swapper/121:43:041
400806699130,13cyclictest0-21swapper/121:23:231
400806699130,13cyclictest0-21swapper/100:01:351
4008059991310,1cyclictest823-21earlyoom21:27:180
400805999130,13cyclictest0-21swapper/023:35:220
400805999130,12cyclictest0-21swapper/023:14:530
216999130,1rtkit-daemon4083607-21diskmemload22:51:306
216999130,0rtkit-daemon0-21swapper/222:14:316
466272120,0sleep40-21swapper/423:13:284
4008111991212,0cyclictest0-21swapper/723:24:197
4008111991212,0cyclictest0-21swapper/723:03:017
4008111991212,0cyclictest0-21swapper/722:19:267
4008111991212,0cyclictest0-21swapper/721:32:467
4008111991212,0cyclictest0-21swapper/719:15:227
4008111991212,0cyclictest0-21swapper/700:22:327
4008111991210,2cyclictest104944-21aten_rcpower_en00:00:147
400810499129,2cyclictest4017797-21sed19:20:246
400810499124,7cyclictest2297-21pool-gsd-smartc23:40:506
400810499122,1cyclictest0-21swapper/622:05:086
4008104991211,1cyclictest0-21swapper/621:40:246
4008104991211,1cyclictest0-21swapper/600:32:466
400810499120,12cyclictest0-21swapper/622:00:046
400810499120,12cyclictest0-21swapper/621:22:216
400809899128,3cyclictest845-21rngd23:10:035
4008098991212,0cyclictest0-21swapper/522:54:225
4008098991212,0cyclictest0-21swapper/520:45:455
4008098991212,0cyclictest0-21swapper/520:25:255
4008098991210,2cyclictest957-21ntpd23:35:525
400809899120,12cyclictest0-21swapper/521:43:585
400809899120,12cyclictest0-21swapper/520:59:545
400809899120,12cyclictest0-21swapper/519:51:365
400809899120,0cyclictest0-21swapper/521:52:155
400809899120,0cyclictest0-21swapper/519:35:595
400809899120,0cyclictest0-21swapper/519:35:595
4008090991212,0cyclictest0-21swapper/421:35:154
400809099120,12cyclictest0-21swapper/421:00:464
400809099120,12cyclictest0-21swapper/421:00:464
400809099120,12cyclictest0-21swapper/420:12:294
400809099120,12cyclictest0-21swapper/400:19:194
400807999121,8cyclictest4104353-21fschecks_time21:25:153
4008079991212,0cyclictest0-21swapper/321:31:073
400807999120,9cyclictest0-21swapper/300:23:183
400807999120,1cyclictest4083607-21diskmemload00:06:473
400807999120,10cyclictest0-21swapper/323:30:543
400807999120,10cyclictest0-21swapper/323:15:223
400807999120,10cyclictest0-21swapper/322:27:233
400807999120,10cyclictest0-21swapper/322:27:233
400807499123,6cyclictest4085553-21kworker/u16:321:16:472
4008074991212,0cyclictest0-21swapper/223:11:322
4008074991212,0cyclictest0-21swapper/222:03:532
4008074991212,0cyclictest0-21swapper/221:47:182
4008074991212,0cyclictest0-21swapper/221:11:512
4008074991211,1cyclictest28-21ksoftirqd/223:51:042
4008074991211,1cyclictest28-21ksoftirqd/223:51:032
4008074991211,1cyclictest0-21swapper/222:13:292
4008074991211,1cyclictest0-21swapper/200:34:572
400806699121,6cyclictest823-21earlyoom00:18:171
4008066991212,0cyclictest0-21swapper/123:12:101
400806699120,12cyclictest0-21swapper/121:19:191
400806699120,0cyclictest0-21swapper/100:27:471
4008059991212,0cyclictest0-21swapper/022:01:040
4008059991211,1cyclictest10-21ksoftirqd/021:19:550
216999120,1rtkit-daemon4011169-21munin-node21:01:372
216999120,1rtkit-daemon4011169-21munin-node21:01:372
216999120,1rtkit-daemon2297-21pool-gsd-smartc22:43:522
4008111991111,0cyclictest0-21swapper/722:13:157
4008111991111,0cyclictest0-21swapper/722:00:157
4008111991110,1cyclictest0-21swapper/720:29:597
400810499113,2cyclictest4052959-21aten2.4-expect20:20:146
400810499111,6cyclictest823-21earlyoom20:25:266
4008104991111,0cyclictest0-21swapper/621:10:586
4008104991110,1cyclictest0-21swapper/619:29:196
400810499110,11cyclictest0-21swapper/622:40:056
400810499110,0cyclictest0-21swapper/622:21:036
400809899114,7cyclictest957-21ntpd22:32:505
4008098991111,0cyclictest0-21swapper/523:52:595
4008098991111,0cyclictest0-21swapper/523:52:585
4008098991111,0cyclictest0-21swapper/523:05:265
4008098991111,0cyclictest0-21swapper/519:55:405
4008098991111,0cyclictest0-21swapper/519:44:065
4008098991110,1cyclictest0-21swapper/500:22:305
400809099118,2cyclictest4144455-21sshd21:56:314
4008090991111,0cyclictest0-21swapper/423:25:204
4008090991111,0cyclictest0-21swapper/422:46:484
4008090991111,0cyclictest0-21swapper/420:18:304
4008090991111,0cyclictest0-21swapper/419:40:464
400807999110,8cyclictest0-21swapper/320:24:553
400807999110,8cyclictest0-21swapper/320:15:173
400807999110,1cyclictest0-21swapper/321:15:193
400807999110,1cyclictest0-21swapper/320:00:153
4008074991111,0cyclictest0-21swapper/223:30:532
400807499110,11cyclictest0-21swapper/219:32:002
400806699115,5cyclictest99050irq/162-enp10s023:15:221
4008066991111,0cyclictest0-21swapper/123:03:521
4008066991111,0cyclictest0-21swapper/121:06:291
4008066991111,0cyclictest0-21swapper/100:11:311
400806699110,11cyclictest0-21swapper/120:55:061
400806699110,11cyclictest0-21swapper/120:31:411
400806699110,11cyclictest0-21swapper/119:10:421
400806699110,0cyclictest0-21swapper/121:00:281
400806699110,0cyclictest0-21swapper/121:00:281
400805999113,7cyclictest2297-21pool-gsd-smartc00:14:300
4008059991111,0cyclictest0-21swapper/022:58:380
4008059991111,0cyclictest0-21swapper/021:10:000
4008059991110,1cyclictest10-21ksoftirqd/022:41:030
400805999110,11cyclictest4083607-21diskmemload23:57:590
400805999110,11cyclictest0-21swapper/023:29:500
400805999110,11cyclictest0-21swapper/023:18:570
400805999110,11cyclictest0-21swapper/021:37:190
400805999110,11cyclictest0-21swapper/020:37:190
400805999110,0cyclictest0-21swapper/019:40:340
216999110,0rtkit-daemon0-21swapper/622:15:542
216999110,0rtkit-daemon0-21swapper/621:37:432
216999110,0rtkit-daemon0-21swapper/620:26:362
216999110,0rtkit-daemon0-21swapper/223:51:236
216999110,0rtkit-daemon0-21swapper/223:51:236
216999110,0rtkit-daemon0-21swapper/223:24:396
216999110,0rtkit-daemon0-21swapper/222:58:166
216999110,0rtkit-daemon0-21swapper/221:34:216
216999110,0rtkit-daemon0-21swapper/220:45:376
216999110,0rtkit-daemon0-21swapper/220:38:016
216999110,0rtkit-daemon0-21swapper/220:30:176
216999110,0rtkit-daemon0-21swapper/220:10:536
216999110,0rtkit-daemon0-21swapper/219:53:406
216999110,0rtkit-daemon0-21swapper/219:37:576
216999110,0rtkit-daemon0-21swapper/219:37:576
216999110,0rtkit-daemon0-21swapper/200:11:496
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional