You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 02:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Wed Sep 17, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
342612599690,2cyclictest3473110-21fschecks_count09:30:151
3426125996662,2cyclictest0-21swapper/111:35:391
3426125996461,2cyclictest0-21swapper/107:17:061
3426125996442,21cyclictest3440124-21kworker/1:107:55:161
3426125996442,20cyclictest3461483-21kworker/1:109:20:181
3426125996361,1cyclictest0-21swapper/107:39:021
342612599630,62cyclictest0-21swapper/112:15:261
342612599630,2cyclictest0-21swapper/109:39:531
342612599620,61cyclictest0-21swapper/112:36:331
3426125996159,1cyclictest0-21swapper/108:46:321
3426125996041,17cyclictest3482912-21kworker/1:210:55:161
3426125995956,2cyclictest0-21swapper/108:19:021
3426125995943,15cyclictest3482912-21kworker/1:210:35:011
3426125995941,17cyclictest3528527-21kworker/1:112:30:151
3426125995856,1cyclictest0-21swapper/108:30:381
3426125995856,1cyclictest0-21swapper/108:20:151
3426125995855,2cyclictest0-21swapper/109:58:321
3426125995855,2cyclictest0-21swapper/109:58:321
3426125995742,14cyclictest3482912-21kworker/1:210:40:051
3426125995742,14cyclictest3449256-21kworker/1:208:40:241
3426125995740,16cyclictest3449256-21kworker/1:208:50:151
3426125995740,16cyclictest3429823-21kworker/1:107:25:161
3426125995653,2cyclictest0-21swapper/107:51:031
3426125995641,14cyclictest3482912-21kworker/1:211:05:011
3426125995641,14cyclictest3482912-21kworker/1:210:22:041
3426125995641,14cyclictest3440124-21kworker/1:108:10:181
3426125995640,15cyclictest3461483-21kworker/1:109:05:291
3426125995639,16cyclictest3461483-21kworker/1:109:40:171
3426125995639,15cyclictest1423251-1kworker/1:1H08:00:151
3426125995638,16cyclictest3528527-21kworker/1:112:25:141
3426124995648,5cyclictest2111315-1kworker/0:0H12:30:230
3426125995553,1cyclictest0-21swapper/111:30:411
3426125995553,1cyclictest0-21swapper/109:49:041
3426125995540,14cyclictest3449256-21kworker/1:208:25:161
3426125995540,14cyclictest1423251-1kworker/1:1H11:25:171
3426125995539,15cyclictest3504426-21kworker/1:111:15:151
3426125995539,15cyclictest3449256-21kworker/1:208:35:161
3426125995539,15cyclictest1423251-1kworker/1:1H11:20:031
3426125995539,15cyclictest1423251-1kworker/1:1H08:05:011
3426125995538,16cyclictest3461483-21kworker/1:109:00:161
3426125995532,21cyclictest1423251-1kworker/1:1H12:00:011
342612599550,2cyclictest0-21swapper/112:11:581
3426125995440,14cyclictest3461483-21kworker/1:109:14:591
3426125995439,14cyclictest3482912-21kworker/1:211:04:571
3426125995439,14cyclictest3482912-21kworker/1:210:45:031
3426125995439,14cyclictest3429823-21kworker/1:107:20:141
3426125995438,15cyclictest3482912-21kworker/1:210:10:081
3426125995438,15cyclictest3482912-21kworker/1:210:10:081
3426125995438,15cyclictest3422977-21kworker/1:007:10:061
3426125995437,16cyclictest3513210-21kworker/1:211:50:001
3426125995437,16cyclictest1423251-1kworker/1:1H09:50:171
3426128995348,3cyclictest3447694-21kworker/2:209:39:002
3426128995348,3cyclictest1342754-1kworker/2:0H07:47:322
3426128995348,3cyclictest1342754-1kworker/2:0H07:18:322
3426125995351,1cyclictest0-21swapper/111:10:051
3426125995338,14cyclictest3528527-21kworker/1:112:20:081
3426125995338,14cyclictest3515741-21kworker/1:111:40:151
3426125995337,15cyclictest3520352-21kworker/1:112:05:061
3426125995337,15cyclictest3482912-21kworker/1:210:54:361
3426125995337,15cyclictest3449256-21kworker/1:208:55:141
3426125995334,18cyclictest3482912-21kworker/1:210:20:001
342612599530,51cyclictest0-21swapper/107:30:241
3426124995349,2cyclictest3469248-21kworker/0:109:25:050
3426128995248,3cyclictest1342754-1kworker/2:0H09:01:062
3426128995248,2cyclictest3421586-21kworker/2:207:42:022
3426128995247,3cyclictest3447694-21kworker/2:209:40:302
3426125995237,14cyclictest3520352-21kworker/1:112:02:031
3426125995237,14cyclictest3482912-21kworker/1:210:31:321
3426125995237,14cyclictest3432018-21kworker/1:207:45:151
3426125995236,15cyclictest3461483-21kworker/1:109:20:001
3426124995249,2cyclictest3465754-21kworker/0:209:11:560
3426124995248,2cyclictest3474129-21kworker/0:009:45:150
3426124995247,3cyclictest2111315-1kworker/0:0H11:30:450
3426131995147,3cyclictest483976-1kworker/3:1H12:20:143
3426128995148,2cyclictest3500660-21kworker/2:211:12:432
3426128995146,3cyclictest3522037-21kworker/2:012:02:022
3426128995146,3cyclictest3482247-21kworker/2:110:34:032
3426128995146,3cyclictest3447694-21kworker/2:209:25:232
3426128995146,3cyclictest3447694-21kworker/2:209:09:062
3426125995148,2cyclictest0-21swapper/109:29:511
3426125995136,14cyclictest3482912-21kworker/1:210:00:161
3426125995136,14cyclictest3432018-21kworker/1:207:40:171
3426124995148,2cyclictest3479011-21kworker/0:209:54:100
3426124995147,3cyclictest3498747-21kworker/0:110:57:040
3426124995147,2cyclictest3430021-21kworker/0:007:20:380
3426124995146,3cyclictest3531723-21kworker/0:012:39:330
3426128995047,2cyclictest3522037-21kworker/2:012:13:332
3426128995047,2cyclictest3500660-21kworker/2:211:54:032
3426128995046,3cyclictest1342754-1kworker/2:0H09:13:322
3426128995046,2cyclictest3530162-21kworker/2:212:32:382
3426128995045,3cyclictest3442760-21kworker/2:008:00:062
3426128995045,3cyclictest3421586-21kworker/2:207:24:032
3426128995039,6cyclictest1342754-1kworker/2:0H10:22:342
3426125995034,15cyclictest3513210-21kworker/1:211:50:051
3426125995034,15cyclictest3482912-21kworker/1:210:05:171
3426124995047,2cyclictest3447649-21kworker/0:208:27:110
3426124995046,2cyclictest3512282-21kworker/0:311:50:320
3426124995045,3cyclictest3425991-21kworker/0:207:26:200
3426131994946,2cyclictest3456002-21kworker/3:008:54:563
3426128994946,2cyclictest3500660-21kworker/2:211:32:082
3426128994946,2cyclictest3442760-21kworker/2:008:08:322
3426128994945,3cyclictest3442760-21kworker/2:008:14:022
3426128994945,2cyclictest3500660-21kworker/2:211:21:382
3426128994944,3cyclictest1342754-1kworker/2:0H11:35:162
3426128994943,3cyclictest1342754-1kworker/2:0H10:25:162
342612599491,47cyclictest0-21swapper/110:25:251
3426124994945,2cyclictest3485494-21kworker/0:210:26:000
3426124994944,3cyclictest3485494-21kworker/0:210:17:030
3426131994845,2cyclictest483976-1kworker/3:1H09:47:323
3426131994845,2cyclictest3492812-21kworker/3:210:39:563
3426131994842,4cyclictest483976-1kworker/3:1H10:30:393
3426128994846,1cyclictest3421586-21kworker/2:207:53:022
3426128994845,2cyclictest3500660-21kworker/2:210:55:062
3426128994845,2cyclictest3482247-21kworker/2:110:16:322
3426128994845,2cyclictest3482247-21kworker/2:110:07:322
3426128994845,2cyclictest3447694-21kworker/2:209:57:082
3426128994845,2cyclictest3447694-21kworker/2:209:57:072
3426128994845,2cyclictest3447694-21kworker/2:209:30:412
3426128994845,2cyclictest3421586-21kworker/2:207:29:042
3426128994844,3cyclictest3421586-21kworker/2:207:38:572
3426128994844,2cyclictest3500660-21kworker/2:211:43:332
3426128994844,2cyclictest3447694-21kworker/2:208:49:502
3426128994844,2cyclictest1342754-1kworker/2:0H11:00:152
3426128994844,2cyclictest1342754-1kworker/2:0H07:10:312
3426124994845,2cyclictest3525221-21kworker/0:112:12:030
3426124994845,1cyclictest2111315-1kworker/0:0H08:40:190
3426124994843,3cyclictest3424467-21kworker/0:107:11:380
3426131994744,2cyclictest3480621-21kworker/3:009:54:553
3426131994743,3cyclictest483976-1kworker/3:1H10:25:083
3426128994744,2cyclictest3522037-21kworker/2:012:23:332
3426128994744,2cyclictest3482247-21kworker/2:110:46:002
3426128994744,2cyclictest3482247-21kworker/2:110:13:042
3426128994744,2cyclictest3482247-21kworker/2:110:13:032
3426128994744,2cyclictest3447694-21kworker/2:209:53:332
3426128994744,2cyclictest3447694-21kworker/2:208:57:572
3426128994744,2cyclictest3421586-21kworker/2:207:31:142
3426128994742,3cyclictest3500660-21kworker/2:211:16:132
3426128994742,3cyclictest1342754-1kworker/2:0H09:48:322
3426128994742,3cyclictest1342754-1kworker/2:0H09:20:322
3426124994745,1cyclictest3472508-21kworker/0:209:41:390
3426124994744,2cyclictest3485494-21kworker/0:210:43:340
3426124994744,2cyclictest3437904-21kworker/0:007:45:270
3426124994744,2cyclictest2111315-1kworker/0:0H11:42:580
3426124994742,3cyclictest3454382-21kworker/0:008:45:420
3426124994742,3cyclictest2111315-1kworker/0:0H09:34:590
3426131994641,3cyclictest483976-1kworker/3:1H12:10:013
3426128994644,1cyclictest3447694-21kworker/2:208:35:292
3426128994643,2cyclictest3500660-21kworker/2:211:29:042
3426128994643,2cyclictest3500660-21kworker/2:211:05:052
3426128994642,3cyclictest3482247-21kworker/2:110:01:062
3426128994641,3cyclictest3500660-21kworker/2:211:48:032
3426124994643,2cyclictest3521960-21kworker/0:212:00:230
3426124994643,2cyclictest3485494-21kworker/0:210:35:440
3426124994643,2cyclictest2111315-1kworker/0:0H10:25:000
3426124994643,2cyclictest2111315-1kworker/0:0H10:06:590
3426124994642,3cyclictest3485494-21kworker/0:211:00:260
3426124994642,2cyclictest3512282-21kworker/0:311:45:290
3426124994642,2cyclictest2111315-1kworker/0:0H07:35:000
3426131994542,2cyclictest483976-1kworker/3:1H12:36:003
3426131994542,2cyclictest3442762-21kworker/3:208:34:553
3426131994541,3cyclictest483976-1kworker/3:1H11:20:253
3426131994541,3cyclictest483976-1kworker/3:1H07:21:333
3426131994541,3cyclictest3497117-21kworker/3:010:45:143
3426131994541,3cyclictest3487119-21kworker/3:010:24:553
3426128994542,2cyclictest3522037-21kworker/2:012:07:322
3426128994542,2cyclictest3482247-21kworker/2:110:50:332
3426128994542,2cyclictest3447694-21kworker/2:208:26:142
3426128994540,4cyclictest3447694-21kworker/2:208:50:332
3426124994543,1cyclictest3525221-21kworker/0:112:17:360
3426124994542,2cyclictest3437904-21kworker/0:008:06:080
3426124994542,2cyclictest3425991-21kworker/0:207:37:210
3426124994542,2cyclictest2111315-1kworker/0:0H11:58:590
3426124994542,1cyclictest2111315-1kworker/0:0H08:30:120
3426124994542,1cyclictest2111315-1kworker/0:0H08:20:000
3426124994541,2cyclictest3485494-21kworker/0:210:31:090
3426131994440,3cyclictest483976-1kworker/3:1H08:44:553
3426131994439,3cyclictest483976-1kworker/3:1H10:00:053
3426128994439,3cyclictest3530162-21kworker/2:212:29:582
3426124994441,2cyclictest3507101-21kworker/0:211:19:030
3426124994441,2cyclictest3485494-21kworker/0:210:12:030
3426124994441,2cyclictest3485494-21kworker/0:210:12:030
3426124994441,2cyclictest3425991-21kworker/0:207:43:310
3426124994440,3cyclictest3507101-21kworker/0:211:35:320
3426131994341,1cyclictest483976-1kworker/3:1H08:09:343
3426131994340,2cyclictest483976-1kworker/3:1H11:49:553
3426131994340,2cyclictest483976-1kworker/3:1H08:46:573
3426131994338,2cyclictest483976-1kworker/3:1H10:40:143
3426128994340,2cyclictest3500660-21kworker/2:211:56:112
3426128994338,3cyclictest3421586-21kworker/2:207:55:242
3426128994338,3cyclictest1342754-1kworker/2:0H12:37:332
3426124994341,1cyclictest3454382-21kworker/0:009:05:430
3426124994340,2cyclictest3447649-21kworker/0:208:21:320
3426124994339,2cyclictest3498747-21kworker/0:110:53:330
3426124994338,3cyclictest3437904-21kworker/0:007:59:320
3426131994239,2cyclictest483976-1kworker/3:1H11:04:543
3426131994238,3cyclictest483976-1kworker/3:1H09:25:163
3426131994238,2cyclictest483976-1kworker/3:1H09:15:153
3426128994237,3cyclictest3482247-21kworker/2:110:35:322
3426128994237,3cyclictest3447694-21kworker/2:208:15:592
3426124994238,2cyclictest2111315-1kworker/0:0H11:25:030
3426124994238,2cyclictest2111315-1kworker/0:0H09:55:140
3426124994238,2cyclictest2111315-1kworker/0:0H09:55:140
3426131994137,3cyclictest483976-1kworker/3:1H08:04:393
3426131994137,3cyclictest483976-1kworker/3:1H07:53:573
3426131994137,2cyclictest483976-1kworker/3:1H11:35:163
3426131994137,2cyclictest483976-1kworker/3:1H08:19:353
3426131994137,2cyclictest483976-1kworker/3:1H07:14:213
3426131994135,4cyclictest483976-1kworker/3:1H07:36:403
3426124994138,2cyclictest2111315-1kworker/0:0H07:51:030
3426124994136,2cyclictest2111315-1kworker/0:0H08:59:460
3426131994037,2cyclictest483976-1kworker/3:1H10:55:013
3426131994037,2cyclictest3433056-21kworker/3:107:49:553
3426131994036,3cyclictest483976-1kworker/3:1H10:09:583
3426131994035,3cyclictest483976-1kworker/3:1H11:20:013
3426131994035,3cyclictest483976-1kworker/3:1H09:39:583
3426124994036,2cyclictest2111315-1kworker/0:0H11:20:150
3426131993937,1cyclictest483976-1kworker/3:1H08:25:163
3426131993936,2cyclictest3515467-21kworker/3:011:44:563
3426131993936,2cyclictest3503867-21kworker/3:111:29:553
3426131993935,2cyclictest483976-1kworker/3:1H07:40:173
3426131993835,2cyclictest483976-1kworker/3:1H11:05:023
3426131993835,2cyclictest3487119-21kworker/3:010:15:143
3426131993834,3cyclictest483976-1kworker/3:1H12:00:053
3426131993833,3cyclictest483976-1kworker/3:1H09:58:583
3426131993833,3cyclictest483976-1kworker/3:1H09:58:573
3426131993833,3cyclictest483976-1kworker/3:1H09:24:553
3426131993832,4cyclictest483976-1kworker/3:1H09:05:323
3426128993834,3cyclictest3522037-21kworker/2:012:19:032
3426131993733,2cyclictest3433056-21kworker/3:107:57:593
3426128993734,2cyclictest1342754-1kworker/2:0H08:43:312
3426124993735,1cyclictest3465754-21kworker/0:209:15:220
3426124993734,2cyclictest3451407-21kworker/0:108:37:370
3426124993733,2cyclictest2111315-1kworker/0:0H10:02:580
3426124993732,3cyclictest2111315-1kworker/0:0H12:30:010
3426131993633,2cyclictest483976-1kworker/3:1H12:34:543
3426128993631,3cyclictest3447694-21kworker/2:208:21:572
3426124993530,3cyclictest2111315-1kworker/0:0H11:10:150
3426131993430,3cyclictest483976-1kworker/3:1H12:10:193
3426131993429,3cyclictest483976-1kworker/3:1H09:44:543
3426131993428,5cyclictest483976-1kworker/3:1H09:10:063
3426124993431,2cyclictest2111315-1kworker/0:0H07:16:010
3426131993330,2cyclictest483976-1kworker/3:1H09:33:023
3426131993330,2cyclictest3525229-21kworker/3:112:29:543
3426131993329,3cyclictest483976-1kworker/3:1H08:39:553
3426131993327,4cyclictest483976-1kworker/3:1H10:10:153
3426131993327,4cyclictest483976-1kworker/3:1H10:10:143
3426128993329,2cyclictest1342754-1kworker/2:0H08:30:122
3426125993312,19cyclictest3426163-21latency_hist07:10:001
3426124993329,2cyclictest2111315-1kworker/0:0H12:07:570
3426131993228,3cyclictest483976-1kworker/3:1H11:10:203
3426131993128,2cyclictest3442762-21kworker/3:208:14:553
3426131993127,3cyclictest483976-1kworker/3:1H09:01:113
3426131993127,3cyclictest483976-1kworker/3:1H07:30:363
3426131993027,2cyclictest3528468-21kworker/3:012:19:543
3426124993027,2cyclictest2111315-1kworker/0:0H08:53:570
3426131992925,3cyclictest3503867-21kworker/3:111:30:153
3426131992816,5cyclictest654-21snmpd08:56:483
3426124992824,3cyclictest2111315-1kworker/0:0H09:37:580
3426124992820,4cyclictest2111315-1kworker/0:0H12:20:220
3426131992723,2cyclictest0-21swapper/311:53:133
3426131992722,3cyclictest3442762-21kworker/3:208:20:153
342612899271,16cyclictest3467913-21apt-get09:15:122
3426131992622,2cyclictest3424465-21kworker/3:007:15:143
3426124992623,1cyclictest2111315-1kworker/0:0H09:05:000
342613199250,16cyclictest3521989-21latency_hist12:00:013
3426128992312,7cyclictest1756130-21systemd-journal10:45:002
342613199224,14cyclictest3431640-21/usr/sbin/munin07:25:183
3426124992219,2cyclictest0-21swapper/008:10:200
3426124992217,3cyclictest3469542-21cat09:20:150
342612499212,12cyclictest3498135-21sed10:45:160
342612499210,5cyclictest151rcu_preempt11:05:200
342613199200,13cyclictest654-21snmpd10:52:473
342612499191,10cyclictest3443064-21apt-get08:00:130
3426131991813,3cyclictest40-21ksoftirqd/307:10:003
3426124991611,3cyclictest3426193-21sort07:10:000
342612899144,2cyclictest151rcu_preempt07:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional