You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-29 - 12:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Wed Oct 29, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2188821997243,28cyclictest2217298-21kworker/1:220:50:181
2188821997240,30cyclictest2188598-21kworker/1:119:35:141
2188821996942,26cyclictest2188598-21kworker/1:119:45:161
2188821996939,28cyclictest2217298-21kworker/1:220:40:151
2188821996842,25cyclictest2239019-21kworker/1:021:45:011
2188821996841,26cyclictest2239019-21kworker/1:022:00:161
2188821996840,26cyclictest2217298-21kworker/1:221:15:161
2188821996743,23cyclictest2259005-21kworker/1:022:45:161
2188821996739,26cyclictest2218718-1kworker/1:0H23:25:141
2188821996437,25cyclictest1650801-1kworker/1:1H19:30:151
218882199630,62cyclictest0-21swapper/123:01:281
218882199621,59cyclictest0-21swapper/120:55:171
218882199620,1cyclictest0-21swapper/123:36:361
2188821996134,25cyclictest2188598-21kworker/1:119:15:161
2188821996134,25cyclictest2188598-21kworker/1:119:15:161
2188821996046,2cyclictest26250irq/16-i801_smb19:55:161
2188821996044,15cyclictest2283044-21kworker/1:200:05:171
2188821996043,15cyclictest2208934-21kworker/1:220:10:161
2188821996042,17cyclictest2239019-21kworker/1:022:15:001
2188821996042,17cyclictest2239019-21kworker/1:022:05:161
2188821996041,17cyclictest2268985-21kworker/1:123:40:151
2188821996038,20cyclictest2268985-21kworker/1:123:50:161
2188821996036,14cyclictest2188598-21kworker/1:119:25:151
218882199600,49cyclictest2294380-21cron00:30:011
2188821995943,15cyclictest2217298-21kworker/1:221:00:111
2188821995941,17cyclictest2239019-21kworker/1:021:45:161
2188821995854,2cyclictest0-21swapper/122:30:281
2188821995843,14cyclictest2283044-21kworker/1:223:55:011
2188821995843,14cyclictest2259005-21kworker/1:022:50:271
2188821995843,14cyclictest2213804-21kworker/1:120:26:261
2188821995842,15cyclictest2250073-21kworker/1:122:25:141
2188821995842,15cyclictest2217298-21kworker/1:220:45:191
2188821995841,16cyclictest2294370-21kworker/1:200:30:161
2188821995836,14cyclictest2250073-21kworker/1:122:15:151
2188821995833,16cyclictest2217298-21kworker/1:221:35:171
2188821995751,3cyclictest0-21swapper/100:17:061
2188821995743,14cyclictest2256776-21kworker/1:222:35:231
2188821995742,14cyclictest2218718-1kworker/1:0H23:45:251
2188821995742,14cyclictest2217298-21kworker/1:221:30:051
2188821995742,14cyclictest2208934-21kworker/1:220:15:011
2188821995742,14cyclictest2188598-21kworker/1:119:11:371
2188821995741,15cyclictest2217298-21kworker/1:220:35:151
2188821995739,17cyclictest2217298-21kworker/1:221:05:151
2188821995739,17cyclictest2202483-21kworker/1:219:55:011
2188821995642,14cyclictest2283044-21kworker/1:200:10:321
2188821995642,14cyclictest2259005-21kworker/1:022:58:111
2188821995641,14cyclictest2259005-21kworker/1:022:40:161
2188821995641,14cyclictest2217298-21kworker/1:221:29:361
2188821995641,14cyclictest2208934-21kworker/1:220:20:001
2188821995638,17cyclictest2291730-21kworker/1:100:20:151
2188823995550,3cyclictest2033112-1kworker/2:0H23:25:142
2188821995540,14cyclictest2239019-21kworker/1:021:56:201
2188821995539,15cyclictest2217298-21kworker/1:221:11:301
218882199550,2cyclictest1208-21cron00:05:011
2188823995449,3cyclictest2033112-1kworker/2:0H21:20:012
2188821995440,14cyclictest2204653-21kworker/1:020:08:001
2188821995439,14cyclictest2296047-21kworker/1:000:36:491
2188821995439,14cyclictest2268985-21kworker/1:123:19:041
2188821995439,14cyclictest2259005-21kworker/1:023:10:161
2188821995439,14cyclictest2250073-21kworker/1:122:23:371
2188821995439,14cyclictest2213804-21kworker/1:120:30:011
2188821995438,15cyclictest2239019-21kworker/1:021:50:011
2188821995438,15cyclictest2188598-21kworker/1:119:20:191
2188821995437,16cyclictest2204653-21kworker/1:020:00:181
2188821995436,17cyclictest2268985-21kworker/1:123:20:191
2188818995450,2cyclictest2190515-21kworker/0:019:16:230
2188818995450,2cyclictest2190515-21kworker/0:019:16:230
2188829995348,3cyclictest2258379-21kworker/3:222:40:223
2188829995348,3cyclictest2214918-21kworker/3:220:39:363
2188829995348,3cyclictest2214918-21kworker/3:220:31:253
2188821995339,14cyclictest2259005-21kworker/1:023:06:291
2188821995338,14cyclictest2188598-21kworker/1:119:40:151
2188818995350,2cyclictest2263265-21kworker/0:023:06:020
2188818995349,2cyclictest2255144-21kworker/0:122:36:400
2188829995248,2cyclictest1816370-1kworker/3:2H23:29:113
2188829995247,3cyclictest1816370-1kworker/3:2H20:49:353
2188821995237,14cyclictest2217298-21kworker/1:221:21:471
2188821995236,15cyclictest2268985-21kworker/1:123:30:001
2188818995248,2cyclictest2199184-21kworker/0:219:44:000
2188818995247,3cyclictest2297609-21kworker/0:200:37:230
2188818995247,3cyclictest2268435-21kworker/0:323:27:360
2188829995147,2cyclictest2276490-21kworker/3:123:49:353
2188829995147,2cyclictest2221923-21kworker/3:121:40:063
2188829995147,2cyclictest1816370-1kworker/3:2H23:02:353
2188829995146,3cyclictest2291102-21kworker/3:000:32:013
2188829995146,3cyclictest2276490-21kworker/3:123:42:063
2188829995146,3cyclictest1816370-1kworker/3:2H19:18:423
2188829995146,3cyclictest1816370-1kworker/3:2H19:18:423
2188823995146,4cyclictest2033112-1kworker/2:0H19:15:242
2188823995146,4cyclictest2033112-1kworker/2:0H19:15:232
2188823995146,3cyclictest2033112-1kworker/2:0H00:32:072
2188818995147,3cyclictest2274881-21kworker/0:000:03:370
2188818995147,2cyclictest2192680-21kworker/0:219:26:020
2188818995146,3cyclictest2263265-21kworker/0:023:03:060
2188818995146,3cyclictest2263265-21kworker/0:022:56:040
2188818995139,2cyclictest2205758-21kworker/0:320:10:570
2188829995046,2cyclictest2241662-21kworker/3:222:10:523
2188823995047,2cyclictest2240041-21kworker/2:122:14:062
2188823995045,3cyclictest2033112-1kworker/2:0H20:40:572
2188823995045,3cyclictest2033112-1kworker/2:0H00:15:262
2188823995044,4cyclictest2230089-21kworker/2:021:21:412
2188818995047,2cyclictest2274881-21kworker/0:000:17:160
2188818995047,2cyclictest2220298-21kworker/0:120:45:550
2188818995047,2cyclictest2210542-21kworker/0:020:20:260
2188818995046,2cyclictest2235164-21kworker/0:121:42:230
2188818995046,2cyclictest2225159-21kworker/0:221:00:320
2188818995046,2cyclictest2204061-21kworker/0:020:04:060
2188818995044,4cyclictest2112903-1kworker/0:0H00:20:140
2188829994946,2cyclictest2258379-21kworker/3:222:36:303
2188829994946,2cyclictest2221923-21kworker/3:121:20:123
2188829994946,2cyclictest1816370-1kworker/3:2H21:50:473
2188829994945,3cyclictest2188601-21kworker/3:119:10:533
2188829994945,3cyclictest1816370-1kworker/3:2H23:17:063
2188829994944,3cyclictest2221923-21kworker/3:121:16:093
2188829994944,3cyclictest1816370-1kworker/3:2H20:50:113
2188829994944,3cyclictest1816370-1kworker/3:2H20:05:293
2188829994943,4cyclictest1816370-1kworker/3:2H19:30:323
2188829994942,4cyclictest1816370-1kworker/3:2H21:47:363
2188823994946,2cyclictest2253583-21kworker/2:023:54:062
2188823994945,3cyclictest2033112-1kworker/2:0H21:34:362
2188823994945,2cyclictest2253583-21kworker/2:022:56:332
2188818994946,2cyclictest2274881-21kworker/0:000:14:010
2188818994945,2cyclictest2274881-21kworker/0:000:05:470
2188818994944,3cyclictest2255144-21kworker/0:122:45:110
2188829994845,2cyclictest2221923-21kworker/3:121:10:223
2188829994845,2cyclictest2208937-21kworker/3:020:20:063
2188829994844,3cyclictest2291102-21kworker/3:000:35:293
2188818994845,2cyclictest2255144-21kworker/0:122:52:020
2188818994845,2cyclictest2235164-21kworker/0:121:45:070
2188818994845,2cyclictest2228667-21kworker/0:021:31:210
2188818994845,2cyclictest2199184-21kworker/0:219:57:030
2188818994844,3cyclictest2210542-21kworker/0:020:27:020
2188829994744,2cyclictest2208937-21kworker/3:020:10:373
2188829994743,3cyclictest2250028-21kworker/3:022:20:323
2188829994742,3cyclictest1816370-1kworker/3:2H19:41:213
2188829994740,4cyclictest1816370-1kworker/3:2H22:45:163
2188823994744,2cyclictest2253583-21kworker/2:000:12:172
2188823994741,4cyclictest2033112-1kworker/2:0H20:10:182
2188818994744,2cyclictest2274881-21kworker/0:023:37:370
2188818994743,3cyclictest2112903-1kworker/0:0H23:20:250
2188818994743,2cyclictest2248453-21kworker/0:322:11:210
2188829994643,2cyclictest2276490-21kworker/3:100:06:043
2188829994642,3cyclictest2292744-21kworker/3:200:24:063
2188829994642,2cyclictest2188601-21kworker/3:119:25:063
2188829994641,3cyclictest2276490-21kworker/3:100:13:373
2188829994641,3cyclictest1816370-1kworker/3:2H23:51:463
2188829994641,3cyclictest1816370-1kworker/3:2H21:00:153
2188829994640,3cyclictest1816370-1kworker/3:2H19:50:013
2188823994643,2cyclictest2253583-21kworker/2:022:47:012
2188823994643,2cyclictest2200812-21kworker/2:220:04:012
2188823994643,2cyclictest1695164-21kworker/2:019:40:372
2188823994642,3cyclictest2033112-1kworker/2:0H20:27:352
2188818994643,2cyclictest2244899-21kworker/0:022:00:340
2188818994643,2cyclictest2240022-21kworker/0:221:50:320
2188818994643,2cyclictest2187313-21kworker/0:119:10:370
2188818994642,2cyclictest2268396-21kworker/0:123:12:410
2188818994642,2cyclictest2255144-21kworker/0:122:41:350
2188818994642,2cyclictest2228667-21kworker/0:021:21:520
2188829994542,2cyclictest2208937-21kworker/3:020:15:243
2188829994542,2cyclictest2202438-21kworker/3:019:50:423
2188829994541,3cyclictest2276490-21kworker/3:123:55:243
2188829994541,3cyclictest2276490-21kworker/3:100:16:463
2188829994540,3cyclictest2214918-21kworker/3:220:25:523
2188823994542,2cyclictest2253583-21kworker/2:023:33:102
2188823994541,3cyclictest2230089-21kworker/2:021:42:352
2188823994541,2cyclictest2253583-21kworker/2:023:45:072
2188823994541,2cyclictest2253583-21kworker/2:023:05:062
2188823994540,3cyclictest2033112-1kworker/2:0H00:00:152
2188818994542,2cyclictest2195945-21kworker/0:019:34:060
2188818994542,2cyclictest2112903-1kworker/0:0H19:38:360
2188818994541,3cyclictest2274881-21kworker/0:023:46:450
2188829994441,2cyclictest2258379-21kworker/3:222:50:473
2188829994439,3cyclictest2291102-21kworker/3:000:28:353
2188829994439,3cyclictest1816370-1kworker/3:2H23:31:103
2188829994438,3cyclictest1816370-1kworker/3:2H23:35:143
2188823994439,3cyclictest2033112-1kworker/2:0H22:32:352
2188823994438,4cyclictest2240041-21kworker/2:122:06:262
2188823994438,3cyclictest2033112-1kworker/2:0H23:40:002
2188818994441,2cyclictest2225159-21kworker/0:220:59:360
2188818994440,3cyclictest2228667-21kworker/0:021:18:120
2188818994440,2cyclictest2235164-21kworker/0:121:35:050
2188818994440,2cyclictest2112903-1kworker/0:0H23:15:150
2188818994439,3cyclictest2112903-1kworker/0:0H23:57:470
2188818994439,3cyclictest2112903-1kworker/0:0H22:20:250
2188818994437,4cyclictest2112903-1kworker/0:0H21:10:140
2188829994340,2cyclictest2214918-21kworker/3:220:40:233
2188829994339,3cyclictest2264884-21kworker/3:223:09:063
2188823994340,2cyclictest2253583-21kworker/2:023:56:352
2188823994340,2cyclictest2253583-21kworker/2:023:16:302
2188823994340,2cyclictest2200812-21kworker/2:221:10:422
2188823994340,2cyclictest2200812-21kworker/2:219:50:352
2188823994339,2cyclictest1695164-21kworker/2:019:32:052
2188823994338,3cyclictest2033112-1kworker/2:0H22:25:152
2188818994339,2cyclictest2274881-21kworker/0:023:43:010
2188818994339,2cyclictest2274881-21kworker/0:000:29:030
2188818994339,2cyclictest2112903-1kworker/0:0H19:20:190
2188818994338,3cyclictest2112903-1kworker/0:0H22:15:240
2188829994239,2cyclictest2197555-21kworker/3:219:36:503
2188829994239,2cyclictest1816370-1kworker/3:2H22:04:353
2188829994238,3cyclictest1816370-1kworker/3:2H19:23:073
2188829994238,2cyclictest1816370-1kworker/3:2H22:55:143
2188823994239,2cyclictest2294424-21kworker/2:100:37:592
2188823994239,2cyclictest2240041-21kworker/2:122:01:202
2188823994238,2cyclictest2253583-21kworker/2:023:23:482
2188823994237,3cyclictest2033112-1kworker/2:0H20:30:142
2188818994238,2cyclictest2200823-21kworker/0:019:45:060
2188829994138,2cyclictest2250028-21kworker/3:022:17:053
2188829994138,2cyclictest2221923-21kworker/3:121:09:013
2188829994137,2cyclictest1816370-1kworker/3:2H22:08:353
2188829994135,3cyclictest1816370-1kworker/3:2H20:00:563
2188823994138,2cyclictest2253583-21kworker/2:023:10:122
2188823994138,2cyclictest2240041-21kworker/2:121:45:442
2188823994137,2cyclictest2200812-21kworker/2:220:50:002
2188818994138,2cyclictest2225159-21kworker/0:221:08:060
2188818994138,2cyclictest2205758-21kworker/0:320:15:170
2188829994037,2cyclictest1816370-1kworker/3:2H23:14:363
2188829994037,2cyclictest1816370-1kworker/3:2H19:58:363
2188829994036,3cyclictest2276490-21kworker/3:100:01:493
2188829994035,3cyclictest1816370-1kworker/3:2H21:55:143
2188823994037,2cyclictest2240041-21kworker/2:122:16:532
2188823994037,2cyclictest2200812-21kworker/2:221:05:422
2188823994037,2cyclictest2033112-1kworker/2:0H20:20:522
2188823994037,2cyclictest2033112-1kworker/2:0H19:45:162
2188823994036,2cyclictest2240041-21kworker/2:122:23:422
2188823994036,2cyclictest2033112-1kworker/2:0H22:35:152
2188818994038,1cyclictest2228667-21kworker/0:021:25:060
2188818994037,2cyclictest2274881-21kworker/0:023:33:000
2188818994036,2cyclictest2220298-21kworker/0:120:53:060
2188829993936,2cyclictest1816370-1kworker/3:2H20:55:013
2188829993935,2cyclictest1816370-1kworker/3:2H22:30:113
2188823993935,2cyclictest2033112-1kworker/2:0H20:20:002
2188818993936,2cyclictest2274881-21kworker/0:000:34:160
2188818993936,2cyclictest2255144-21kworker/0:122:33:360
2188829993835,2cyclictest1816370-1kworker/3:2H23:20:333
2188823993834,3cyclictest2033112-1kworker/2:0H19:40:002
2188823993833,3cyclictest2033112-1kworker/2:0H19:26:202
2188818993834,2cyclictest2210542-21kworker/0:020:36:550
2188818993834,2cyclictest2112903-1kworker/0:0H23:55:000
2188823993735,1cyclictest2033112-1kworker/2:0H21:25:142
2188823993733,3cyclictest2033112-1kworker/2:0H22:00:002
2188823993732,3cyclictest2033112-1kworker/2:0H21:36:162
2188818993734,2cyclictest2243268-21kworker/0:121:55:220
2188823993631,3cyclictest2033112-1kworker/2:0H20:05:562
2188818993633,2cyclictest2244899-21kworker/0:022:05:470
2188829993531,3cyclictest1816370-1kworker/3:2H22:28:373
2188823993531,2cyclictest2033112-1kworker/2:0H19:20:182
2188818993531,3cyclictest2210542-21kworker/0:020:30:410
2188829993429,3cyclictest2221923-21kworker/3:121:26:303
2188823993431,2cyclictest2033112-1kworker/2:0H00:30:012
2188823993429,3cyclictest2033112-1kworker/2:0H21:00:152
2188829993328,3cyclictest1816370-1kworker/3:2H21:34:063
2188823993329,2cyclictest2033112-1kworker/2:0H23:00:142
2188823993227,3cyclictest2033112-1kworker/2:0H22:40:172
2188818993227,3cyclictest2112903-1kworker/0:0H20:05:170
2188823993128,2cyclictest2033112-1kworker/2:0H19:58:052
2188823993127,2cyclictest2033112-1kworker/2:0H20:50:182
2188818993128,2cyclictest2248453-21kworker/0:322:26:230
2188818993128,2cyclictest2220298-21kworker/0:120:44:070
2188823993027,2cyclictest2033112-1kworker/2:0H00:22:012
2188823993026,3cyclictest2033112-1kworker/2:0H22:51:032
218882399300,2cyclictest151rcu_preempt21:50:192
218882199302,26cyclictest2188912-21latency_hist19:10:001
2188823992925,3cyclictest2033112-1kworker/2:0H00:05:262
2188829992823,3cyclictest1816370-1kworker/3:2H21:35:153
2188823992824,2cyclictest2033112-1kworker/2:0H19:10:152
2188823992520,4cyclictest2033112-1kworker/2:0H20:56:352
218882399240,5cyclictest0-21swapper/220:35:152
218882399240,4cyclictest0-21swapper/223:40:172
2188818992312,6cyclictest2112903-1kworker/0:0H19:09:590
218881899226,15cyclictest171rcuc/019:50:150
218882999183,13cyclictest0-21swapper/319:10:013
218882399160,10cyclictest2188958-21gpgv19:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional